Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260811 06:16:41.387815 10029 test_util.cc:268] Using random seed: 1779125976
2026-08-11T06:16:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T06:16:41Z Disabled control of system clock
I20260811 06:16:41.424978 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.126:33303
--webserver_interface=127.9.203.126
--webserver_port=0
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260811 06:16:41.779919 10041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:41.780254 10041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:41.780339 10041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:41.788214 10041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:16:41.788341 10041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:41.788390 10041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:16:41.788467 10041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:16:41.798172 10041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.126:33303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.203.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:41.799858 10041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:41.801900 10041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:16:41.817430 10053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:41.817510 10059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:41.817472 10057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:41.818113 10041 server_base.cc:1034] running on GCE node
I20260811 06:16:41.819060 10041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:41.821096 10041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:41.822397 10041 hybrid_clock.cc:648] HybridClock initialized: now 1786429001822316 us; error 66 us; skew 500 ppm
I20260811 06:16:41.822867 10041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:41.825892 10041 webserver.cc:460] Webserver started at http://127.9.203.126:41171/ using document root <none> and password file <none>
I20260811 06:16:41.826841 10041 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:41.826977 10041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:41.827409 10041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:41.830754 10041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data/instance:
uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
format_stamp: "Formatted at 2026-08-11 06:16:41 on dist-test-slave-cvwc"
I20260811 06:16:41.831663 10041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal/instance:
uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
format_stamp: "Formatted at 2026-08-11 06:16:41 on dist-test-slave-cvwc"
I20260811 06:16:41.838866 10041 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 06:16:41.844856 10069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:41.846797 10041 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260811 06:16:41.847025 10041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal
uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
format_stamp: "Formatted at 2026-08-11 06:16:41 on dist-test-slave-cvwc"
I20260811 06:16:41.847261 10041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:41.871767 10041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:41.872733 10041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:41.873062 10041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:41.892876 10041 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.126:33303
I20260811 06:16:41.892910 10155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.126:33303 every 8 connection(s)
I20260811 06:16:41.894585 10041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/data/info.pb
I20260811 06:16:41.895735 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 10041
I20260811 06:16:41.896039 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-0/wal/instance
I20260811 06:16:41.898940 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.125:35327
--webserver_interface=127.9.203.125
--webserver_port=0
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260811 06:16:41.899232 10156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:41.906560 10156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:41.927120 10156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } has no permanent_uuid. Determining permanent_uuid...
W20260811 06:16:41.928654 10073 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
W20260811 06:16:41.930414 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
I20260811 06:16:41.979867 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } attempt: 1
W20260811 06:16:41.981999 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
I20260811 06:16:42.050292 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } attempt: 2
W20260811 06:16:42.052500 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
I20260811 06:16:42.143793 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } attempt: 3
W20260811 06:16:42.146095 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
I20260811 06:16:42.289382 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } attempt: 4
W20260811 06:16:42.291750 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111)
W20260811 06:16:42.300760 10159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:42.301224 10159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:42.301471 10159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:42.314693 10159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:16:42.314963 10159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:42.315124 10159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:16:42.315349 10159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:16:42.329567 10159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.125:35327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.203.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:42.331349 10159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:42.333652 10159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:16:42.351850 10171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:42.352824 10178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:42.354326 10176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:42.355590 10159 server_base.cc:1034] running on GCE node
I20260811 06:16:42.356693 10159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:42.358531 10159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:42.359897 10159 hybrid_clock.cc:648] HybridClock initialized: now 1786429002359713 us; error 40 us; skew 500 ppm
I20260811 06:16:42.360414 10159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:42.364636 10159 webserver.cc:460] Webserver started at http://127.9.203.125:45215/ using document root <none> and password file <none>
I20260811 06:16:42.365645 10159 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:42.365907 10159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:42.366402 10159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:42.370347 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/instance:
uuid: "a36d6d06a0cb4489b5014178b9973219"
format_stamp: "Formatted at 2026-08-11 06:16:42 on dist-test-slave-cvwc"
I20260811 06:16:42.371421 10159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal/instance:
uuid: "a36d6d06a0cb4489b5014178b9973219"
format_stamp: "Formatted at 2026-08-11 06:16:42 on dist-test-slave-cvwc"
I20260811 06:16:42.379235 10159 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260811 06:16:42.384743 10184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:42.386605 10159 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:42.386948 10159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
uuid: "a36d6d06a0cb4489b5014178b9973219"
format_stamp: "Formatted at 2026-08-11 06:16:42 on dist-test-slave-cvwc"
I20260811 06:16:42.387247 10159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:42.411682 10159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:42.413352 10159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:42.413995 10159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:42.466967 10159 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.125:35327
I20260811 06:16:42.467133 10268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.125:35327 every 8 connection(s)
I20260811 06:16:42.468950 10159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
I20260811 06:16:42.472653 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 10159
I20260811 06:16:42.472913 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal/instance
I20260811 06:16:42.474747 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--webserver_interface=127.9.203.124
--webserver_port=0
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260811 06:16:42.476454 10270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:42.488857 10270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:42.510654 10270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:42.527109 10270 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } has no permanent_uuid. Determining permanent_uuid...
W20260811 06:16:42.529273 10186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
W20260811 06:16:42.532635 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.582135 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 1
W20260811 06:16:42.584627 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.591173 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } attempt: 5
I20260811 06:16:42.600270 10156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } has no permanent_uuid. Determining permanent_uuid...
W20260811 06:16:42.602803 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.653046 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 2
I20260811 06:16:42.654289 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 1
W20260811 06:16:42.655795 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
W20260811 06:16:42.656744 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.725127 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 2
W20260811 06:16:42.727600 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.747134 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 3
W20260811 06:16:42.749492 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.833992 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 3
W20260811 06:16:42.836906 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:42.892805 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 4
W20260811 06:16:42.895556 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:43.014287 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 4
W20260811 06:16:43.016398 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:43.194795 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 5
W20260811 06:16:43.197001 10270 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
W20260811 06:16:43.227028 10273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:43.227494 10273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:43.227738 10273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:43.239385 10273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:16:43.239630 10273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:43.239746 10273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:16:43.239892 10273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:16:43.253420 10273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.203.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:43.255173 10273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:43.257987 10273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:16:43.277434 10291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:43.278411 10295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:43.278592 10292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:43.280189 10273 server_base.cc:1034] running on GCE node
I20260811 06:16:43.281256 10273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:43.283068 10273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:43.284435 10273 hybrid_clock.cc:648] HybridClock initialized: now 1786429003284241 us; error 43 us; skew 500 ppm
I20260811 06:16:43.284905 10273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:43.288921 10273 webserver.cc:460] Webserver started at http://127.9.203.124:39467/ using document root <none> and password file <none>
I20260811 06:16:43.289892 10273 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:43.290109 10273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:43.290498 10273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:43.293699 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 5
I20260811 06:16:43.294378 10273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/instance:
uuid: "29fb239be50c4171bdbc75e064555197"
format_stamp: "Formatted at 2026-08-11 06:16:43 on dist-test-slave-cvwc"
I20260811 06:16:43.295652 10273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal/instance:
uuid: "29fb239be50c4171bdbc75e064555197"
format_stamp: "Formatted at 2026-08-11 06:16:43 on dist-test-slave-cvwc"
W20260811 06:16:43.295800 10156 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.203.124:45045: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:16:43.303479 10273 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260811 06:16:43.308827 10305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:43.310403 10273 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:43.310631 10273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
uuid: "29fb239be50c4171bdbc75e064555197"
format_stamp: "Formatted at 2026-08-11 06:16:43 on dist-test-slave-cvwc"
I20260811 06:16:43.310971 10273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:43.343216 10273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:43.344774 10273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:43.345327 10273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:43.400170 10273 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.124:45045
I20260811 06:16:43.400336 10400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.124:45045 every 8 connection(s)
I20260811 06:16:43.402043 10273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
I20260811 06:16:43.403995 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 10273
I20260811 06:16:43.404210 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal/instance
I20260811 06:16:43.408106 10401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:43.423082 10401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:43.446823 10401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:43.458587 10401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } has no permanent_uuid. Determining permanent_uuid...
I20260811 06:16:43.476151 10401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Bootstrap starting.
I20260811 06:16:43.482023 10401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:43.484511 10401 log.cc:824] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:43.488833 10401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: No bootstrap required, opened a new log
I20260811 06:16:43.501996 10401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.502559 10401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:43.502786 10401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29fb239be50c4171bdbc75e064555197, State: Initialized, Role: FOLLOWER
I20260811 06:16:43.503615 10401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.505244 10413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.506165 10413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.506496 10401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:16:43.510991 10413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:43.511580 10413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.514815 10413 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
W20260811 06:16:43.530097 10438 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:16:43.530350 10438 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:16:43.524760 10273 master_runner.cc:186] Error getting master registration for 127.9.203.126:33303: OK, instance_id { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" instance_seqno: 1786429001887469 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:16:43.542757 10273 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:16:43.599298 10314 tablet.cc:2369] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:16:43.744336 10270 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 6
I20260811 06:16:43.763410 10270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Bootstrap starting.
I20260811 06:16:43.769927 10270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:43.772583 10270 log.cc:824] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:43.776701 10270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: No bootstrap required, opened a new log
I20260811 06:16:43.791525 10270 raft_consensus.cc:348] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.792102 10270 raft_consensus.cc:374] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:43.792367 10270 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36d6d06a0cb4489b5014178b9973219, State: Initialized, Role: FOLLOWER
I20260811 06:16:43.793232 10270 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.794961 10443 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.795789 10443 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.796687 10270 sys_catalog.cc:564] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:16:43.796883 10228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:16:43.798082 10228 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29fb239be50c4171bdbc75e064555197 in term 0.
I20260811 06:16:43.799362 10310 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219; no voters:
I20260811 06:16:43.800062 10413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:43.800397 10413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:43.800657 10413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:43.805940 10413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.807276 10413 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 1 election: Requested vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
I20260811 06:16:43.809311 10228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219"
I20260811 06:16:43.809698 10228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:43.815451 10228 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29fb239be50c4171bdbc75e064555197 in term 1.
I20260811 06:16:43.816080 10310 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219; no voters:
I20260811 06:16:43.816533 10413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:43.817685 10413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 LEADER]: Becoming Leader. State: Replica: 29fb239be50c4171bdbc75e064555197, State: Running, Role: LEADER
I20260811 06:16:43.818559 10413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.820094 10156 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } attempt: 6
I20260811 06:16:43.850574 10450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.851536 10450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:43.866520 10473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:16:43.868216 10156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: Bootstrap starting.
I20260811 06:16:43.874480 10156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:43.874894 10473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:16:43.877381 10156 log.cc:824] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:43.860376 10159 master_runner.cc:186] Error getting master registration for 127.9.203.126:33303: OK, instance_id { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" instance_seqno: 1786429001887469 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:16:43.884474 10159 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:16:43.889503 10156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: No bootstrap required, opened a new log
W20260811 06:16:43.893350 10469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 06:16:43.893659 10469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 06:16:43.910128 10228 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Refusing update from remote peer 29fb239be50c4171bdbc75e064555197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:16:43.911494 10450 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:43.913151 10156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:43.913875 10156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:43.914171 10156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff4bfd7a38d4d999137c09f50fe4c57, State: Initialized, Role: FOLLOWER
I20260811 06:16:43.915145 10156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
W20260811 06:16:43.918604 10194 tablet.cc:2369] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:16:43.922605 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.923542 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.926085 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
I20260811 06:16:43.928586 10116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
W20260811 06:16:43.929487 10116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45226 (request call id 1) took 414 ms (client timeout 535 ms). Trace:
I20260811 06:16:43.930135 10443 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.930562 10443 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 06:16:43.930197 10116 rpcz_store.cc:269] 0811 06:16:43.515092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:43.515162 (+ 70us) service_pool.cc:227] Handling call
0811 06:16:43.929274 (+414112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:43.931749 10156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:16:43.926304 10113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:43.938879 10113 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Refusing update from remote peer 29fb239be50c4171bdbc75e064555197: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:16:43.940120 10413 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:43.949208 10450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.949661 10450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:43.954780 10443 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.955078 10443 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.960543 10473 catalog_manager.cc:1347] Generated new cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:43.960723 10473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:16:43.970348 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.970906 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.972769 10491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:43.973635 10491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:43.999864 10450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:44.000315 10450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:44.020320 10473 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 06:16:44.020706 10513 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:44.020946 10513 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: loading cluster ID for follower catalog manager: success
I20260811 06:16:44.022506 10473 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:16:44.026964 10513 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: acquiring CA information for follower catalog manager: success
W20260811 06:16:44.029345 10513 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 06:16:44.051060 10473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Generated new TSK 0
I20260811 06:16:44.057411 10473 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:16:44.099220 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.203.65:0
--local_ip_for_outbound_sockets=127.9.203.65
--webserver_interface=127.9.203.65
--webserver_port=0
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260811 06:16:44.551329 10518 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:44.551792 10518 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:44.554814 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:16:44.556885 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
I20260811 06:16:44.557968 10186 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a36d6d06a0cb4489b5014178b9973219; no voters: 29fb239be50c4171bdbc75e064555197, 9ff4bfd7a38d4d999137c09f50fe4c57
I20260811 06:16:44.563869 10518 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:44.565234 10518 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:16:44.897485 10469 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:44.897697 10469 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: loading cluster ID for follower catalog manager: success
I20260811 06:16:44.903191 10469 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: acquiring CA information for follower catalog manager: success
I20260811 06:16:44.907346 10469 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 06:16:45.019474 10516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:45.019919 10516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:45.020179 10516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:45.032089 10516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:45.032461 10516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.203.65
I20260811 06:16:45.033594 10513 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:16:45.046859 10516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.203.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.203.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.203.65
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:45.048810 10516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:45.049569 10525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:45.050076 10525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.051749 10516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 06:16:45.051848 10525 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:45.052553 10227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:16:45.052549 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
I20260811 06:16:45.053637 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
I20260811 06:16:45.054275 10525 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:16:45.076386 10530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:45.077620 10531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:45.078233 10533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:45.079633 10516 server_base.cc:1034] running on GCE node
I20260811 06:16:45.080390 10516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:45.081796 10516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:45.083155 10516 hybrid_clock.cc:648] HybridClock initialized: now 1786429005082959 us; error 67 us; skew 500 ppm
I20260811 06:16:45.083575 10516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:45.087970 10516 webserver.cc:460] Webserver started at http://127.9.203.65:42655/ using document root <none> and password file <none>
I20260811 06:16:45.089205 10516 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:45.089489 10516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:45.089989 10516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:45.093744 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data/instance:
uuid: "24d29113b2454d9c93e23db3e3dac801"
format_stamp: "Formatted at 2026-08-11 06:16:45 on dist-test-slave-cvwc"
I20260811 06:16:45.094745 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/instance:
uuid: "24d29113b2454d9c93e23db3e3dac801"
format_stamp: "Formatted at 2026-08-11 06:16:45 on dist-test-slave-cvwc"
I20260811 06:16:45.102926 10516 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.002s
I20260811 06:16:45.109023 10546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:45.110127 10547 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:45.110411 10547 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.111074 10516 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260811 06:16:45.111267 10516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal
uuid: "24d29113b2454d9c93e23db3e3dac801"
format_stamp: "Formatted at 2026-08-11 06:16:45 on dist-test-slave-cvwc"
I20260811 06:16:45.111626 10547 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:45.111506 10516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:45.111981 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
I20260811 06:16:45.112061 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:16:45.112444 10113 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a36d6d06a0cb4489b5014178b9973219 in term 1.
I20260811 06:16:45.113121 10185 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219; no voters: 29fb239be50c4171bdbc75e064555197
I20260811 06:16:45.113560 10547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 06:16:45.113935 10547 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:45.114185 10547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:16:45.119374 10547 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.121249 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197"
I20260811 06:16:45.121243 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
I20260811 06:16:45.121577 10113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:16:45.122150 10547 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 election: Requested vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:45.126143 10113 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a36d6d06a0cb4489b5014178b9973219 in term 2.
I20260811 06:16:45.126896 10185 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219; no voters: 29fb239be50c4171bdbc75e064555197
I20260811 06:16:45.127655 10547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:16:45.137745 10113 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 2 FOLLOWER]: Rejecting Update request from peer 29fb239be50c4171bdbc75e064555197 for earlier term 1. Current term is 2. Ops: []
I20260811 06:16:45.138945 10547 raft_consensus.cc:686] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 LEADER]: Becoming Leader. State: Replica: a36d6d06a0cb4489b5014178b9973219, State: Running, Role: LEADER
I20260811 06:16:45.139869 10547 consensus_queue.cc:237] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.143778 10556 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260811 06:16:45.144761 10556 raft_consensus.cc:3032] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 LEADER]: Stepping down as leader of term 1
I20260811 06:16:45.144876 10553 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36d6d06a0cb4489b5014178b9973219. Latest consensus state: current_term: 2 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:45.145424 10553 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:45.146680 10227 raft_consensus.cc:1226] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 LEADER]: Rejecting Update request from peer 29fb239be50c4171bdbc75e064555197 for earlier term 1. Current term is 2. Ops: []
I20260811 06:16:45.148275 10556 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29fb239be50c4171bdbc75e064555197, State: Running, Role: LEADER
I20260811 06:16:45.147835 10551 consensus_queue.cc:1046] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 06:16:45.148793 10551 consensus_queue.cc:1225] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Peer a36d6d06a0cb4489b5014178b9973219 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260811 06:16:45.149330 10556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.150437 10556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:16:45.156803 10563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:16:45.161804 10563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:16:45.163846 10563 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:45.164008 10563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:16:45.167166 10563 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:16:45.169346 10563 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Loaded TSK: 0
I20260811 06:16:45.170866 10563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:16:45.180559 10516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:45.181994 10516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:45.182461 10516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:45.184595 10516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:16:45.187566 10516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:16:45.187716 10516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:45.187953 10516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:16:45.188086 10516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:45.302237 10516 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.65:37755
I20260811 06:16:45.302438 10741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.65:37755 every 8 connection(s)
I20260811 06:16:45.304527 10516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/data/info.pb
I20260811 06:16:45.311282 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 10516
I20260811 06:16:45.311605 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/instance
I20260811 06:16:45.323807 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.203.66:0
--local_ip_for_outbound_sockets=127.9.203.66
--webserver_interface=127.9.203.66
--webserver_port=0
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260811 06:16:45.368350 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:16:45.368793 10744 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:45.369402 10746 heartbeater.cc:347] Connected to a master server at 127.9.203.126:33303
I20260811 06:16:45.369560 10746 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:45.369844 10747 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:45.370067 10747 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:45.370615 10744 heartbeater.cc:511] Master 127.9.203.124:45045 requested a full tablet report, sending...
I20260811 06:16:45.370625 10746 heartbeater.cc:511] Master 127.9.203.126:33303 requested a full tablet report, sending...
I20260811 06:16:45.371078 10747 heartbeater.cc:511] Master 127.9.203.125:35327 requested a full tablet report, sending...
I20260811 06:16:45.373538 10215 ts_manager.cc:194] Registered new tserver with Master: 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:45.373987 10098 ts_manager.cc:194] Registered new tserver with Master: 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:45.375314 10215 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.203.65:49661
I20260811 06:16:45.377095 10337 ts_manager.cc:194] Registered new tserver with Master: 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:45.524885 10556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:45.525205 10556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.526081 10556 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
I20260811 06:16:45.526786 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:16:45.526746 10227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:16:45.527284 10113 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29fb239be50c4171bdbc75e064555197 in term 2.
I20260811 06:16:45.527925 10310 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29fb239be50c4171bdbc75e064555197, 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: a36d6d06a0cb4489b5014178b9973219
I20260811 06:16:45.528404 10556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 06:16:45.528601 10556 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:45.528721 10556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 2 FOLLOWER]: Advancing to term 3
I20260811 06:16:45.531284 10556 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.532300 10556 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 3 election: Requested vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
I20260811 06:16:45.532997 10113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
I20260811 06:16:45.533413 10113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 2 FOLLOWER]: Advancing to term 3
I20260811 06:16:45.533330 10227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219"
I20260811 06:16:45.535601 10438 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:16:45.536909 10113 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29fb239be50c4171bdbc75e064555197 in term 3.
I20260811 06:16:45.537494 10307 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29fb239be50c4171bdbc75e064555197, 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: a36d6d06a0cb4489b5014178b9973219
I20260811 06:16:45.538014 10556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 06:16:45.538363 10556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 LEADER]: Becoming Leader. State: Replica: 29fb239be50c4171bdbc75e064555197, State: Running, Role: LEADER
I20260811 06:16:45.538793 10556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.541249 10548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:45.541759 10548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:45.543269 10765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:16:45.546959 10765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:16:45.548918 10765 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:45.549115 10765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:16:45.551770 10765 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:16:45.553617 10765 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Loaded TSK: 0
I20260811 06:16:45.554612 10765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:16:45.704041 10113 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Rejecting Update request from peer a36d6d06a0cb4489b5014178b9973219 for earlier term 2. Current term is 3. Ops: []
I20260811 06:16:45.704809 10766 consensus_queue.cc:1046] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 06:16:45.705605 10766 raft_consensus.cc:3032] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 LEADER]: Stepping down as leader of term 2
I20260811 06:16:45.705751 10766 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a36d6d06a0cb4489b5014178b9973219, State: Running, Role: LEADER
I20260811 06:16:45.706130 10766 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:45.706997 10766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 2 FOLLOWER]: Advancing to term 3
I20260811 06:16:45.878355 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:16:46.059010 10761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:46.059502 10761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:46.059811 10761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:46.072621 10761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:46.072984 10761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.203.66
I20260811 06:16:46.086166 10761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.203.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.203.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.203.66
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:46.087670 10761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:46.089686 10761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:16:46.105993 10775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:46.106047 10773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:46.106782 10779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:46.107532 10761 server_base.cc:1034] running on GCE node
I20260811 06:16:46.108448 10761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:46.108940 10227 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Refusing update from remote peer 29fb239be50c4171bdbc75e064555197: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260811 06:16:46.109086 10227 pending_rounds.cc:76] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Aborting all ops after (but not including) 4
I20260811 06:16:46.109205 10227 pending_rounds.cc:97] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260811 06:16:46.109349 10227 raft_consensus.cc:2866] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 06:16:46.110062 10761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:46.110257 10784 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 06:16:46.111445 10761 hybrid_clock.cc:648] HybridClock initialized: now 1786429006111195 us; error 131 us; skew 500 ppm
I20260811 06:16:46.111884 10761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:46.112074 10766 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.112457 10766 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:46.114166 10784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.114485 10784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:46.115162 10113 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Refusing update from remote peer 29fb239be50c4171bdbc75e064555197: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260811 06:16:46.115800 10784 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260811 06:16:46.125051 10766 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.125505 10766 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:46.127673 10805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.128034 10805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:46.127842 10798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.128274 10798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:46.128901 10761 webserver.cc:460] Webserver started at http://127.9.203.66:42155/ using document root <none> and password file <none>
I20260811 06:16:46.129707 10761 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:46.129899 10761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:46.130242 10761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:46.133193 10761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data/instance:
uuid: "56a371f7ed104f68a5db9ca097eb237e"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.134061 10761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/instance:
uuid: "56a371f7ed104f68a5db9ca097eb237e"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.140138 10761 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260811 06:16:46.144647 10808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:46.146286 10761 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:46.146490 10761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal
uuid: "56a371f7ed104f68a5db9ca097eb237e"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.146747 10761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:46.167373 10761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:46.168504 10761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:46.168941 10761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:46.170290 10761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:16:46.172231 10761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:16:46.172338 10761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:46.172500 10761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:16:46.172582 10761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:46.228210 10761 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.66:45845
I20260811 06:16:46.228312 10997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.66:45845 every 8 connection(s)
I20260811 06:16:46.229744 10761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/data/info.pb
I20260811 06:16:46.238742 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 10761
I20260811 06:16:46.239003 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/instance
I20260811 06:16:46.247201 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.203.67:0
--local_ip_for_outbound_sockets=127.9.203.67
--webserver_interface=127.9.203.67
--webserver_port=0
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260811 06:16:46.267409 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:16:46.267930 10998 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:46.269826 10998 heartbeater.cc:511] Master 127.9.203.124:45045 requested a full tablet report, sending...
I20260811 06:16:46.270665 11002 heartbeater.cc:347] Connected to a master server at 127.9.203.126:33303
I20260811 06:16:46.270892 11002 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:46.271498 11004 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:46.271764 11004 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:46.272231 11002 heartbeater.cc:511] Master 127.9.203.126:33303 requested a full tablet report, sending...
I20260811 06:16:46.272207 10337 ts_manager.cc:194] Registered new tserver with Master: 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:46.272811 11004 heartbeater.cc:511] Master 127.9.203.125:35327 requested a full tablet report, sending...
I20260811 06:16:46.273823 10098 ts_manager.cc:194] Registered new tserver with Master: 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:46.274498 10215 ts_manager.cc:194] Registered new tserver with Master: 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:46.274751 10337 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.203.66:60281
I20260811 06:16:46.381006 10744 heartbeater.cc:503] Master 127.9.203.124:45045 was elected leader, sending a full tablet report...
I20260811 06:16:46.602728 10791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:46.603426 10791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:46.778112 10998 heartbeater.cc:503] Master 127.9.203.124:45045 was elected leader, sending a full tablet report...
W20260811 06:16:46.887235 11024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:46.887681 11024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:46.887903 11024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 06:16:46.898567 11024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:46.898859 11024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.203.67
I20260811 06:16:46.913301 11024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.203.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.203.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.203.67
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:46.915176 11024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:46.917701 11024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 06:16:46.936645 11032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:46.936950 11038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:46.937464 11033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:46.939956 11024 server_base.cc:1034] running on GCE node
I20260811 06:16:46.940941 11024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:46.942276 11024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:46.943584 11024 hybrid_clock.cc:648] HybridClock initialized: now 1786429006943439 us; error 62 us; skew 500 ppm
I20260811 06:16:46.943945 11024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:46.947142 11024 webserver.cc:460] Webserver started at http://127.9.203.67:34143/ using document root <none> and password file <none>
I20260811 06:16:46.948086 11024 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:46.948362 11024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:46.948777 11024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 06:16:46.951732 11024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data/instance:
uuid: "f8dcf15ece3a4389932aa672079442b6"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.952615 11024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/instance:
uuid: "f8dcf15ece3a4389932aa672079442b6"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.960155 11024 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260811 06:16:46.965376 11045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:46.967163 11024 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:46.967433 11024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal
uuid: "f8dcf15ece3a4389932aa672079442b6"
format_stamp: "Formatted at 2026-08-11 06:16:46 on dist-test-slave-cvwc"
I20260811 06:16:46.967756 11024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:47.004055 11024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:47.005676 11024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:47.006419 11024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:16:47.008303 11024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 06:16:47.011152 11024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 06:16:47.011324 11024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:47.011591 11024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 06:16:47.011687 11024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:47.090953 11024 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.67:46797
I20260811 06:16:47.090982 11233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.67:46797 every 8 connection(s)
I20260811 06:16:47.092458 11024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/data/info.pb
I20260811 06:16:47.103111 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 11024
I20260811 06:16:47.103423 10029 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/instance
I20260811 06:16:47.112475 11252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:47.112939 11252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:47.114733 10227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:16:47.116227 11252 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:47.116482 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
I20260811 06:16:47.117250 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
I20260811 06:16:47.117885 11252 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 06:16:47.134794 11236 heartbeater.cc:347] Connected to a master server at 127.9.203.126:33303
I20260811 06:16:47.135342 11236 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:47.135555 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:16:47.135684 11235 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:47.136786 11236 heartbeater.cc:511] Master 127.9.203.126:33303 requested a full tablet report, sending...
I20260811 06:16:47.137992 11235 heartbeater.cc:511] Master 127.9.203.124:45045 requested a full tablet report, sending...
I20260811 06:16:47.138839 10098 ts_manager.cc:194] Registered new tserver with Master: f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:47.139106 10337 ts_manager.cc:194] Registered new tserver with Master: f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:47.140257 11238 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:47.140432 11238 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:47.140441 10337 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.203.67:46427
I20260811 06:16:47.141042 11238 heartbeater.cc:511] Master 127.9.203.125:35327 requested a full tablet report, sending...
I20260811 06:16:47.142118 10215 ts_manager.cc:194] Registered new tserver with Master: f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:47.158164 10029 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 06:16:47.202837 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_29de91fd222e4ea7b6e7c66098536177"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.202700 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3db163a8e3304b7da7f4447b9a629e35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.204569 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6c9b7672da944e5e8a7ff4a88fe7af41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.203066 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_064b1fda5ec64ef9b0a785bf5a67fdfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.206035 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9f81bbc35c2240eaa2d43f3e5bfd5f9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.208832 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c9b7672da944e5e8a7ff4a88fe7af41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.208774 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_064b1fda5ec64ef9b0a785bf5a67fdfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.208798 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3db163a8e3304b7da7f4447b9a629e35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.209545 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29de91fd222e4ea7b6e7c66098536177 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.210678 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f81bbc35c2240eaa2d43f3e5bfd5f9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.211956 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_22336894ac9844c986ca32cb702e6f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.219452 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22336894ac9844c986ca32cb702e6f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.209157 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_79115c5e21ec45b09f9bc215b90be78f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.215960 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e1b6bd64453c41dab4769a66afe5b1f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.223706 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79115c5e21ec45b09f9bc215b90be78f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.224156 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1b6bd64453c41dab4769a66afe5b1f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.214208 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8b42e7e0f4284143b958bfe671fb003b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.224843 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b42e7e0f4284143b958bfe671fb003b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.210650 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_63f773507f8a4cbba7abfcfee40e96fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.233023 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63f773507f8a4cbba7abfcfee40e96fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.271090 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_29de91fd222e4ea7b6e7c66098536177" } new_table_name: "default.Table_63601e06e4fa495fb77ba982e2be8f3c" modify_external_catalogs: true
I20260811 06:16:47.271130 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_22336894ac9844c986ca32cb702e6f7b" } new_table_name: "default.Table_65cc0e4c415b4b0095a28b5ec4bfda05" modify_external_catalogs: true
I20260811 06:16:47.273919 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6c9b7672da944e5e8a7ff4a88fe7af41" } new_table_name: "default.Table_9072e50721ce4fc2b7b38f83f52ba25e" modify_external_catalogs: true
I20260811 06:16:47.274932 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9f81bbc35c2240eaa2d43f3e5bfd5f9f" } new_table_name: "default.Table_d800c8c8f6dd4ec19a3ff9b8981fcc88" modify_external_catalogs: true
I20260811 06:16:47.280288 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3db163a8e3304b7da7f4447b9a629e35" } new_table_name: "default.Table_845c4a4bc3bf461b93c77f3ef3e438f2" modify_external_catalogs: true
I20260811 06:16:47.293915 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e1b6bd64453c41dab4769a66afe5b1f6" } modify_external_catalogs: true
I20260811 06:16:47.294421 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e1b6bd64453c41dab4769a66afe5b1f6" } modify_external_catalogs: true
I20260811 06:16:47.295897 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_064b1fda5ec64ef9b0a785bf5a67fdfe" } modify_external_catalogs: true
I20260811 06:16:47.300365 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_064b1fda5ec64ef9b0a785bf5a67fdfe" } modify_external_catalogs: true
I20260811 06:16:47.319139 10029 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu pid 10159
W20260811 06:16:47.320981 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet abdbcb4438fd4a9faf58c0c797c43e8b has no consensus state
I20260811 06:16:47.321633 10261 generic_service.cc:196] Checking for leaks (request via RPC)
W20260811 06:16:47.323047 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 955d8ca2c32c4152ac827240ede58b2e has no consensus state
I20260811 06:16:47.325776 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8b42e7e0f4284143b958bfe671fb003b" } modify_external_catalogs: true
I20260811 06:16:47.326259 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_79115c5e21ec45b09f9bc215b90be78f" } modify_external_catalogs: true
I20260811 06:16:47.326812 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8b42e7e0f4284143b958bfe671fb003b" } modify_external_catalogs: true
I20260811 06:16:47.326836 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_79115c5e21ec45b09f9bc215b90be78f" } modify_external_catalogs: true
I20260811 06:16:47.328410 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_63f773507f8a4cbba7abfcfee40e96fd" } modify_external_catalogs: true
I20260811 06:16:47.329875 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_63f773507f8a4cbba7abfcfee40e96fd" } modify_external_catalogs: true
W20260811 06:16:47.328615 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d588d25f50a3444ab8d0f4261459d948 has no consensus state
W20260811 06:16:47.332190 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6985d40409ae4480be7ad69e0969da07 has no consensus state
I20260811 06:16:47.341030 10318 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 31e63608bd3a4557a836233c4b9486c6
I20260811 06:16:47.341048 10333 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 719f0dad47764b63a99b4aaab315b394
I20260811 06:16:47.343117 10324 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9a5bd4df115045c09953bb88bd200766
W20260811 06:16:47.345466 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4b818b7d50a43d6bfd0bd3fe66c7087 consensus state has no leader
W20260811 06:16:47.354717 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6985d40409ae4480be7ad69e0969da07 (table default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6985d40409ae4480be7ad69e0969da07 consensus state has no leader
I20260811 06:16:47.382938 10328 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0fcf181903144f50947309644fca07de
I20260811 06:16:47.386904 10321 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f4fc249b9bc34641b4ed823b3d9beb53
I20260811 06:16:47.387677 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 6985d40409ae4480be7ad69e0969da07 (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.385931 10880 tablet_service.cc:1467] Processing CreateTablet for tablet d588d25f50a3444ab8d0f4261459d948 (DEFAULT_TABLE table=default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.386431 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 955d8ca2c32c4152ac827240ede58b2e (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.389575 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955d8ca2c32c4152ac827240ede58b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.392397 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588d25f50a3444ab8d0f4261459d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.392802 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6985d40409ae4480be7ad69e0969da07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.392275 11128 tablet_service.cc:1467] Processing CreateTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b (DEFAULT_TABLE table=default.Table_d800c8c8f6dd4ec19a3ff9b8981fcc88 [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.386247 10881 tablet_service.cc:1467] Processing CreateTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (DEFAULT_TABLE table=default.Table_63601e06e4fa495fb77ba982e2be8f3c [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.393952 11118 tablet_service.cc:1467] Processing CreateTablet for tablet d588d25f50a3444ab8d0f4261459d948 (DEFAULT_TABLE table=default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.394209 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4b818b7d50a43d6bfd0bd3fe66c7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.394527 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 955d8ca2c32c4152ac827240ede58b2e (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.395059 10886 tablet_service.cc:1467] Processing CreateTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b (DEFAULT_TABLE table=default.Table_d800c8c8f6dd4ec19a3ff9b8981fcc88 [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.395303 11119 tablet_service.cc:1467] Processing CreateTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (DEFAULT_TABLE table=default.Table_63601e06e4fa495fb77ba982e2be8f3c [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.395823 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 6985d40409ae4480be7ad69e0969da07 (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.397396 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abdbcb4438fd4a9faf58c0c797c43e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.398135 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abdbcb4438fd4a9faf58c0c797c43e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.398451 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6985d40409ae4480be7ad69e0969da07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.398813 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588d25f50a3444ab8d0f4261459d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.399259 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4b818b7d50a43d6bfd0bd3fe66c7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.399665 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955d8ca2c32c4152ac827240ede58b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.414240 10627 tablet_service.cc:1467] Processing CreateTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (DEFAULT_TABLE table=default.Table_63601e06e4fa495fb77ba982e2be8f3c [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.416926 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 955d8ca2c32c4152ac827240ede58b2e (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.415586 10626 tablet_service.cc:1467] Processing CreateTablet for tablet d588d25f50a3444ab8d0f4261459d948 (DEFAULT_TABLE table=default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.416340 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 6985d40409ae4480be7ad69e0969da07 (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.418358 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955d8ca2c32c4152ac827240ede58b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.422367 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6985d40409ae4480be7ad69e0969da07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.423964 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d588d25f50a3444ab8d0f4261459d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.424965 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4b818b7d50a43d6bfd0bd3fe66c7087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.425376 10634 tablet_service.cc:1467] Processing CreateTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b (DEFAULT_TABLE table=default.Table_d800c8c8f6dd4ec19a3ff9b8981fcc88 [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.426692 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abdbcb4438fd4a9faf58c0c797c43e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.451753 11361 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:47.458657 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_63c67aa45e8b4160b1c2b2b838657879"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.459448 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c67aa45e8b4160b1c2b2b838657879 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.466555 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_dbddc18d58d54db9b917d16527a58eed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.467247 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbddc18d58d54db9b917d16527a58eed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.468739 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_118ea8b2036c46d880938fe2e72aeda8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.469193 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f3113222c88b413aa5271147bc19a017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.469605 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_118ea8b2036c46d880938fe2e72aeda8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.469782 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3113222c88b413aa5271147bc19a017 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.470255 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_23390c9b10544890a545333f5e05c046"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.470815 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23390c9b10544890a545333f5e05c046 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.475373 10318 master_service.cc:946] ReplaceTablet: received request to replace tablet 6985d40409ae4480be7ad69e0969da07 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.476099 11361 tablet_bootstrap.cc:654] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.477253 10331 master_service.cc:946] ReplaceTablet: received request to replace tablet 955d8ca2c32c4152ac827240ede58b2e from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.478559 11361 log.cc:824] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:47.489042 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet abdbcb4438fd4a9faf58c0c797c43e8b from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.492918 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 6985d40409ae4480be7ad69e0969da07 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.492754 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6e1156f0cc61431fb135ee06a0ce9d01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.493616 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e1156f0cc61431fb135ee06a0ce9d01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.495963 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_11b6248b22a7431fb009f5462a2865a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.496663 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11b6248b22a7431fb009f5462a2865a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.498406 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet abdbcb4438fd4a9faf58c0c797c43e8b from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.501422 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8d100f23af59496dbd7e3c5308703ca4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.502099 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d100f23af59496dbd7e3c5308703ca4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.502471 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_43f0d301220c473a8e0b3470124bd1e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.503173 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43f0d301220c473a8e0b3470124bd1e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.510532 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b9494faaf0c24cacbf34a1ea147c637e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.511255 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9494faaf0c24cacbf34a1ea147c637e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.517589 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6985d40409ae4480be7ad69e0969da07
I20260811 06:16:47.518456 10318 catalog_manager.cc:6565] ReplaceTablet: tablet 6985d40409ae4480be7ad69e0969da07 deleted and replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:47.519066 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 955d8ca2c32c4152ac827240ede58b2e
I20260811 06:16:47.519690 10331 catalog_manager.cc:6565] ReplaceTablet: tablet 955d8ca2c32c4152ac827240ede58b2e deleted and replaced by tablet 818859f61e754a75baf8804939864fd7
I20260811 06:16:47.521944 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.521574 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.524490 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.525466 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.528319 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.528615 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_118ea8b2036c46d880938fe2e72aeda8" } new_table_name: "default.Table_c377592be3df4bc8ae946bba086fa15a" modify_external_catalogs: true
I20260811 06:16:47.530836 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_63601e06e4fa495fb77ba982e2be8f3c" } new_table_name: "default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8" modify_external_catalogs: true
W20260811 06:16:47.534821 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6985d40409ae4480be7ad69e0969da07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6985d40409ae4480be7ad69e0969da07 already in progress: creating tablet
I20260811 06:16:47.537462 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet abdbcb4438fd4a9faf58c0c797c43e8b
I20260811 06:16:47.537802 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d800c8c8f6dd4ec19a3ff9b8981fcc88" } new_table_name: "default.Table_79a06e688c7f4536bb78d323d80892cf" modify_external_catalogs: true
I20260811 06:16:47.537853 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f3113222c88b413aa5271147bc19a017" } new_table_name: "default.Table_9b8f335592764b7791359d681078c3d1" modify_external_catalogs: true
I20260811 06:16:47.539897 10321 catalog_manager.cc:6565] ReplaceTablet: tablet abdbcb4438fd4a9faf58c0c797c43e8b deleted and replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a
W20260811 06:16:47.541102 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 955d8ca2c32c4152ac827240ede58b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955d8ca2c32c4152ac827240ede58b2e already in progress: creating tablet
W20260811 06:16:47.542109 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 955d8ca2c32c4152ac827240ede58b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955d8ca2c32c4152ac827240ede58b2e already in progress: creating tablet
I20260811 06:16:47.542225 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:47.541823 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6985d40409ae4480be7ad69e0969da07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6985d40409ae4480be7ad69e0969da07 already in progress: creating tablet
I20260811 06:16:47.543442 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.543493 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:47.545019 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 955d8ca2c32c4152ac827240ede58b2e because the tablet was not found. No further retry: Not found: Tablet not found: 955d8ca2c32c4152ac827240ede58b2e
I20260811 06:16:47.546176 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_23390c9b10544890a545333f5e05c046" } modify_external_catalogs: true
I20260811 06:16:47.546700 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_23390c9b10544890a545333f5e05c046" } modify_external_catalogs: true
W20260811 06:16:47.546917 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet abdbcb4438fd4a9faf58c0c797c43e8b because the tablet was not found. No further retry: Not found: Tablet not found: abdbcb4438fd4a9faf58c0c797c43e8b
I20260811 06:16:47.548291 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_43f0d301220c473a8e0b3470124bd1e4" } modify_external_catalogs: true
I20260811 06:16:47.548590 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_43f0d301220c473a8e0b3470124bd1e4" } modify_external_catalogs: true
I20260811 06:16:47.550585 11362 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:16:47.545048 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet abdbcb4438fd4a9faf58c0c797c43e8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abdbcb4438fd4a9faf58c0c797c43e8b already in progress: creating tablet
W20260811 06:16:47.554046 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet abdbcb4438fd4a9faf58c0c797c43e8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abdbcb4438fd4a9faf58c0c797c43e8b already in progress: creating tablet
I20260811 06:16:47.554159 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.555389 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8d100f23af59496dbd7e3c5308703ca4" } modify_external_catalogs: true
I20260811 06:16:47.555707 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8d100f23af59496dbd7e3c5308703ca4" } modify_external_catalogs: true
I20260811 06:16:47.556634 11365 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:16:47.559486 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 577207be9523447c95f752e6861a3baf has no consensus state
I20260811 06:16:47.561167 11362 tablet_bootstrap.cc:654] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:47.561410 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4b818b7d50a43d6bfd0bd3fe66c7087 consensus state has no leader
I20260811 06:16:47.563711 11361 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:47.563799 11362 log.cc:824] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:47.564240 11361 ts_tablet_manager.cc:1397] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.113s user 0.017s sys 0.000s
I20260811 06:16:47.564569 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dbddc18d58d54db9b917d16527a58eed" } new_table_name: "default.Table_040c010aaa5b4a218e3d7e7e2454859f" modify_external_catalogs: true
W20260811 06:16:47.570395 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6985d40409ae4480be7ad69e0969da07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6985d40409ae4480be7ad69e0969da07 already in progress: creating tablet
W20260811 06:16:47.574446 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2da20f0fe3ab4d85be35081e3d72f56a has no consensus state
I20260811 06:16:47.577363 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 4671fa2f252e43cab925b11f50a70cff (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.578096 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4671fa2f252e43cab925b11f50a70cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.579190 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 4671fa2f252e43cab925b11f50a70cff (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.579933 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4671fa2f252e43cab925b11f50a70cff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:47.583563 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d45b7d1994a40cc83d2ce0d6de5a249 has no consensus state
I20260811 06:16:47.585412 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 4671fa2f252e43cab925b11f50a70cff (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.586094 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4671fa2f252e43cab925b11f50a70cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.588634 10029 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu with pid 10159
I20260811 06:16:47.590430 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_845c4a4bc3bf461b93c77f3ef3e438f2" } modify_external_catalogs: true
I20260811 06:16:47.590672 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_845c4a4bc3bf461b93c77f3ef3e438f2" } modify_external_catalogs: true
I20260811 06:16:47.592772 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6e1156f0cc61431fb135ee06a0ce9d01" } modify_external_catalogs: true
I20260811 06:16:47.592975 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6e1156f0cc61431fb135ee06a0ce9d01" } modify_external_catalogs: true
I20260811 06:16:47.595865 10332 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 1f45371b34ce4161998e9046b65332d5
I20260811 06:16:47.596099 10333 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 1c2cad251f07417cb2eeebd2e174b732
I20260811 06:16:47.596779 10321 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dee67b6db12f471cb27f075dc4bcdead
W20260811 06:16:47.597537 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 937a7467093a414882c34a3958af1deb has no consensus state
I20260811 06:16:47.605291 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet d588d25f50a3444ab8d0f4261459d948
I20260811 06:16:47.606760 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.607591 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.608281 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:47.608426 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d588d25f50a3444ab8d0f4261459d948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d588d25f50a3444ab8d0f4261459d948 already in progress: creating tablet
I20260811 06:16:47.608834 10328 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 533adde6d5b84799abad91621906de99
W20260811 06:16:47.609058 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d588d25f50a3444ab8d0f4261459d948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d588d25f50a3444ab8d0f4261459d948 already in progress: creating tablet
W20260811 06:16:47.609117 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d588d25f50a3444ab8d0f4261459d948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d588d25f50a3444ab8d0f4261459d948 already in progress: creating tablet
I20260811 06:16:47.614423 11365 tablet_bootstrap.cc:654] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.615841 11365 log.cc:824] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:47.619865 11361 raft_consensus.cc:348] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.620429 11361 raft_consensus.cc:374] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.620537 11361 raft_consensus.cc:729] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.620620 11362 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.620947 11362 ts_tablet_manager.cc:1397] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.094s user 0.022s sys 0.011s
I20260811 06:16:47.622097 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.622339 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.622568 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da20f0fe3ab4d85be35081e3d72f56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.622777 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da20f0fe3ab4d85be35081e3d72f56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.622694 10880 tablet_service.cc:1467] Processing CreateTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.623068 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e6bf8789594a91a1a35e6c750a0ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.623344 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 937a7467093a414882c34a3958af1deb (DEFAULT_TABLE table=default.Table_040c010aaa5b4a218e3d7e7e2454859f [id=72559661450c4fd7b7459b56611f41e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.623706 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 937a7467093a414882c34a3958af1deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.626097 11128 tablet_service.cc:1467] Processing CreateTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.626477 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e6bf8789594a91a1a35e6c750a0ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.629702 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 818859f61e754a75baf8804939864fd7 (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.630172 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818859f61e754a75baf8804939864fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.630623 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 937a7467093a414882c34a3958af1deb (DEFAULT_TABLE table=default.Table_040c010aaa5b4a218e3d7e7e2454859f [id=72559661450c4fd7b7459b56611f41e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.631013 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 937a7467093a414882c34a3958af1deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.631880 10879 tablet_service.cc:1467] Processing CreateTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 (DEFAULT_TABLE table=default.Table_11b6248b22a7431fb009f5462a2865a0 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.632464 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7fcb33853948a0a54b9ba93cbe2f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.632638 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (DEFAULT_TABLE table=default.Table_9b8f335592764b7791359d681078c3d1 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.633184 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d45b7d1994a40cc83d2ce0d6de5a249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.634060 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 818859f61e754a75baf8804939864fd7 (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.634424 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818859f61e754a75baf8804939864fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.638911 11117 tablet_service.cc:1467] Processing CreateTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 (DEFAULT_TABLE table=default.Table_11b6248b22a7431fb009f5462a2865a0 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.639179 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (DEFAULT_TABLE table=default.Table_9b8f335592764b7791359d681078c3d1 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.639494 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7fcb33853948a0a54b9ba93cbe2f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.639829 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d45b7d1994a40cc83d2ce0d6de5a249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.642398 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 (DEFAULT_TABLE table=default.Table_b9494faaf0c24cacbf34a1ea147c637e [id=d41d2864aded430783e667b5f3a87e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.642871 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c4f425aa214a7a9e8a029389d59a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.643411 11235 heartbeater.cc:503] Master 127.9.203.124:45045 was elected leader, sending a full tablet report...
I20260811 06:16:47.649678 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 577207be9523447c95f752e6861a3baf (DEFAULT_TABLE table=default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.650244 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577207be9523447c95f752e6861a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:47.652387 11048 connection.cc:535] client connection to 127.9.203.125:35327 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:47.653056 11238 heartbeater.cc:644] Failed to heartbeat to 127.9.203.125:35327 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:47.648277 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 (DEFAULT_TABLE table=default.Table_b9494faaf0c24cacbf34a1ea147c637e [id=d41d2864aded430783e667b5f3a87e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.652994 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 577207be9523447c95f752e6861a3baf (DEFAULT_TABLE table=default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.654110 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c4f425aa214a7a9e8a029389d59a04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:47.654333 10747 heartbeater.cc:644] Failed to heartbeat to 127.9.203.125:35327 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.9.203.125:35327 (error 108)
W20260811 06:16:47.654712 10310 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.203.125:35327 (error 108)
I20260811 06:16:47.658795 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.659238 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2da20f0fe3ab4d85be35081e3d72f56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.660135 10623 tablet_service.cc:1467] Processing CreateTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 (DEFAULT_TABLE table=default.Table_11b6248b22a7431fb009f5462a2865a0 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.660561 11361 consensus_queue.cc:260] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.660975 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7fcb33853948a0a54b9ba93cbe2f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.663363 11362 raft_consensus.cc:348] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.663975 11362 raft_consensus.cc:374] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.664132 11362 raft_consensus.cc:729] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.665153 11362 consensus_queue.cc:260] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.665635 10328 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (table default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]). Expected version 2 got 0
I20260811 06:16:47.669783 11362 ts_tablet_manager.cc:1428] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.049s user 0.014s sys 0.003s
I20260811 06:16:47.670442 11362 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.670899 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.671833 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:47.671948 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6985d40409ae4480be7ad69e0969da07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6985d40409ae4480be7ad69e0969da07 already in progress: creating tablet
W20260811 06:16:47.674774 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 955d8ca2c32c4152ac827240ede58b2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955d8ca2c32c4152ac827240ede58b2e already in progress: creating tablet
I20260811 06:16:47.675007 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 577207be9523447c95f752e6861a3baf (DEFAULT_TABLE table=default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.675580 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577207be9523447c95f752e6861a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.678050 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:47.678943 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d588d25f50a3444ab8d0f4261459d948 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d588d25f50a3444ab8d0f4261459d948 already in progress: creating tablet
I20260811 06:16:47.679945 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.680413 10634 tablet_service.cc:1467] Processing CreateTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd (DEFAULT_TABLE table=default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.680872 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e6bf8789594a91a1a35e6c750a0ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.681612 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.682605 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 577207be9523447c95f752e6861a3baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.684937 11368 tablet_replica.cc:330] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:47.685516 11368 raft_consensus.cc:2229] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:16:47.685616 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet abdbcb4438fd4a9faf58c0c797c43e8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abdbcb4438fd4a9faf58c0c797c43e8b already in progress: creating tablet
I20260811 06:16:47.686115 11368 raft_consensus.cc:2258] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.687969 11368 ts_tablet_manager.cc:1905] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.688074 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d7236b1d385f4f509212dc6da9c66d34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.688899 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7236b1d385f4f509212dc6da9c66d34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:47.689623 11355 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:16:47.684288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.203.125:35327 (local address 127.0.0.1:59616)
0811 06:16:47.684503 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 06:16:47.684525 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 06:16:47.684645 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 06:16:47.688708 (+ 4063us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 06:16:47.690143 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 818859f61e754a75baf8804939864fd7 (DEFAULT_TABLE table=default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.690653 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818859f61e754a75baf8804939864fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.691434 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 937a7467093a414882c34a3958af1deb (DEFAULT_TABLE table=default.Table_040c010aaa5b4a218e3d7e7e2454859f [id=72559661450c4fd7b7459b56611f41e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.693881 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 937a7467093a414882c34a3958af1deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.696235 11361 ts_tablet_manager.cc:1428] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.132s user 0.015s sys 0.009s
I20260811 06:16:47.697366 11365 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:47.700820 11365 ts_tablet_manager.cc:1397] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.142s user 0.004s sys 0.009s
I20260811 06:16:47.701604 11368 ts_tablet_manager.cc:1918] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.701995 11368 log.cc:1196] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6985d40409ae4480be7ad69e0969da07
I20260811 06:16:47.701846 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6272334e630c4d86b022775a34779af7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.702333 11379 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:16:47.672524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.203.125:35327 (local address 127.9.203.66:59553)
0811 06:16:47.700154 (+ 27630us) negotiation.cc:107] Waiting for socket to connect
0811 06:16:47.700790 (+ 636us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":27445,"threads_started":1}
W20260811 06:16:47.702623 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6272334e630c4d86b022775a34779af7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.702857 11368 ts_tablet_manager.cc:1939] T 6985d40409ae4480be7ad69e0969da07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:16:47.703050 11004 heartbeater.cc:644] Failed to heartbeat to 127.9.203.125:35327 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection reset by peer (error 104)
I20260811 06:16:47.704344 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ea082d040262438eaf58a7135960e338"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.704752 11362 tablet_bootstrap.cc:654] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:47.704917 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea082d040262438eaf58a7135960e338 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.705076 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6985d40409ae4480be7ad69e0969da07 (table default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:16:47.706240 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5765b716d86742a6b576e46ae2cf3f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.706740 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5765b716d86742a6b576e46ae2cf3f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.707792 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_39c740d7852b4e1898570b4807ba19b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.708266 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39c740d7852b4e1898570b4807ba19b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.709846 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (DEFAULT_TABLE table=default.Table_9b8f335592764b7791359d681078c3d1 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.711567 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d45b7d1994a40cc83d2ce0d6de5a249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.714963 11362 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.715206 11362 ts_tablet_manager.cc:1397] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.008s
I20260811 06:16:47.716465 11362 raft_consensus.cc:348] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:47.716866 11362 raft_consensus.cc:374] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.717103 11362 raft_consensus.cc:729] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.717610 11362 consensus_queue.cc:260] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:47.718420 11362 ts_tablet_manager.cc:1428] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 06:16:47.721521 11362 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.722903 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.724921 11362 tablet_bootstrap.cc:654] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.726009 11368 tablet_replica.cc:330] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:47.726362 11368 raft_consensus.cc:2229] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.726725 11368 raft_consensus.cc:2258] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:47.728832 10310 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 -> Peer a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327): Couldn't send request to peer a36d6d06a0cb4489b5014178b9973219. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:47.732923 11362 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.733306 11362 ts_tablet_manager.cc:1397] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260811 06:16:47.734990 10884 tablet_service.cc:1467] Processing CreateTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 (DEFAULT_TABLE table=default.Table_5765b716d86742a6b576e46ae2cf3f34 [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.736470 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 (DEFAULT_TABLE table=default.Table_b9494faaf0c24cacbf34a1ea147c637e [id=d41d2864aded430783e667b5f3a87e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.737108 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c4f425aa214a7a9e8a029389d59a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.737128 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc53fcee3ed5480f85804f29c94c13f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.739342 11361 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:47.740062 11362 raft_consensus.cc:348] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.740800 11362 raft_consensus.cc:374] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.741058 11362 raft_consensus.cc:729] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.742453 10629 tablet_service.cc:1467] Processing CreateTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 (DEFAULT_TABLE table=default.Table_5765b716d86742a6b576e46ae2cf3f34 [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.743614 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc53fcee3ed5480f85804f29c94c13f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.746236 11362 consensus_queue.cc:260] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.732928 11368 ts_tablet_manager.cc:1905] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.750197 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.750689 11370 tablet_replica.cc:330] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:47.750517 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_bb77b27494bc4806ac4da4ede8cb81ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.751439 11370 raft_consensus.cc:2229] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:16:47.751539 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb77b27494bc4806ac4da4ede8cb81ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.752323 11370 raft_consensus.cc:2258] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.753374 11361 tablet_bootstrap.cc:654] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.753340 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_92dda8b4ff6c404abf437eb140977cb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.754123 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92dda8b4ff6c404abf437eb140977cb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.754432 11370 ts_tablet_manager.cc:1905] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.758442 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_714fea9e28ef4d1facbeb57e1d41a03b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.759260 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_714fea9e28ef4d1facbeb57e1d41a03b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.760885 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d6faf829a6dc427b8a6040774e8bcafe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.761569 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6faf829a6dc427b8a6040774e8bcafe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.763036 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a7890da151b0471b86045bc59b692bcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.763780 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7890da151b0471b86045bc59b692bcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.764182 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet bc7fcb33853948a0a54b9ba93cbe2f53 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.771466 11127 tablet_service.cc:1467] Processing CreateTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 (DEFAULT_TABLE table=default.Table_5765b716d86742a6b576e46ae2cf3f34 [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.772907 10620 tablet_service.cc:1467] Processing CreateTablet for tablet bbbaa377ea524e57ab23d73928d70775 (DEFAULT_TABLE table=default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.773730 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc53fcee3ed5480f85804f29c94c13f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.774423 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_040c010aaa5b4a218e3d7e7e2454859f" } new_table_name: "default.Table_02fc64f6fff6403bba126deaa2a74ffe" modify_external_catalogs: true
I20260811 06:16:47.774516 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5765b716d86742a6b576e46ae2cf3f34" } new_table_name: "default.Table_9dd290af671e42d6a5d6545e9651028b" modify_external_catalogs: true
I20260811 06:16:47.775899 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 714247a11705421b9c012d99bdbf3d04 (DEFAULT_TABLE table=default.Table_6272334e630c4d86b022775a34779af7 [id=a66e3380ba3d46ca93a6f98468b36cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.776443 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714247a11705421b9c012d99bdbf3d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.776592 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 714247a11705421b9c012d99bdbf3d04 (DEFAULT_TABLE table=default.Table_6272334e630c4d86b022775a34779af7 [id=a66e3380ba3d46ca93a6f98468b36cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.777436 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbbaa377ea524e57ab23d73928d70775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.779544 10634 tablet_service.cc:1467] Processing CreateTablet for tablet bf1a831788df4431b32c07c1e18b2c4a (DEFAULT_TABLE table=default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.780139 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf1a831788df4431b32c07c1e18b2c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.780735 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet 4671fa2f252e43cab925b11f50a70cff from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.781186 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_11b6248b22a7431fb009f5462a2865a0" } new_table_name: "default.Table_fc6c3d54d9c04ab0ad9278dd8e534505" modify_external_catalogs: true
I20260811 06:16:47.782903 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 714247a11705421b9c012d99bdbf3d04 (DEFAULT_TABLE table=default.Table_6272334e630c4d86b022775a34779af7 [id=a66e3380ba3d46ca93a6f98468b36cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.783496 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714247a11705421b9c012d99bdbf3d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.784549 11119 tablet_service.cc:1467] Processing CreateTablet for tablet bf1a831788df4431b32c07c1e18b2c4a (DEFAULT_TABLE table=default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.785050 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf1a831788df4431b32c07c1e18b2c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.785885 11115 tablet_service.cc:1467] Processing CreateTablet for tablet bbbaa377ea524e57ab23d73928d70775 (DEFAULT_TABLE table=default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.787768 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbbaa377ea524e57ab23d73928d70775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.793571 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet bc7fcb33853948a0a54b9ba93cbe2f53
I20260811 06:16:47.794270 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714247a11705421b9c012d99bdbf3d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.795171 10332 catalog_manager.cc:6565] ReplaceTablet: tablet bc7fcb33853948a0a54b9ba93cbe2f53 deleted and replaced by tablet 57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:47.793756 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b9494faaf0c24cacbf34a1ea147c637e" } new_table_name: "default.Table_58c73784d3fa44d48d364bb30ebd549b" modify_external_catalogs: true
I20260811 06:16:47.799201 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.803561 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.803526 10886 tablet_service.cc:1467] Processing CreateTablet for tablet bbbaa377ea524e57ab23d73928d70775 (DEFAULT_TABLE table=default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.803682 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet abdbcb4438fd4a9faf58c0c797c43e8b from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.804301 10882 tablet_service.cc:1467] Processing CreateTablet for tablet bf1a831788df4431b32c07c1e18b2c4a (DEFAULT_TABLE table=default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.805003 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbbaa377ea524e57ab23d73928d70775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.805179 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d7236b1d385f4f509212dc6da9c66d34" } modify_external_catalogs: true
I20260811 06:16:47.805467 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d7236b1d385f4f509212dc6da9c66d34" } modify_external_catalogs: true
I20260811 06:16:47.807636 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_65cc0e4c415b4b0095a28b5ec4bfda05" } modify_external_catalogs: true
W20260811 06:16:47.807920 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet bc7fcb33853948a0a54b9ba93cbe2f53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7fcb33853948a0a54b9ba93cbe2f53 already in progress: creating tablet
I20260811 06:16:47.807897 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_65cc0e4c415b4b0095a28b5ec4bfda05" } modify_external_catalogs: true
I20260811 06:16:47.808589 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9b8f335592764b7791359d681078c3d1" } new_table_name: "default.Table_b6b1752778e1410f9e6f3dea51936d5f" modify_external_catalogs: true
W20260811 06:16:47.814296 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 937a7467093a414882c34a3958af1deb consensus state has no leader
I20260811 06:16:47.814373 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:47.814927 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc53fcee3ed5480f85804f29c94c13f8 consensus state has no leader
I20260811 06:16:47.815217 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.815425 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf1a831788df4431b32c07c1e18b2c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.816239 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c377592be3df4bc8ae946bba086fa15a" } modify_external_catalogs: true
I20260811 06:16:47.816593 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c377592be3df4bc8ae946bba086fa15a" } modify_external_catalogs: true
I20260811 06:16:47.834730 11370 ts_tablet_manager.cc:1918] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.835198 11370 log.cc:1196] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/d588d25f50a3444ab8d0f4261459d948
I20260811 06:16:47.836108 11370 ts_tablet_manager.cc:1939] T d588d25f50a3444ab8d0f4261459d948 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:47.838425 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet d588d25f50a3444ab8d0f4261459d948 (table default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]) successfully deleted
I20260811 06:16:47.839305 11362 ts_tablet_manager.cc:1428] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.073s user 0.005s sys 0.000s
I20260811 06:16:47.843511 11362 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.846259 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_63c67aa45e8b4160b1c2b2b838657879" } modify_external_catalogs: true
I20260811 06:16:47.846678 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_63c67aa45e8b4160b1c2b2b838657879" } modify_external_catalogs: true
I20260811 06:16:47.848150 11365 raft_consensus.cc:348] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.849062 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 955d8ca2c32c4152ac827240ede58b2e from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:47.849774 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet bc7fcb33853948a0a54b9ba93cbe2f53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7fcb33853948a0a54b9ba93cbe2f53 already in progress: creating tablet
I20260811 06:16:47.850167 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_39c740d7852b4e1898570b4807ba19b7" } modify_external_catalogs: true
I20260811 06:16:47.850459 11365 raft_consensus.cc:374] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.850584 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_39c740d7852b4e1898570b4807ba19b7" } modify_external_catalogs: true
I20260811 06:16:47.850668 11365 raft_consensus.cc:729] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.852089 11365 consensus_queue.cc:260] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.854409 11361 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:47.854651 11361 ts_tablet_manager.cc:1397] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.115s user 0.010s sys 0.039s
I20260811 06:16:47.855443 11368 ts_tablet_manager.cc:1918] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.856364 11361 raft_consensus.cc:348] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.856714 11361 raft_consensus.cc:374] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.856993 11361 raft_consensus.cc:729] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:16:47.857039 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34c4f425aa214a7a9e8a029389d59a04 consensus state has no leader
I20260811 06:16:47.859193 11365 ts_tablet_manager.cc:1428] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.158s user 0.012s sys 0.010s
I20260811 06:16:47.860482 11362 tablet_bootstrap.cc:654] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.860581 11365 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:47.862056 11361 consensus_queue.cc:260] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.862528 11368 log.cc:1196] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/abdbcb4438fd4a9faf58c0c797c43e8b
I20260811 06:16:47.862840 11361 ts_tablet_manager.cc:1428] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260811 06:16:47.863056 11368 ts_tablet_manager.cc:1939] T abdbcb4438fd4a9faf58c0c797c43e8b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:47.863193 11361 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:47.864274 11368 tablet_replica.cc:330] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:47.864491 11368 raft_consensus.cc:2229] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:16:47.864558 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d45b7d1994a40cc83d2ce0d6de5a249 consensus state has no leader
I20260811 06:16:47.864759 11368 raft_consensus.cc:2258] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.866503 11361 tablet_bootstrap.cc:654] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:47.868815 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57144ad37b874c91a89a25665a85eeb2 has no consensus state
I20260811 06:16:47.869684 11365 tablet_bootstrap.cc:654] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.870850 11127 tablet_service.cc:1467] Processing CreateTablet for tablet c4b809805d1e43128b5b18f558002036 (DEFAULT_TABLE table=default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.871438 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b809805d1e43128b5b18f558002036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.868824 10333 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (table default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]). Expected version 2 got 0
I20260811 06:16:47.868853 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet abdbcb4438fd4a9faf58c0c797c43e8b (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
I20260811 06:16:47.873442 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet f4b818b7d50a43d6bfd0bd3fe66c7087 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:47.874200 10884 tablet_service.cc:1467] Processing CreateTablet for tablet c4b809805d1e43128b5b18f558002036 (DEFAULT_TABLE table=default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.874832 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b809805d1e43128b5b18f558002036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.879910 11368 ts_tablet_manager.cc:1905] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.884485 11361 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:47.884840 11361 ts_tablet_manager.cc:1397] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260811 06:16:47.885280 11362 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.885529 11362 ts_tablet_manager.cc:1397] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.008s
I20260811 06:16:47.886480 11361 raft_consensus.cc:348] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.886868 11361 raft_consensus.cc:374] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.887053 11361 raft_consensus.cc:729] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.886853 11362 raft_consensus.cc:348] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.887246 11362 raft_consensus.cc:374] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.887494 11362 raft_consensus.cc:729] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.887718 11365 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:47.887523 11361 consensus_queue.cc:260] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.888079 11365 ts_tablet_manager.cc:1397] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.002s
I20260811 06:16:47.887905 11362 consensus_queue.cc:260] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.888790 11362 ts_tablet_manager.cc:1428] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:16:47.889971 11362 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.890142 11365 raft_consensus.cc:348] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.890494 11365 raft_consensus.cc:374] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.890753 11365 raft_consensus.cc:729] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.891300 11365 consensus_queue.cc:260] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.892597 11365 ts_tablet_manager.cc:1428] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:47.892616 11361 ts_tablet_manager.cc:1428] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260811 06:16:47.893253 11362 tablet_bootstrap.cc:654] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.894510 11365 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:47.898224 11365 tablet_bootstrap.cc:654] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.910439 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.910854 11371 tablet_replica.cc:330] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:47.911338 10620 tablet_service.cc:1467] Processing CreateTablet for tablet c4b809805d1e43128b5b18f558002036 (DEFAULT_TABLE table=default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:47.911540 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet bf1a831788df4431b32c07c1e18b2c4a
I20260811 06:16:47.911581 11371 raft_consensus.cc:2229] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.911900 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4b809805d1e43128b5b18f558002036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:47.912184 11371 raft_consensus.cc:2258] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.913255 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:47.913533 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.913758 10322 catalog_manager.cc:6565] ReplaceTablet: tablet f4b818b7d50a43d6bfd0bd3fe66c7087 deleted and replaced by tablet 9b4eb7864cc742929ac1756949b6bec5
I20260811 06:16:47.914079 11361 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:47.914433 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4eb7864cc742929ac1756949b6bec5) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.915098 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 577207be9523447c95f752e6861a3baf
I20260811 06:16:47.916191 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.916673 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 818859f61e754a75baf8804939864fd7
I20260811 06:16:47.917043 11361 tablet_bootstrap.cc:654] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.917733 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4eb7864cc742929ac1756949b6bec5) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.917825 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.918081 11370 tablet_replica.cc:330] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:47.918221 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet c4b809805d1e43128b5b18f558002036
I20260811 06:16:47.918458 11370 raft_consensus.cc:2229] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.918797 11370 raft_consensus.cc:2258] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.920873 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.921108 11371 ts_tablet_manager.cc:1905] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.921555 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 4671fa2f252e43cab925b11f50a70cff
I20260811 06:16:47.922122 10330 catalog_manager.cc:6565] ReplaceTablet: tablet 4671fa2f252e43cab925b11f50a70cff deleted and replaced by tablet 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:47.927399 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (replaced by tablet 11c50f909aad4bb991bfdeae8eab8455) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.928105 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:47.930694 11370 ts_tablet_manager.cc:1905] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.931167 11368 ts_tablet_manager.cc:1918] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.931388 11368 log.cc:1196] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/955d8ca2c32c4152ac827240ede58b2e
I20260811 06:16:47.931850 11368 ts_tablet_manager.cc:1939] T 955d8ca2c32c4152ac827240ede58b2e P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:47.933092 11362 tablet_bootstrap.cc:492] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.933323 11368 tablet_replica.cc:330] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:47.933383 11362 ts_tablet_manager.cc:1397] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.013s
I20260811 06:16:47.934111 11365 tablet_bootstrap.cc:492] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:47.934437 11365 ts_tablet_manager.cc:1397] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.004s
I20260811 06:16:47.934803 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.936026 11365 raft_consensus.cc:348] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.936380 11365 raft_consensus.cc:374] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.936487 11365 raft_consensus.cc:729] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.936810 11365 consensus_queue.cc:260] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.937633 11365 ts_tablet_manager.cc:1428] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260811 06:16:47.937891 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.939280 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (replaced by tablet 11c50f909aad4bb991bfdeae8eab8455) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.939426 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.939635 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.933583 11368 raft_consensus.cc:2229] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.940021 11368 raft_consensus.cc:2258] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.940563 11371 ts_tablet_manager.cc:1918] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:47.940740 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bc7fcb33853948a0a54b9ba93cbe2f53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc7fcb33853948a0a54b9ba93cbe2f53 already in progress: creating tablet
I20260811 06:16:47.940873 11371 log.cc:1196] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6985d40409ae4480be7ad69e0969da07
W20260811 06:16:47.941128 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bf1a831788df4431b32c07c1e18b2c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf1a831788df4431b32c07c1e18b2c4a already in progress: creating tablet
I20260811 06:16:47.941256 11368 ts_tablet_manager.cc:1905] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.941730 11371 ts_tablet_manager.cc:1939] T 6985d40409ae4480be7ad69e0969da07 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:47.941730 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.942435 11365 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:47.943895 11370 ts_tablet_manager.cc:1918] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.944151 11370 log.cc:1196] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:47.944701 11370 ts_tablet_manager.cc:1939] T f4b818b7d50a43d6bfd0bd3fe66c7087 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:47.946041 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (table default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
I20260811 06:16:47.948828 11365 tablet_bootstrap.cc:654] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.949530 11368 ts_tablet_manager.cc:1918] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.940228 11362 raft_consensus.cc:348] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:47.950524 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet bf1a831788df4431b32c07c1e18b2c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf1a831788df4431b32c07c1e18b2c4a already in progress: creating tablet
I20260811 06:16:47.951048 11362 raft_consensus.cc:374] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.951141 11371 tablet_replica.cc:330] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:47.951227 11362 raft_consensus.cc:729] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.951505 11371 raft_consensus.cc:2229] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.951632 11362 consensus_queue.cc:260] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.951783 11371 raft_consensus.cc:2258] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:47.951907 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 577207be9523447c95f752e6861a3baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 577207be9523447c95f752e6861a3baf already in progress: creating tablet
I20260811 06:16:47.952255 11362 ts_tablet_manager.cc:1428] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260811 06:16:47.952668 11361 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:47.952672 11371 ts_tablet_manager.cc:1905] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.952728 11362 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.952872 11361 ts_tablet_manager.cc:1397] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.008s
W20260811 06:16:47.952872 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 4671fa2f252e43cab925b11f50a70cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4671fa2f252e43cab925b11f50a70cff already in progress: creating tablet
W20260811 06:16:47.953732 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c4b809805d1e43128b5b18f558002036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b809805d1e43128b5b18f558002036 already in progress: creating tablet
I20260811 06:16:47.954269 11370 tablet_replica.cc:330] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:47.954622 11370 raft_consensus.cc:2229] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.954559 11361 raft_consensus.cc:348] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:47.954941 11361 raft_consensus.cc:374] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.955054 11370 raft_consensus.cc:2258] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.955221 11361 raft_consensus.cc:729] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.955523 11361 consensus_queue.cc:260] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:47.956115 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.956863 11370 ts_tablet_manager.cc:1905] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.958534 11362 tablet_bootstrap.cc:654] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.959957 11368 log.cc:1196] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:47.960757 11368 ts_tablet_manager.cc:1939] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:47.960834 11361 ts_tablet_manager.cc:1428] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260811 06:16:47.961024 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:47.961282 11365 tablet_bootstrap.cc:492] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:47.961469 11365 ts_tablet_manager.cc:1397] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.004s
I20260811 06:16:47.961998 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (table default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
I20260811 06:16:47.962579 11365 raft_consensus.cc:348] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.962891 11365 raft_consensus.cc:374] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.963096 11365 raft_consensus.cc:729] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.963436 11365 consensus_queue.cc:260] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:47.964176 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 577207be9523447c95f752e6861a3baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 577207be9523447c95f752e6861a3baf already in progress: creating tablet
I20260811 06:16:47.964525 11365 ts_tablet_manager.cc:1428] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:16:47.964922 11365 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:16:47.965409 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 818859f61e754a75baf8804939864fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818859f61e754a75baf8804939864fd7 already in progress: creating tablet
W20260811 06:16:47.966768 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4671fa2f252e43cab925b11f50a70cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4671fa2f252e43cab925b11f50a70cff already in progress: creating tablet
I20260811 06:16:47.967725 11371 ts_tablet_manager.cc:1918] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:47.968068 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c4b809805d1e43128b5b18f558002036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b809805d1e43128b5b18f558002036 already in progress: creating tablet
I20260811 06:16:47.968889 11371 log.cc:1196] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/d588d25f50a3444ab8d0f4261459d948
I20260811 06:16:47.969661 11371 ts_tablet_manager.cc:1939] T d588d25f50a3444ab8d0f4261459d948 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:47.970185 11362 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:47.970463 11362 ts_tablet_manager.cc:1397] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.008s
I20260811 06:16:47.970777 11361 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:47.971629 11362 raft_consensus.cc:348] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.972041 11362 raft_consensus.cc:374] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.972291 11362 raft_consensus.cc:729] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.972602 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4eb7864cc742929ac1756949b6bec5) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.972867 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.972740 11362 consensus_queue.cc:260] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.974018 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.974460 11361 tablet_bootstrap.cc:654] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.974550 11365 tablet_bootstrap.cc:654] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:47.975492 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.977052 11371 tablet_replica.cc:330] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:47.977129 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (replaced by tablet 11c50f909aad4bb991bfdeae8eab8455) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.977342 11371 raft_consensus.cc:2229] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.977733 11362 ts_tablet_manager.cc:1428] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260811 06:16:47.977967 11371 raft_consensus.cc:2258] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.978473 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 955d8ca2c32c4152ac827240ede58b2e with delete_type TABLET_DATA_DELETED (replaced by tablet 818859f61e754a75baf8804939864fd7) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:47.979732 11370 ts_tablet_manager.cc:1918] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.979766 11371 ts_tablet_manager.cc:1905] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.980017 11370 log.cc:1196] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/955d8ca2c32c4152ac827240ede58b2e
I20260811 06:16:47.980753 11370 ts_tablet_manager.cc:1939] T 955d8ca2c32c4152ac827240ede58b2e P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:47.980866 11362 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.982354 11370 tablet_replica.cc:330] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:47.982645 11370 raft_consensus.cc:2229] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:47.982967 11370 raft_consensus.cc:2258] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:47.983757 11370 ts_tablet_manager.cc:1905] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:47.984916 11362 tablet_bootstrap.cc:654] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:47.987658 11007 tablet.cc:2369] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:16:47.987430 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6985d40409ae4480be7ad69e0969da07 (table default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:16:47.988003 11361 tablet_bootstrap.cc:492] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:47.988193 11361 ts_tablet_manager.cc:1397] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.009s
I20260811 06:16:47.987599 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 955d8ca2c32c4152ac827240ede58b2e (table default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]) successfully deleted
I20260811 06:16:47.988559 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet d588d25f50a3444ab8d0f4261459d948 (table default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]) successfully deleted
W20260811 06:16:47.988704 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 818859f61e754a75baf8804939864fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818859f61e754a75baf8804939864fd7 already in progress: creating tablet
W20260811 06:16:47.988826 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet bf1a831788df4431b32c07c1e18b2c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf1a831788df4431b32c07c1e18b2c4a already in progress: creating tablet
I20260811 06:16:47.989498 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2bc3fd5062864693aa7108fd630a0c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:47.990049 11362 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
W20260811 06:16:47.990203 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bc3fd5062864693aa7108fd630a0c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.990227 11362 ts_tablet_manager.cc:1397] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 06:16:47.991073 11362 raft_consensus.cc:348] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.991333 11362 raft_consensus.cc:374] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.989008 11361 raft_consensus.cc:348] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.991436 11362 raft_consensus.cc:729] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.991493 11361 raft_consensus.cc:374] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:47.991619 11361 raft_consensus.cc:729] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:47.991699 11362 consensus_queue.cc:260] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.992241 11362 ts_tablet_manager.cc:1428] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:47.992642 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4145b5bbd2854fdfbbddcfa34e984604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.993265 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4145b5bbd2854fdfbbddcfa34e984604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.991858 11361 consensus_queue.cc:260] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:47.995164 11361 ts_tablet_manager.cc:1428] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260811 06:16:47.995029 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0afd45a96d354605b528113aa162a7d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.995772 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0afd45a96d354605b528113aa162a7d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.995916 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f855f0704b4a4ffdb05fc1987726f090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.996474 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f855f0704b4a4ffdb05fc1987726f090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.997821 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_50dfbed24a12413087ed0a2ba5270d0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:47.998340 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50dfbed24a12413087ed0a2ba5270d0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:47.998628 11362 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:47.999538 11371 ts_tablet_manager.cc:1918] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:47.999691 11371 log.cc:1196] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:48.000185 11361 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.000747 11371 ts_tablet_manager.cc:1939] T f4b818b7d50a43d6bfd0bd3fe66c7087 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.002647 11362 tablet_bootstrap.cc:654] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.002868 11365 tablet_bootstrap.cc:492] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.003041 11365 ts_tablet_manager.cc:1397] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.011s
I20260811 06:16:48.003764 11365 raft_consensus.cc:348] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.004029 11365 raft_consensus.cc:374] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.004099 11365 raft_consensus.cc:729] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.004328 11365 consensus_queue.cc:260] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.004796 11361 tablet_bootstrap.cc:654] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.004837 11365 ts_tablet_manager.cc:1428] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:48.005162 11365 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.006902 11365 tablet_bootstrap.cc:654] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.008353 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 6985d40409ae4480be7ad69e0969da07 with delete_type TABLET_DATA_DELETED (replaced by tablet a3e6bf8789594a91a1a35e6c750a0ddd) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.009698 11371 tablet_replica.cc:330] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.010133 11371 raft_consensus.cc:2229] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.010380 11371 raft_consensus.cc:2258] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.014019 11371 ts_tablet_manager.cc:1905] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.016284 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f4b818b7d50a43d6bfd0bd3fe66c7087 (table default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
W20260811 06:16:48.016770 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 577207be9523447c95f752e6861a3baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 577207be9523447c95f752e6861a3baf already in progress: creating tablet
W20260811 06:16:48.017133 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 818859f61e754a75baf8804939864fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818859f61e754a75baf8804939864fd7 already in progress: creating tablet
W20260811 06:16:48.017541 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c4b809805d1e43128b5b18f558002036 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b809805d1e43128b5b18f558002036 already in progress: creating tablet
I20260811 06:16:48.017684 11365 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.017911 11365 ts_tablet_manager.cc:1397] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260811 06:16:48.019085 11362 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.019340 11362 ts_tablet_manager.cc:1397] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260811 06:16:48.019891 11365 raft_consensus.cc:348] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.020277 11365 raft_consensus.cc:374] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.020447 11370 ts_tablet_manager.cc:1918] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.020478 11365 raft_consensus.cc:729] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.020678 11370 log.cc:1196] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/abdbcb4438fd4a9faf58c0c797c43e8b
I20260811 06:16:48.020787 11365 consensus_queue.cc:260] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.020792 11362 raft_consensus.cc:348] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.021309 11370 ts_tablet_manager.cc:1939] T abdbcb4438fd4a9faf58c0c797c43e8b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:48.022042 11365 ts_tablet_manager.cc:1428] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
W20260811 06:16:48.022244 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4671fa2f252e43cab925b11f50a70cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4671fa2f252e43cab925b11f50a70cff already in progress: creating tablet
I20260811 06:16:48.022333 11365 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.023011 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_67bb6fd937f14bd9b83287f166dd7563"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.023785 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67bb6fd937f14bd9b83287f166dd7563 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.025420 11365 tablet_bootstrap.cc:654] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.026324 11362 raft_consensus.cc:374] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.026746 11371 ts_tablet_manager.cc:1918] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.027115 11371 log.cc:1196] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/955d8ca2c32c4152ac827240ede58b2e
I20260811 06:16:48.027051 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_954ed7a85b3a4ca9829f922186111bca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.027757 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_954ed7a85b3a4ca9829f922186111bca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.027817 11371 ts_tablet_manager.cc:1939] T 955d8ca2c32c4152ac827240ede58b2e P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.026641 11362 raft_consensus.cc:729] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.029758 11362 consensus_queue.cc:260] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.030797 11362 ts_tablet_manager.cc:1428] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260811 06:16:48.031322 11362 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.034066 11119 tablet_service.cc:1467] Processing CreateTablet for tablet ef8b262229dd4b26b862527d2e17cb27 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.034204 11117 tablet_service.cc:1467] Processing CreateTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 (DEFAULT_TABLE table=default.Table_a7890da151b0471b86045bc59b692bcb [id=946afbec359e4e1b9804a4e6f1141cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.034706 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.035107 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8b262229dd4b26b862527d2e17cb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.037395 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_49107780657c4e69bfa79a8a520a80dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.038888 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49107780657c4e69bfa79a8a520a80dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.042124 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet 818859f61e754a75baf8804939864fd7 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.042425 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f29d57725aa74ed2b2d8eb05bd1e2990"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.043347 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.049285 11119 tablet_service.cc:1467] Processing CreateTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc (DEFAULT_TABLE table=default.Table_92dda8b4ff6c404abf437eb140977cb5 [id=257d5c1ee6aa4f1c8060822ef0fae341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.050032 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0f6ba0c08149f981fe27c5d40346cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.053287 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 (DEFAULT_TABLE table=default.Table_d6faf829a6dc427b8a6040774e8bcafe [id=6e7fa977ab2a4b8e963cb21ebab03568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.053488 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 57144ad37b874c91a89a25665a85eeb2 (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.053731 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 (DEFAULT_TABLE table=default.Table_714fea9e28ef4d1facbeb57e1d41a03b [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.053996 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccb7050ea9f4cc2a1b924814a204de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.054248 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57144ad37b874c91a89a25665a85eeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.054625 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368c0252cf84fe6831dc07eb173a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.061671 10884 tablet_service.cc:1467] Processing CreateTablet for tablet ef8b262229dd4b26b862527d2e17cb27 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.062397 10886 tablet_service.cc:1467] Processing CreateTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc (DEFAULT_TABLE table=default.Table_92dda8b4ff6c404abf437eb140977cb5 [id=257d5c1ee6aa4f1c8060822ef0fae341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.063656 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0f6ba0c08149f981fe27c5d40346cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.066751 10632 tablet_service.cc:1467] Processing CreateTablet for tablet ef8b262229dd4b26b862527d2e17cb27 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.067281 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8b262229dd4b26b862527d2e17cb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.069375 10882 tablet_service.cc:1467] Processing CreateTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 (DEFAULT_TABLE table=default.Table_a7890da151b0471b86045bc59b692bcb [id=946afbec359e4e1b9804a4e6f1141cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.070430 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8b262229dd4b26b862527d2e17cb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.078043 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4eb7864cc742929ac1756949b6bec5) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.076428 10632 tablet_service.cc:1467] Processing CreateTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 (DEFAULT_TABLE table=default.Table_a7890da151b0471b86045bc59b692bcb [id=946afbec359e4e1b9804a4e6f1141cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.080010 10620 tablet_service.cc:1467] Processing CreateTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc (DEFAULT_TABLE table=default.Table_92dda8b4ff6c404abf437eb140977cb5 [id=257d5c1ee6aa4f1c8060822ef0fae341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.080526 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee0f6ba0c08149f981fe27c5d40346cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.082585 10749 tablet.cc:2369] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:16:48.089771 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.092581 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4eb7864cc742929ac1756949b6bec5) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.093127 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 (DEFAULT_TABLE table=default.Table_d6faf829a6dc427b8a6040774e8bcafe [id=6e7fa977ab2a4b8e963cb21ebab03568]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:48.093685 10309 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 because the tablet was not found. No further retry: Not found: Tablet not found: f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:48.093700 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 57144ad37b874c91a89a25665a85eeb2 (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.093814 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 (DEFAULT_TABLE table=default.Table_714fea9e28ef4d1facbeb57e1d41a03b [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.094589 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.094858 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 (DEFAULT_TABLE table=default.Table_d6faf829a6dc427b8a6040774e8bcafe [id=6e7fa977ab2a4b8e963cb21ebab03568]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.095453 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccb7050ea9f4cc2a1b924814a204de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.097872 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368c0252cf84fe6831dc07eb173a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.100288 11378 raft_consensus.cc:482] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.100697 11378 raft_consensus.cc:504] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.101775 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57144ad37b874c91a89a25665a85eeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.105997 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 57144ad37b874c91a89a25665a85eeb2 (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.106583 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57144ad37b874c91a89a25665a85eeb2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.106616 11239 tablet.cc:2369] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:16:48.107653 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccb7050ea9f4cc2a1b924814a204de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.110997 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 (DEFAULT_TABLE table=default.Table_714fea9e28ef4d1facbeb57e1d41a03b [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.111564 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7368c0252cf84fe6831dc07eb173a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.112015 11378 leader_election.cc:288] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:48.126904 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 955d8ca2c32c4152ac827240ede58b2e (table default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]) successfully deleted
W20260811 06:16:48.127415 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f4b818b7d50a43d6bfd0bd3fe66c7087 because the tablet was not found. No further retry: Not found: Tablet not found: f4b818b7d50a43d6bfd0bd3fe66c7087
I20260811 06:16:48.128706 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet abdbcb4438fd4a9faf58c0c797c43e8b (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
I20260811 06:16:48.129184 11370 tablet_replica.cc:330] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:48.129491 11370 raft_consensus.cc:2229] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.129877 11370 raft_consensus.cc:2258] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.133230 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 2da20f0fe3ab4d85be35081e3d72f56a from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.135968 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_35412a7c2bd54e9d95217170b0e53051"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.136933 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35412a7c2bd54e9d95217170b0e53051 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.138551 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_92dda8b4ff6c404abf437eb140977cb5" } new_table_name: "default.Table_830bbd5a95fc4f45addf2c57b787c2d9" modify_external_catalogs: true
I20260811 06:16:48.138875 11361 tablet_bootstrap.cc:492] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.139132 11361 ts_tablet_manager.cc:1397] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.144s user 0.019s sys 0.082s
I20260811 06:16:48.140401 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8" } new_table_name: "default.Table_f996348e4ca94119a8fe9d98abe1cb11" modify_external_catalogs: true
I20260811 06:16:48.140556 11361 raft_consensus.cc:348] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.140918 11361 raft_consensus.cc:374] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.141083 11361 raft_consensus.cc:729] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.141448 11361 consensus_queue.cc:260] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.142376 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b6b1752778e1410f9e6f3dea51936d5f" } new_table_name: "default.Table_a0997cec306c4b50b9124325c4c92376" modify_external_catalogs: true
I20260811 06:16:48.144011 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9072e50721ce4fc2b7b38f83f52ba25e" } new_table_name: "default.Table_203f033414a24818992a3d37490a42eb" modify_external_catalogs: true
I20260811 06:16:48.149412 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d6faf829a6dc427b8a6040774e8bcafe" } new_table_name: "default.Table_586d663235904c22bb85aeb30236801f" modify_external_catalogs: true
I20260811 06:16:48.153146 11361 ts_tablet_manager.cc:1428] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20260811 06:16:48.153677 11361 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.156692 11361 tablet_bootstrap.cc:654] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.158319 11362 tablet_bootstrap.cc:654] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.162241 11119 tablet_service.cc:1467] Processing CreateTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.162990 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbab2b67ef434ebebe7fe947e9c4ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.166291 10880 tablet_service.cc:1467] Processing CreateTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.166923 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbab2b67ef434ebebe7fe947e9c4ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.166988 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.167411 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c50f909aad4bb991bfdeae8eab8455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.170251 10333 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]). Expected version 2 got 0
I20260811 06:16:48.171130 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:48.171274 10634 tablet_service.cc:1467] Processing CreateTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.171876 10324 master_service.cc:946] ReplaceTablet: received request to replace tablet 577207be9523447c95f752e6861a3baf from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.171990 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbab2b67ef434ebebe7fe947e9c4ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.182293 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.182864 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c50f909aad4bb991bfdeae8eab8455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.187209 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.187745 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.188313 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 (DEFAULT_TABLE table=default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.188508 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 (DEFAULT_TABLE table=default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:48.188616 10309 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 11c50f909aad4bb991bfdeae8eab8455 because the tablet was not found. No further retry: Not found: Tablet not found: 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:48.188894 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4eb7864cc742929ac1756949b6bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.188969 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4eb7864cc742929ac1756949b6bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.189671 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0afd45a96d354605b528113aa162a7d4" } modify_external_catalogs: true
I20260811 06:16:48.189559 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_49107780657c4e69bfa79a8a520a80dd" } modify_external_catalogs: true
I20260811 06:16:48.191006 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0afd45a96d354605b528113aa162a7d4" } modify_external_catalogs: true
I20260811 06:16:48.192929 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.193338 11368 tablet_replica.cc:330] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.193609 11368 raft_consensus.cc:2229] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.193967 11368 raft_consensus.cc:2258] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.195067 11368 ts_tablet_manager.cc:1905] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.198348 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_49107780657c4e69bfa79a8a520a80dd" } modify_external_catalogs: true
I20260811 06:16:48.200228 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_954ed7a85b3a4ca9829f922186111bca" } modify_external_catalogs: true
I20260811 06:16:48.200441 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_954ed7a85b3a4ca9829f922186111bca" } modify_external_catalogs: true
I20260811 06:16:48.203997 11370 ts_tablet_manager.cc:1905] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.206198 11361 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.206535 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet d588d25f50a3444ab8d0f4261459d948 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.207116 11361 ts_tablet_manager.cc:1397] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.053s user 0.015s sys 0.012s
I20260811 06:16:48.208407 11361 raft_consensus.cc:348] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.208797 11361 raft_consensus.cc:374] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.208985 11361 raft_consensus.cc:729] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.209376 11361 consensus_queue.cc:260] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.212744 11370 ts_tablet_manager.cc:1918] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.212968 11370 log.cc:1196] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6985d40409ae4480be7ad69e0969da07
I20260811 06:16:48.213114 11361 ts_tablet_manager.cc:1428] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:16:48.213632 11370 ts_tablet_manager.cc:1939] T 6985d40409ae4480be7ad69e0969da07 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:48.214191 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet abdbcb4438fd4a9faf58c0c797c43e8b with delete_type TABLET_DATA_DELETED (replaced by tablet 2da20f0fe3ab4d85be35081e3d72f56a) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.214586 11371 tablet_replica.cc:330] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.214821 11371 raft_consensus.cc:2229] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.214912 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.215107 11371 raft_consensus.cc:2258] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.214988 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 6985d40409ae4480be7ad69e0969da07 (table default.Table_9072e50721ce4fc2b7b38f83f52ba25e [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:16:48.215765 11361 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.217118 11368 ts_tablet_manager.cc:1918] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.217384 11368 log.cc:1196] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bc7fcb33853948a0a54b9ba93cbe2f53
I20260811 06:16:48.217456 11371 ts_tablet_manager.cc:1905] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.218191 11368 ts_tablet_manager.cc:1939] T bc7fcb33853948a0a54b9ba93cbe2f53 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:16:48.218312 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee0f6ba0c08149f981fe27c5d40346cc consensus state has no leader
I20260811 06:16:48.218541 11361 tablet_bootstrap.cc:654] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.218863 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_50dfbed24a12413087ed0a2ba5270d0e" } modify_external_catalogs: true
I20260811 06:16:48.219130 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_50dfbed24a12413087ed0a2ba5270d0e" } modify_external_catalogs: true
I20260811 06:16:48.219558 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bc7fcb33853948a0a54b9ba93cbe2f53 (table default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
I20260811 06:16:48.220167 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 (DEFAULT_TABLE table=default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:48.220556 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b4eb7864cc742929ac1756949b6bec5 consensus state has no leader
I20260811 06:16:48.220624 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11c50f909aad4bb991bfdeae8eab8455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.220978 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d45b7d1994a40cc83d2ce0d6de5a249 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:48.222069 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d45b7d1994a40cc83d2ce0d6de5a249 consensus state has no leader
I20260811 06:16:48.222491 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet d588d25f50a3444ab8d0f4261459d948 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.226301 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 (DEFAULT_TABLE table=default.Table_93a29957b5ee4984bef1d1ebaf1ddaf8 [id=8444a45079b34969a38481a4b00c1352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.226454 11371 ts_tablet_manager.cc:1918] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.226672 11371 log.cc:1196] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/abdbcb4438fd4a9faf58c0c797c43e8b
I20260811 06:16:48.227090 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b4eb7864cc742929ac1756949b6bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.227341 11371 ts_tablet_manager.cc:1939] T abdbcb4438fd4a9faf58c0c797c43e8b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.228583 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.229913 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:48.230419 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 11c50f909aad4bb991bfdeae8eab8455 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c50f909aad4bb991bfdeae8eab8455 already in progress: creating tablet
I20260811 06:16:48.231074 11371 tablet_replica.cc:330] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.231537 11371 raft_consensus.cc:2229] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.232023 11371 raft_consensus.cc:2258] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.233098 11371 ts_tablet_manager.cc:1905] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.237368 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.237916 11370 tablet_replica.cc:330] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:48.238255 11370 raft_consensus.cc:2229] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.238549 11370 raft_consensus.cc:2258] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:48.239077 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3e6bf8789594a91a1a35e6c750a0ddd consensus state has no leader
W20260811 06:16:48.239593 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ccb7050ea9f4cc2a1b924814a204de5 consensus state has no leader
I20260811 06:16:48.239670 11370 ts_tablet_manager.cc:1905] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.240863 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:48.241446 10322 catalog_manager.cc:6565] ReplaceTablet: tablet 2da20f0fe3ab4d85be35081e3d72f56a deleted and replaced by tablet 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:48.241685 11371 ts_tablet_manager.cc:1918] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.241951 11371 log.cc:1196] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/4671fa2f252e43cab925b11f50a70cff
I20260811 06:16:48.242444 11371 ts_tablet_manager.cc:1939] T 4671fa2f252e43cab925b11f50a70cff P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.242477 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.243369 10321 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 61a9a54292f94467bc04f3ba9813b011
I20260811 06:16:48.243602 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.244024 10333 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet e6211eb0442b42e6b7e60fa2433b0960
I20260811 06:16:48.244951 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet abdbcb4438fd4a9faf58c0c797c43e8b (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
I20260811 06:16:48.246297 11365 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.246538 11365 ts_tablet_manager.cc:1397] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.224s user 0.010s sys 0.013s
I20260811 06:16:48.247884 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.250036 11370 ts_tablet_manager.cc:1918] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.250046 11365 raft_consensus.cc:348] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.250531 11365 raft_consensus.cc:374] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.250715 11365 raft_consensus.cc:729] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.251180 11365 consensus_queue.cc:260] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.252134 11365 ts_tablet_manager.cc:1428] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:16:48.252466 11370 log.cc:1196] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/4671fa2f252e43cab925b11f50a70cff
I20260811 06:16:48.253106 11361 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.253192 11370 ts_tablet_manager.cc:1939] T 4671fa2f252e43cab925b11f50a70cff P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:48.253295 11361 ts_tablet_manager.cc:1397] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.038s user 0.021s sys 0.013s
I20260811 06:16:48.254359 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 4671fa2f252e43cab925b11f50a70cff (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
I20260811 06:16:48.255003 11361 raft_consensus.cc:348] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.255330 11361 raft_consensus.cc:374] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:48.255388 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2da20f0fe3ab4d85be35081e3d72f56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da20f0fe3ab4d85be35081e3d72f56a already in progress: creating tablet
I20260811 06:16:48.255472 11361 raft_consensus.cc:729] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.255817 11361 consensus_queue.cc:260] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.258443 11361 ts_tablet_manager.cc:1428] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260811 06:16:48.259982 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 7d45b7d1994a40cc83d2ce0d6de5a249
I20260811 06:16:48.260325 11361 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.260663 10328 catalog_manager.cc:6565] ReplaceTablet: tablet 7d45b7d1994a40cc83d2ce0d6de5a249 deleted and replaced by tablet e1ee53b81b8a441d8f9186bceb61129c
I20260811 06:16:48.263576 10791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:48.264568 10791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:48.264843 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:48.266340 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d45b7d1994a40cc83d2ce0d6de5a249 already in progress: creating tablet
I20260811 06:16:48.266925 11365 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.267277 10332 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 4d02a5a7f5694f3388a0e1199a820f61
I20260811 06:16:48.267427 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.269775 11365 tablet_bootstrap.cc:654] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.271668 11368 tablet_replica.cc:330] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.272046 11368 raft_consensus.cc:2229] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.272375 11368 raft_consensus.cc:2258] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.274453 11361 tablet_bootstrap.cc:654] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.277426 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "937a7467093a414882c34a3958af1deb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:48.280611 11365 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.280789 11365 ts_tablet_manager.cc:1397] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260811 06:16:48.281978 11365 raft_consensus.cc:348] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.282269 11365 raft_consensus.cc:374] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.282442 11365 raft_consensus.cc:729] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.282795 11365 consensus_queue.cc:260] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.283344 11362 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.283583 11362 ts_tablet_manager.cc:1397] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.252s user 0.003s sys 0.003s
I20260811 06:16:48.284541 11362 raft_consensus.cc:348] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.284817 11362 raft_consensus.cc:374] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.284871 11365 ts_tablet_manager.cc:1428] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:48.284953 11362 raft_consensus.cc:729] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.285293 11362 consensus_queue.cc:260] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:48.285701 10813 leader_election.cc:341] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.286311 11365 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.287739 11362 ts_tablet_manager.cc:1428] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:16:48.288121 11362 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.289427 11361 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.289705 11361 ts_tablet_manager.cc:1397] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.003s
I20260811 06:16:48.290998 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.125:35327
--webserver_interface=127.9.203.125
--webserver_port=45215
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260811 06:16:48.291065 11365 tablet_bootstrap.cc:654] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.292579 11368 ts_tablet_manager.cc:1905] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.294070 11361 raft_consensus.cc:348] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.294350 11361 raft_consensus.cc:374] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.294471 11361 raft_consensus.cc:729] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.294926 11361 consensus_queue.cc:260] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.295575 11361 ts_tablet_manager.cc:1428] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:16:48.296012 11361 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.296180 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 4671fa2f252e43cab925b11f50a70cff (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
W20260811 06:16:48.296689 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 11c50f909aad4bb991bfdeae8eab8455 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11c50f909aad4bb991bfdeae8eab8455 already in progress: creating tablet
W20260811 06:16:48.297153 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2da20f0fe3ab4d85be35081e3d72f56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2da20f0fe3ab4d85be35081e3d72f56a already in progress: creating tablet
I20260811 06:16:48.298158 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6f6438ab426342b1a830212e84bc6d46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.298918 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f6438ab426342b1a830212e84bc6d46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.301682 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.302848 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.302915 11361 tablet_bootstrap.cc:654] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.307054 11362 tablet_bootstrap.cc:654] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.310828 11371 tablet_replica.cc:330] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.311859 11371 raft_consensus.cc:2229] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.313284 11371 raft_consensus.cc:2258] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.314196 11371 ts_tablet_manager.cc:1905] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.318427 11361 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.318646 11361 ts_tablet_manager.cc:1397] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260811 06:16:48.319584 11361 raft_consensus.cc:348] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.319841 11361 raft_consensus.cc:374] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.319933 11361 raft_consensus.cc:729] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.320219 11361 consensus_queue.cc:260] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.322543 11362 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.322712 11362 ts_tablet_manager.cc:1397] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.005s
I20260811 06:16:48.323559 11362 raft_consensus.cc:348] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.323807 11362 raft_consensus.cc:374] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.323907 11362 raft_consensus.cc:729] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.324395 11361 ts_tablet_manager.cc:1428] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:16:48.324748 11361 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.326094 11362 consensus_queue.cc:260] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.326536 11361 tablet_bootstrap.cc:654] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.328583 11368 ts_tablet_manager.cc:1918] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.328763 11368 log.cc:1196] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/d588d25f50a3444ab8d0f4261459d948
I20260811 06:16:48.329169 11368 ts_tablet_manager.cc:1939] T d588d25f50a3444ab8d0f4261459d948 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:48.330361 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet d588d25f50a3444ab8d0f4261459d948 (table default.Table_845c4a4bc3bf461b93c77f3ef3e438f2 [id=6ea32d9d85264a6ca9f8c153f8086b09]) successfully deleted
I20260811 06:16:48.330745 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 57144ad37b874c91a89a25665a85eeb2 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:48.330816 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d45b7d1994a40cc83d2ce0d6de5a249 already in progress: creating tablet
I20260811 06:16:48.331072 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "937a7467093a414882c34a3958af1deb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.331652 10665 raft_consensus.cc:2454] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:48.332747 11361 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.332978 11361 ts_tablet_manager.cc:1397] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260811 06:16:48.333732 10810 leader_election.cc:302] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:48.333801 11361 raft_consensus.cc:348] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.334069 11361 raft_consensus.cc:374] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.334148 11361 raft_consensus.cc:729] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.334411 11361 consensus_queue.cc:260] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.334573 11378 raft_consensus.cc:2781] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:48.334724 11378 raft_consensus.cc:482] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:48.334831 11378 raft_consensus.cc:3037] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:48.335233 11368 tablet_replica.cc:330] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.337204 11361 ts_tablet_manager.cc:1428] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:16:48.337657 11378 raft_consensus.cc:504] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.339293 11361 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.340962 11361 tablet_bootstrap.cc:654] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.341590 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "937a7467093a414882c34a3958af1deb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:16:48.342006 10310 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.125:35327, user_credentials={real_user=slave}} blocked reactor thread for 44799.7us
W20260811 06:16:48.342267 10813 leader_election.cc:341] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.343111 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "937a7467093a414882c34a3958af1deb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:48.343348 10665 raft_consensus.cc:3037] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:48.343477 11362 ts_tablet_manager.cc:1428] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260811 06:16:48.343533 11368 raft_consensus.cc:2229] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.343722 11368 raft_consensus.cc:2258] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.344542 11368 ts_tablet_manager.cc:1905] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.345393 11362 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.345393 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]). Expected version 2 got 0
I20260811 06:16:48.347220 11362 tablet_bootstrap.cc:654] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.347615 11378 leader_election.cc:288] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:48.348273 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.348721 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d04b025b1b45009260ddd9f1b0aabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.348762 10665 raft_consensus.cc:2454] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:48.349423 10810 leader_election.cc:302] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:48.349948 11378 raft_consensus.cc:2781] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:48.351676 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 (DEFAULT_TABLE table=default.Table_0afd45a96d354605b528113aa162a7d4 [id=3dcac6ff3c0346e194219b87e4945063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.352167 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff1ad74f2034ed9b24c9712bae14cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.355836 11368 ts_tablet_manager.cc:1918] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.358151 11368 log.cc:1196] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/4671fa2f252e43cab925b11f50a70cff
I20260811 06:16:48.358400 11378 raft_consensus.cc:686] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:48.358678 11368 ts_tablet_manager.cc:1939] T 4671fa2f252e43cab925b11f50a70cff P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:48.359055 11117 tablet_service.cc:1467] Processing CreateTablet for tablet cb854704951e4a399267766fb5be40e2 (DEFAULT_TABLE table=default.Table_f855f0704b4a4ffdb05fc1987726f090 [id=fb4d89cc1c0346e282b734a2c8a070b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.359083 11378 consensus_queue.cc:237] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.359556 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb854704951e4a399267766fb5be40e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.360910 11368 tablet_replica.cc:330] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.361125 11368 raft_consensus.cc:2229] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.361294 11368 raft_consensus.cc:2258] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.362094 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 5b681f10c3de4bd798b9d519f10da103 (DEFAULT_TABLE table=default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 [id=783d0e401b2a42b1adf7bbbaa13eed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.362509 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b681f10c3de4bd798b9d519f10da103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.366091 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.366513 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d04b025b1b45009260ddd9f1b0aabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.366986 11368 ts_tablet_manager.cc:1905] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.368368 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 (DEFAULT_TABLE table=default.Table_0afd45a96d354605b528113aa162a7d4 [id=3dcac6ff3c0346e194219b87e4945063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.369014 11121 tablet_service.cc:1467] Processing CreateTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 (DEFAULT_TABLE table=default.Table_67bb6fd937f14bd9b83287f166dd7563 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.348716 10880 tablet_service.cc:1467] Processing CreateTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 (DEFAULT_TABLE table=default.Table_67bb6fd937f14bd9b83287f166dd7563 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.370306 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd7390a2221f4a1b9948c8a1353e4a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.373967 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff1ad74f2034ed9b24c9712bae14cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.374759 11368 ts_tablet_manager.cc:1918] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.374956 11368 log.cc:1196] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:48.375412 11362 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.375623 11362 ts_tablet_manager.cc:1397] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.009s
I20260811 06:16:48.376190 11361 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.376803 11362 raft_consensus.cc:348] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.377056 11362 raft_consensus.cc:374] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.377125 11362 raft_consensus.cc:729] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.377367 11362 consensus_queue.cc:260] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.375413 11368 ts_tablet_manager.cc:1939] T 2da20f0fe3ab4d85be35081e3d72f56a P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:48.377893 11361 ts_tablet_manager.cc:1397] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.039s user 0.014s sys 0.006s
I20260811 06:16:48.378115 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd7390a2221f4a1b9948c8a1353e4a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.379236 11362 ts_tablet_manager.cc:1428] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:16:48.379554 11362 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.379976 11361 raft_consensus.cc:348] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.380303 11361 raft_consensus.cc:374] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.380404 11361 raft_consensus.cc:729] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.380707 11361 consensus_queue.cc:260] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.381325 11361 ts_tablet_manager.cc:1428] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260811 06:16:48.381623 11361 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.381958 11362 tablet_bootstrap.cc:654] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:48.382174 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7d45b7d1994a40cc83d2ce0d6de5a249 consensus state has no leader
I20260811 06:16:48.382953 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 4671fa2f252e43cab925b11f50a70cff (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
I20260811 06:16:48.383361 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2da20f0fe3ab4d85be35081e3d72f56a (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
W20260811 06:16:48.383661 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d45b7d1994a40cc83d2ce0d6de5a249 already in progress: creating tablet
I20260811 06:16:48.385033 10328 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_203f033414a24818992a3d37490a42eb [id=5324723ba4ac4631ac127ce6648b33a4]). Expected version 2 got 0
I20260811 06:16:48.390733 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:48.391543 10309 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2da20f0fe3ab4d85be35081e3d72f56a because the tablet was not found. No further retry: Not found: Tablet not found: 2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:48.394667 10328 catalog_manager.cc:5495] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:16:48.395752 10328 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]). Expected version 2 got 0
I20260811 06:16:48.412215 11361 tablet_bootstrap.cc:654] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.419368 10632 tablet_service.cc:1467] Processing CreateTablet for tablet cb854704951e4a399267766fb5be40e2 (DEFAULT_TABLE table=default.Table_f855f0704b4a4ffdb05fc1987726f090 [id=fb4d89cc1c0346e282b734a2c8a070b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.419891 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb854704951e4a399267766fb5be40e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.429107 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.429610 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d04b025b1b45009260ddd9f1b0aabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.434115 11378 raft_consensus.cc:482] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.434345 11378 raft_consensus.cc:504] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.435632 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:48.436017 11163 raft_consensus.cc:2454] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:48.436480 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.436807 10813 leader_election.cc:302] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:48.437160 11453 raft_consensus.cc:2781] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:48.437288 11453 raft_consensus.cc:482] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:48.437408 11453 raft_consensus.cc:3037] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:48.438133 10810 leader_election.cc:341] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.440891 11453 raft_consensus.cc:504] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.442528 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:48.442798 11163 raft_consensus.cc:3037] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:48.444483 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:48.446062 11453 leader_election.cc:288] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:48.446127 10810 leader_election.cc:341] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.446622 11378 leader_election.cc:288] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:48.447306 11163 raft_consensus.cc:2454] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:48.448031 10813 leader_election.cc:302] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:48.448758 11378 raft_consensus.cc:2781] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:48.448992 11378 raft_consensus.cc:686] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:48.449386 11378 consensus_queue.cc:237] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.418103 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 5b681f10c3de4bd798b9d519f10da103 (DEFAULT_TABLE table=default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 [id=783d0e401b2a42b1adf7bbbaa13eed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.456470 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b681f10c3de4bd798b9d519f10da103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.460757 10620 tablet_service.cc:1467] Processing CreateTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 (DEFAULT_TABLE table=default.Table_67bb6fd937f14bd9b83287f166dd7563 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.461267 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd7390a2221f4a1b9948c8a1353e4a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.461870 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_dcc767edfa7645179a1784037ed2909d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.462503 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcc767edfa7645179a1784037ed2909d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.465600 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c94c766b75e749a7bf08f8b110567bf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.466187 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c94c766b75e749a7bf08f8b110567bf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.469347 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_21f0b9c149d7498e8ba846e4f3adb056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:48.469570 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_22654c0987894b08a5c3fdb36c77e3e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.470094 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21f0b9c149d7498e8ba846e4f3adb056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:48.470131 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22654c0987894b08a5c3fdb36c77e3e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.471576 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6b45271419ea4e4a9b82a7aff6a113f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.472129 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b45271419ea4e4a9b82a7aff6a113f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.473420 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b63b26856f794ef6abd6c07660a63664"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.474690 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b63b26856f794ef6abd6c07660a63664 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.475404 10873 tablet_service.cc:1467] Processing CreateTablet for tablet cb854704951e4a399267766fb5be40e2 (DEFAULT_TABLE table=default.Table_f855f0704b4a4ffdb05fc1987726f090 [id=fb4d89cc1c0346e282b734a2c8a070b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.475926 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb854704951e4a399267766fb5be40e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.478193 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 5b681f10c3de4bd798b9d519f10da103 (DEFAULT_TABLE table=default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 [id=783d0e401b2a42b1adf7bbbaa13eed9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.478874 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b681f10c3de4bd798b9d519f10da103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.480970 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 (DEFAULT_TABLE table=default.Table_0afd45a96d354605b528113aa162a7d4 [id=3dcac6ff3c0346e194219b87e4945063]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.481828 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ff1ad74f2034ed9b24c9712bae14cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.491107 11365 tablet_bootstrap.cc:492] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.491669 11365 ts_tablet_manager.cc:1397] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.205s user 0.031s sys 0.022s
I20260811 06:16:48.492547 11361 tablet_bootstrap.cc:492] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.492875 11361 ts_tablet_manager.cc:1397] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.001s
I20260811 06:16:48.493821 11361 raft_consensus.cc:348] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.494186 11361 raft_consensus.cc:374] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.494305 11361 raft_consensus.cc:729] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.494642 11361 consensus_queue.cc:260] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.496747 11361 ts_tablet_manager.cc:1428] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:16:48.497109 11361 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.498911 11361 tablet_bootstrap.cc:654] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.502774 11365 raft_consensus.cc:348] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.504724 11365 raft_consensus.cc:374] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.505191 11365 raft_consensus.cc:729] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.514546 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5158afff0daf485d8ebd8e03934c96b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.515484 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5158afff0daf485d8ebd8e03934c96b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.517602 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.518051 11368 tablet_replica.cc:330] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.518299 11368 raft_consensus.cc:2229] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.505996 11365 consensus_queue.cc:260] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.518548 11368 raft_consensus.cc:2258] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.518932 11365 ts_tablet_manager.cc:1428] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260811 06:16:48.519954 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b0c01936f89f4b849994b96605913860"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.520530 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0c01936f89f4b849994b96605913860 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.521139 10331 master_service.cc:946] ReplaceTablet: received request to replace tablet ef8b262229dd4b26b862527d2e17cb27 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.521569 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ea082d040262438eaf58a7135960e338" } modify_external_catalogs: true
I20260811 06:16:48.521821 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ea082d040262438eaf58a7135960e338" } modify_external_catalogs: true
I20260811 06:16:48.523026 11368 ts_tablet_manager.cc:1905] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.523478 11365 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.524514 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6f6438ab426342b1a830212e84bc6d46" } new_table_name: "default.Table_7f5293da6027442190e67927b3957712" modify_external_catalogs: true
I20260811 06:16:48.526948 11365 tablet_bootstrap.cc:654] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.527571 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6272334e630c4d86b022775a34779af7" } new_table_name: "default.Table_501489cfe36b4568bbc061b271ba8f06" modify_external_catalogs: true
I20260811 06:16:48.537004 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.538555 11371 ts_tablet_manager.cc:1918] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.538810 11371 log.cc:1196] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/577207be9523447c95f752e6861a3baf
I20260811 06:16:48.539343 11371 ts_tablet_manager.cc:1939] T 577207be9523447c95f752e6861a3baf P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.540753 11371 tablet_replica.cc:330] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.541755 11371 raft_consensus.cc:2229] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.542088 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 577207be9523447c95f752e6861a3baf (table default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]) successfully deleted
I20260811 06:16:48.544703 11368 ts_tablet_manager.cc:1918] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.544976 11368 log.cc:1196] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/7d45b7d1994a40cc83d2ce0d6de5a249
I20260811 06:16:48.545512 11368 ts_tablet_manager.cc:1939] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:48.546870 11127 tablet_service.cc:1467] Processing CreateTablet for tablet e180cc2c38aa4a78897e264276e4c766 (DEFAULT_TABLE table=default.Table_6f6438ab426342b1a830212e84bc6d46 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.547454 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e180cc2c38aa4a78897e264276e4c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.548964 10333 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 34c4f425aa214a7a9e8a029389d59a04 (table default.Table_58c73784d3fa44d48d364bb30ebd549b [id=d41d2864aded430783e667b5f3a87e84]). Expected version 1 got 0
I20260811 06:16:48.552129 11377 raft_consensus.cc:482] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.552486 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]) successfully deleted
I20260811 06:16:48.552394 11377 raft_consensus.cc:504] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.553280 10880 tablet_service.cc:1467] Processing CreateTablet for tablet e180cc2c38aa4a78897e264276e4c766 (DEFAULT_TABLE table=default.Table_6f6438ab426342b1a830212e84bc6d46 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.553845 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e180cc2c38aa4a78897e264276e4c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.554504 11377 leader_election.cc:288] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:48.555536 10337 catalog_manager.cc:5495] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:16:48.556062 10337 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_203f033414a24818992a3d37490a42eb [id=5324723ba4ac4631ac127ce6648b33a4]). Expected version 2 got 0
I20260811 06:16:48.556818 10886 tablet_service.cc:1467] Processing CreateTablet for tablet b1d6641dd44340889879d3b92018b3f0 (DEFAULT_TABLE table=default.Table_35412a7c2bd54e9d95217170b0e53051 [id=ccf560e77b2a45bd81fc1f5d3c03fe08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.557428 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d6641dd44340889879d3b92018b3f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.557493 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_203f033414a24818992a3d37490a42eb" } new_table_name: "default.Table_f5ff2bf414524d4dbcab4dbfcd8f4ff4" modify_external_catalogs: true
I20260811 06:16:48.558028 11115 tablet_service.cc:1467] Processing CreateTablet for tablet e1ee53b81b8a441d8f9186bceb61129c (DEFAULT_TABLE table=default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.558466 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ee53b81b8a441d8f9186bceb61129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.559118 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a7890da151b0471b86045bc59b692bcb" } new_table_name: "default.Table_bf629c6c917c4c6fbbd8fceed0452997" modify_external_catalogs: true
I20260811 06:16:48.560542 10882 tablet_service.cc:1467] Processing CreateTablet for tablet e1ee53b81b8a441d8f9186bceb61129c (DEFAULT_TABLE table=default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.561029 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ee53b81b8a441d8f9186bceb61129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.562055 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0530ec053f47df800cf2abf549b068 (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.562481 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d0530ec053f47df800cf2abf549b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.564621 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_58c73784d3fa44d48d364bb30ebd549b" } new_table_name: "default.Table_e29856ff2b0e4fae84c701e646151d4b" modify_external_catalogs: true
I20260811 06:16:48.565900 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 4671fa2f252e43cab925b11f50a70cff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.566087 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0530ec053f47df800cf2abf549b068 (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.566550 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d0530ec053f47df800cf2abf549b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.566625 11117 tablet_service.cc:1467] Processing CreateTablet for tablet b1d6641dd44340889879d3b92018b3f0 (DEFAULT_TABLE table=default.Table_35412a7c2bd54e9d95217170b0e53051 [id=ccf560e77b2a45bd81fc1f5d3c03fe08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.567035 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d6641dd44340889879d3b92018b3f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.569265 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e180cc2c38aa4a78897e264276e4c766 consensus state has no leader
I20260811 06:16:48.569661 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d45b7d1994a40cc83d2ce0d6de5a249 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:48.570147 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 714247a11705421b9c012d99bdbf3d04 consensus state has no leader
I20260811 06:16:48.572144 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_586d663235904c22bb85aeb30236801f" } modify_external_catalogs: true
I20260811 06:16:48.572346 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_586d663235904c22bb85aeb30236801f" } modify_external_catalogs: true
I20260811 06:16:48.573768 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8de5ee7cac9e43459ba7480c93abb7e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.574563 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8de5ee7cac9e43459ba7480c93abb7e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:48.576418 10311 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 4671fa2f252e43cab925b11f50a70cff because the tablet was not found. No further retry: Not found: Tablet not found: 4671fa2f252e43cab925b11f50a70cff
I20260811 06:16:48.581933 11377 raft_consensus.cc:482] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.582151 11377 raft_consensus.cc:504] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.582823 11377 leader_election.cc:288] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:48.593526 11371 raft_consensus.cc:2258] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.595842 11362 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.596031 11362 ts_tablet_manager.cc:1397] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.217s user 0.076s sys 0.129s
I20260811 06:16:48.596027 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7fcb33853948a0a54b9ba93cbe2f53" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.596508 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c4f425aa214a7a9e8a029389d59a04" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.596828 11362 raft_consensus.cc:348] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.597105 11362 raft_consensus.cc:374] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.597185 11362 raft_consensus.cc:729] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.597388 11362 consensus_queue.cc:260] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.597985 11362 ts_tablet_manager.cc:1428] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:16:48.598382 11362 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.600140 11362 tablet_bootstrap.cc:654] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:48.602474 11046 leader_election.cc:341] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:48.602783 11046 leader_election.cc:341] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.604326 10273 master_runner.cc:186] Error getting master registration for 127.9.203.125:35327: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111),
I20260811 06:16:48.604532 10273 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 06:16:48.608536 11362 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.608738 11362 ts_tablet_manager.cc:1397] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260811 06:16:48.609603 11362 raft_consensus.cc:348] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.609966 11362 raft_consensus.cc:374] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.610054 11362 raft_consensus.cc:729] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.610308 11362 consensus_queue.cc:260] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.610575 11371 ts_tablet_manager.cc:1905] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.611860 11362 ts_tablet_manager.cc:1428] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:16:48.612253 11362 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.613991 11362 tablet_bootstrap.cc:654] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.621157 11361 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:48.621356 11361 ts_tablet_manager.cc:1397] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.124s user 0.005s sys 0.007s
I20260811 06:16:48.622328 11361 raft_consensus.cc:348] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.622581 11361 raft_consensus.cc:374] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.622602 11362 tablet_bootstrap.cc:492] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.622677 11361 raft_consensus.cc:729] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.622983 11361 consensus_queue.cc:260] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.622762 11362 ts_tablet_manager.cc:1397] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 06:16:48.623590 11361 ts_tablet_manager.cc:1428] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:48.624019 11362 raft_consensus.cc:348] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.624243 11362 raft_consensus.cc:374] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.624323 11362 raft_consensus.cc:729] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.542629 11365 tablet_bootstrap.cc:492] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.584673 10620 tablet_service.cc:1467] Processing CreateTablet for tablet e180cc2c38aa4a78897e264276e4c766 (DEFAULT_TABLE table=default.Table_6f6438ab426342b1a830212e84bc6d46 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.585567 10627 tablet_service.cc:1467] Processing CreateTablet for tablet b1d6641dd44340889879d3b92018b3f0 (DEFAULT_TABLE table=default.Table_35412a7c2bd54e9d95217170b0e53051 [id=ccf560e77b2a45bd81fc1f5d3c03fe08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.624635 11362 consensus_queue.cc:260] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.586256 10629 tablet_service.cc:1467] Processing CreateTablet for tablet e1ee53b81b8a441d8f9186bceb61129c (DEFAULT_TABLE table=default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.586869 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0530ec053f47df800cf2abf549b068 (DEFAULT_TABLE table=default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.625188 11365 ts_tablet_manager.cc:1397] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.102s user 0.000s sys 0.006s
I20260811 06:16:48.625174 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 1ff1ad74f2034ed9b24c9712bae14cd3
I20260811 06:16:48.625313 11362 ts_tablet_manager.cc:1428] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:16:48.625598 11362 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.626073 11365 raft_consensus.cc:348] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.626317 11365 raft_consensus.cc:374] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.626408 11365 raft_consensus.cc:729] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.626621 11365 consensus_queue.cc:260] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.627231 11365 ts_tablet_manager.cc:1428] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:16:48.627242 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:48.627318 11362 tablet_bootstrap.cc:654] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.627617 10322 catalog_manager.cc:6565] ReplaceTablet: tablet 57144ad37b874c91a89a25665a85eeb2 deleted and replaced by tablet 0391df1c64954f66a3987aba9257ca4b
I20260811 06:16:48.627949 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_02fc64f6fff6403bba126deaa2a74ffe" } modify_external_catalogs: true
I20260811 06:16:48.628165 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_02fc64f6fff6403bba126deaa2a74ffe" } modify_external_catalogs: true
I20260811 06:16:48.628778 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet bbbaa377ea524e57ab23d73928d70775
I20260811 06:16:48.629205 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e180cc2c38aa4a78897e264276e4c766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.629371 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_35412a7c2bd54e9d95217170b0e53051" } modify_external_catalogs: true
I20260811 06:16:48.629532 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_35412a7c2bd54e9d95217170b0e53051" } modify_external_catalogs: true
I20260811 06:16:48.629858 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1d6641dd44340889879d3b92018b3f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.630317 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1ee53b81b8a441d8f9186bceb61129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.630426 11362 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.630585 11362 ts_tablet_manager.cc:1397] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 06:16:48.630764 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d0530ec053f47df800cf2abf549b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.630991 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ef8b262229dd4b26b862527d2e17cb27
I20260811 06:16:48.631366 10331 catalog_manager.cc:6565] ReplaceTablet: tablet ef8b262229dd4b26b862527d2e17cb27 deleted and replaced by tablet 16674be53bd54f9395b650e19edd3cf4
I20260811 06:16:48.631305 11362 raft_consensus.cc:348] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.631547 11362 raft_consensus.cc:374] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.631620 11362 raft_consensus.cc:729] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.631615 10331 master_service.cc:946] ReplaceTablet: received request to replace tablet cbab2b67ef434ebebe7fe947e9c4ff66 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.631896 11362 consensus_queue.cc:260] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.632611 11362 ts_tablet_manager.cc:1428] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:16:48.632912 11362 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:16:48.632948 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34c4f425aa214a7a9e8a029389d59a04 consensus state has no leader
I20260811 06:16:48.633200 10333 master_service.cc:946] ReplaceTablet: received request to replace tablet c4b809805d1e43128b5b18f558002036 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:48.634682 11362 tablet_bootstrap.cc:654] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.635907 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 4ccb7050ea9f4cc2a1b924814a204de5
I20260811 06:16:48.636145 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.636404 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.636656 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.636991 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:48.637156 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 consensus state has no leader
I20260811 06:16:48.638195 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:48.638592 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bbbaa377ea524e57ab23d73928d70775 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbbaa377ea524e57ab23d73928d70775 already in progress: creating tablet
W20260811 06:16:48.638849 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ef8b262229dd4b26b862527d2e17cb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef8b262229dd4b26b862527d2e17cb27 already in progress: creating tablet
I20260811 06:16:48.638953 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.640498 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f3920e2166f84954861eb83e3296fed4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:48.641007 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:48.641137 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3920e2166f84954861eb83e3296fed4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:48.642410 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff1ad74f2034ed9b24c9712bae14cd3 already in progress: creating tablet
W20260811 06:16:48.642680 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 57144ad37b874c91a89a25665a85eeb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57144ad37b874c91a89a25665a85eeb2 already in progress: creating tablet
I20260811 06:16:48.642930 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:48.643667 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4ccb7050ea9f4cc2a1b924814a204de5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ccb7050ea9f4cc2a1b924814a204de5 already in progress: creating tablet
I20260811 06:16:48.645469 11365 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.647439 11365 tablet_bootstrap.cc:654] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.649976 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.654561 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:48.657078 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 4ccb7050ea9f4cc2a1b924814a204de5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ccb7050ea9f4cc2a1b924814a204de5 already in progress: creating tablet
I20260811 06:16:48.657563 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet cbab2b67ef434ebebe7fe947e9c4ff66
I20260811 06:16:48.657943 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:48.658017 10331 catalog_manager.cc:6565] ReplaceTablet: tablet cbab2b67ef434ebebe7fe947e9c4ff66 deleted and replaced by tablet 9c5fa9633057485b917f117819d79398
I20260811 06:16:48.658906 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.659173 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.659236 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.659502 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:48.660185 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet cbab2b67ef434ebebe7fe947e9c4ff66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbab2b67ef434ebebe7fe947e9c4ff66 already in progress: creating tablet
W20260811 06:16:48.660473 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b1d6641dd44340889879d3b92018b3f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1d6641dd44340889879d3b92018b3f0 already in progress: creating tablet
I20260811 06:16:48.662065 11365 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.662258 11365 ts_tablet_manager.cc:1397] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.002s
I20260811 06:16:48.663101 11365 raft_consensus.cc:348] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.663378 11365 raft_consensus.cc:374] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.663455 11365 raft_consensus.cc:729] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.663743 11365 consensus_queue.cc:260] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.664350 11365 ts_tablet_manager.cc:1428] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:16:48.664697 11365 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.667162 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.667586 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:48.668643 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b1d6641dd44340889879d3b92018b3f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1d6641dd44340889879d3b92018b3f0 already in progress: creating tablet
W20260811 06:16:48.668982 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet cbab2b67ef434ebebe7fe947e9c4ff66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbab2b67ef434ebebe7fe947e9c4ff66 already in progress: creating tablet
I20260811 06:16:48.675195 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.679298 11377 raft_consensus.cc:482] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.679488 11377 raft_consensus.cc:504] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.679953 11476 raft_consensus.cc:482] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.680190 11377 leader_election.cc:288] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:48.680169 11476 raft_consensus.cc:504] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.680913 11365 tablet_bootstrap.cc:654] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.681213 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.681493 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.681519 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818859f61e754a75baf8804939864fd7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.681738 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.682165 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.682480 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.682732 11476 leader_election.cc:288] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:48.683815 11046 leader_election.cc:341] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.683940 11362 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.684098 11362 ts_tablet_manager.cc:1397] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.016s
I20260811 06:16:48.684515 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d45b7d1994a40cc83d2ce0d6de5a249" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.684898 11362 raft_consensus.cc:348] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.685137 11362 raft_consensus.cc:374] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:48.685148 11046 leader_election.cc:341] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:48.685225 11362 raft_consensus.cc:729] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.685460 11362 consensus_queue.cc:260] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.687141 11361 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:48.687227 11362 ts_tablet_manager.cc:1428] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:48.688429 11362 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.688938 11361 tablet_bootstrap.cc:654] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:48.689924 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 57144ad37b874c91a89a25665a85eeb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57144ad37b874c91a89a25665a85eeb2 already in progress: creating tablet
I20260811 06:16:48.690073 11362 tablet_bootstrap.cc:654] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:48.690194 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff1ad74f2034ed9b24c9712bae14cd3 already in progress: creating tablet
W20260811 06:16:48.690507 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet bbbaa377ea524e57ab23d73928d70775 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbbaa377ea524e57ab23d73928d70775 already in progress: creating tablet
W20260811 06:16:48.690807 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ef8b262229dd4b26b862527d2e17cb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef8b262229dd4b26b862527d2e17cb27 already in progress: creating tablet
I20260811 06:16:48.691201 11371 ts_tablet_manager.cc:1918] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.691558 11371 log.cc:1196] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:48.692010 11371 ts_tablet_manager.cc:1939] T 2da20f0fe3ab4d85be35081e3d72f56a P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:48.693184 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2da20f0fe3ab4d85be35081e3d72f56a (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
I20260811 06:16:48.697404 10324 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_203f033414a24818992a3d37490a42eb [id=5324723ba4ac4631ac127ce6648b33a4]). Expected version 2 got 0
I20260811 06:16:48.697688 10324 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]). Expected version 2 got 0
I20260811 06:16:48.698029 10318 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:48.702601 11362 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.702803 11362 ts_tablet_manager.cc:1397] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260811 06:16:48.702936 10634 tablet_service.cc:1467] Processing CreateTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 (DEFAULT_TABLE table=default.Table_b0c01936f89f4b849994b96605913860 [id=4a189ec6459341a6b50dc5c1d28bd101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.703480 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efe8eb16e84575abd18a5079aad2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.703624 11362 raft_consensus.cc:348] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.703873 11362 raft_consensus.cc:374] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.703953 11362 raft_consensus.cc:729] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.704205 11362 consensus_queue.cc:260] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.706120 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.706619 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a00b0b51f574bfb843b65c0876ab4fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.708050 11371 tablet_replica.cc:330] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.708259 11371 raft_consensus.cc:2229] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.708472 11371 raft_consensus.cc:2258] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.708449 11362 ts_tablet_manager.cc:1428] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:16:48.710891 11365 tablet_bootstrap.cc:492] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.711056 11365 ts_tablet_manager.cc:1397] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.004s
I20260811 06:16:48.711834 11365 raft_consensus.cc:348] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.712121 11365 raft_consensus.cc:374] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.712272 11365 raft_consensus.cc:729] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.712532 11365 consensus_queue.cc:260] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.713120 10879 tablet_service.cc:1467] Processing CreateTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 (DEFAULT_TABLE table=default.Table_b0c01936f89f4b849994b96605913860 [id=4a189ec6459341a6b50dc5c1d28bd101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.713620 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efe8eb16e84575abd18a5079aad2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.713917 11365 ts_tablet_manager.cc:1428] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:48.714207 11365 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.715885 11365 tablet_bootstrap.cc:654] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.717073 11362 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.719532 11362 tablet_bootstrap.cc:654] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.719607 11127 tablet_service.cc:1467] Processing CreateTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 (DEFAULT_TABLE table=default.Table_b0c01936f89f4b849994b96605913860 [id=4a189ec6459341a6b50dc5c1d28bd101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.720126 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efe8eb16e84575abd18a5079aad2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.728230 11365 tablet_bootstrap.cc:492] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.728446 11365 ts_tablet_manager.cc:1397] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260811 06:16:48.728848 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 67f458dba9444bfa8841a84cdb798588 (DEFAULT_TABLE table=default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.729351 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f458dba9444bfa8841a84cdb798588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.729737 10619 tablet_service.cc:1467] Processing CreateTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 (DEFAULT_TABLE table=default.Table_5158afff0daf485d8ebd8e03934c96b9 [id=d69efd0f2d58483fa432041de974afee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.730242 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88af70bbada49309a0e7cc7c333d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.730373 11362 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:48.730521 11362 ts_tablet_manager.cc:1397] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260811 06:16:48.731309 11362 raft_consensus.cc:348] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.731545 11362 raft_consensus.cc:374] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.731628 11362 raft_consensus.cc:729] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.731907 11362 consensus_queue.cc:260] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.733862 11362 ts_tablet_manager.cc:1428] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:48.734015 10620 tablet_service.cc:1467] Processing CreateTablet for tablet a4a46cec25944310a838d8323b119883 (DEFAULT_TABLE table=default.Table_21f0b9c149d7498e8ba846e4f3adb056 [id=cba6e77528e14ab3a7f179586ccde125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.733637 10626 tablet_service.cc:1467] Processing CreateTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 (DEFAULT_TABLE table=default.Table_c94c766b75e749a7bf08f8b110567bf6 [id=93e85671b313459588f530b2d88ef20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.734431 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a46cec25944310a838d8323b119883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.735167 11362 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:48.736070 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.737367 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.737735 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00b6bdfc8ac4b5db81de9f614fcf213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.738019 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 (DEFAULT_TABLE table=default.Table_6b45271419ea4e4a9b82a7aff6a113f7 [id=28510dda062b4164a5672202cb2f268c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.738459 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62cbef937a46dfbc4dbf934e887139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.742977 10627 tablet_service.cc:1467] Processing CreateTablet for tablet fe5eea681072477ab52a822d721629cf (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.743468 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe5eea681072477ab52a822d721629cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.743717 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet bbbaa377ea524e57ab23d73928d70775 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbbaa377ea524e57ab23d73928d70775 already in progress: creating tablet
W20260811 06:16:48.744014 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ef8b262229dd4b26b862527d2e17cb27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef8b262229dd4b26b862527d2e17cb27 already in progress: creating tablet
W20260811 06:16:48.744264 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4ccb7050ea9f4cc2a1b924814a204de5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ccb7050ea9f4cc2a1b924814a204de5 already in progress: creating tablet
I20260811 06:16:48.744309 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_88237316c36548428404ae24db07eee6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.744940 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88237316c36548428404ae24db07eee6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.746071 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_eab05c1288934064b96562cf11ac2675"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:48.746306 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f01adcdde391454abf2f768c080313c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.746678 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eab05c1288934064b96562cf11ac2675 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:48.746842 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01adcdde391454abf2f768c080313c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.747915 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0d2536cbb5f54439a910d4be40e09f1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.748479 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d2536cbb5f54439a910d4be40e09f1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.750439 11121 tablet_service.cc:1467] Processing CreateTablet for tablet a4a46cec25944310a838d8323b119883 (DEFAULT_TABLE table=default.Table_21f0b9c149d7498e8ba846e4f3adb056 [id=cba6e77528e14ab3a7f179586ccde125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.752071 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6fe2d394a0cd40908c7e8c378458a6d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.752652 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fe2d394a0cd40908c7e8c378458a6d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.753414 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b51f2e988c1941248eaf6280965ee906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.754148 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b51f2e988c1941248eaf6280965ee906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.754729 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 937a7467093a414882c34a3958af1deb
I20260811 06:16:48.758442 10880 tablet_service.cc:1467] Processing CreateTablet for tablet a4a46cec25944310a838d8323b119883 (DEFAULT_TABLE table=default.Table_21f0b9c149d7498e8ba846e4f3adb056 [id=cba6e77528e14ab3a7f179586ccde125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.729360 11365 raft_consensus.cc:348] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.758994 10884 tablet_service.cc:1467] Processing CreateTablet for tablet fe5eea681072477ab52a822d721629cf (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.759207 11365 raft_consensus.cc:374] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.759282 11365 raft_consensus.cc:729] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.759528 11362 tablet_bootstrap.cc:654] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.759618 11365 consensus_queue.cc:260] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.760044 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 67f458dba9444bfa8841a84cdb798588 (DEFAULT_TABLE table=default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.760613 10872 tablet_service.cc:1467] Processing CreateTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 (DEFAULT_TABLE table=default.Table_5158afff0daf485d8ebd8e03934c96b9 [id=d69efd0f2d58483fa432041de974afee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.759640 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 (DEFAULT_TABLE table=default.Table_6b45271419ea4e4a9b82a7aff6a113f7 [id=28510dda062b4164a5672202cb2f268c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.764606 11365 ts_tablet_manager.cc:1428] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.036s user 0.002s sys 0.001s
I20260811 06:16:48.765298 11371 ts_tablet_manager.cc:1905] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.765746 11365 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.767762 11365 tablet_bootstrap.cc:654] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:48.768947 10330 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_501489cfe36b4568bbc061b271ba8f06 [id=a66e3380ba3d46ca93a6f98468b36cc3]). Expected version 1 got 0
I20260811 06:16:48.769534 10330 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 34c4f425aa214a7a9e8a029389d59a04 (table default.Table_e29856ff2b0e4fae84c701e646151d4b [id=d41d2864aded430783e667b5f3a87e84]). Expected version 2 got 0
I20260811 06:16:48.779844 10324 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_f5ff2bf414524d4dbcab4dbfcd8f4ff4 [id=5324723ba4ac4631ac127ce6648b33a4]). Expected version 3 got 0
I20260811 06:16:48.783331 11116 tablet_service.cc:1467] Processing CreateTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 (DEFAULT_TABLE table=default.Table_5158afff0daf485d8ebd8e03934c96b9 [id=d69efd0f2d58483fa432041de974afee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.785442 11118 tablet_service.cc:1467] Processing CreateTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 (DEFAULT_TABLE table=default.Table_c94c766b75e749a7bf08f8b110567bf6 [id=93e85671b313459588f530b2d88ef20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.786046 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 (DEFAULT_TABLE table=default.Table_6b45271419ea4e4a9b82a7aff6a113f7 [id=28510dda062b4164a5672202cb2f268c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.786450 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 67f458dba9444bfa8841a84cdb798588 (DEFAULT_TABLE table=default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.785693 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.786878 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a46cec25944310a838d8323b119883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.788182 11128 tablet_service.cc:1467] Processing CreateTablet for tablet fe5eea681072477ab52a822d721629cf (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.789817 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 937a7467093a414882c34a3958af1deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.790441 11370 tablet_replica.cc:330] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:48.790666 11370 raft_consensus.cc:2229] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.791235 11370 raft_consensus.cc:2258] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.792040 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f458dba9444bfa8841a84cdb798588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.793349 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.793587 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet bc7fcb33853948a0a54b9ba93cbe2f53 with delete_type TABLET_DATA_DELETED (replaced by tablet 57144ad37b874c91a89a25665a85eeb2) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.793852 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 2da20f0fe3ab4d85be35081e3d72f56a with delete_type TABLET_DATA_DELETED (replaced by tablet 5d0530ec053f47df800cf2abf549b068) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.795082 11370 ts_tablet_manager.cc:1905] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.796044 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a00b0b51f574bfb843b65c0876ab4fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.796291 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62cbef937a46dfbc4dbf934e887139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.798183 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88af70bbada49309a0e7cc7c333d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.798875 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 0391df1c64954f66a3987aba9257ca4b (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.799181 10627 tablet_service.cc:1467] Processing CreateTablet for tablet e7d44fa2df924751a4835821901b56de (DEFAULT_TABLE table=default.Table_f3920e2166f84954861eb83e3296fed4 [id=5b9959e1b81d47a7a923c6d7dbbc3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.799616 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d44fa2df924751a4835821901b56de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.798192 11110 tablet_service.cc:1467] Processing CreateTablet for tablet e7d44fa2df924751a4835821901b56de (DEFAULT_TABLE table=default.Table_f3920e2166f84954861eb83e3296fed4 [id=5b9959e1b81d47a7a923c6d7dbbc3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.802222 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d (DEFAULT_TABLE table=default.Table_8de5ee7cac9e43459ba7480c93abb7e6 [id=9ead873f818d428d989ee530a0993eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.804463 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d (DEFAULT_TABLE table=default.Table_8de5ee7cac9e43459ba7480c93abb7e6 [id=9ead873f818d428d989ee530a0993eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.804921 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516021603ee24b3f9bdffd1e30e5ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.809084 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 0391df1c64954f66a3987aba9257ca4b (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.809522 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0391df1c64954f66a3987aba9257ca4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.815448 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00b6bdfc8ac4b5db81de9f614fcf213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.819577 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.823565 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 16674be53bd54f9395b650e19edd3cf4 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.824059 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 9c5fa9633057485b917f117819d79398 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.824298 10330 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_f5ff2bf414524d4dbcab4dbfcd8f4ff4 [id=5324723ba4ac4631ac127ce6648b33a4]). Expected version 3 got 0
I20260811 06:16:48.826495 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe5eea681072477ab52a822d721629cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.827400 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d44fa2df924751a4835821901b56de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.824018 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:48.829332 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516021603ee24b3f9bdffd1e30e5ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.829552 11386 raft_consensus.cc:482] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.829840 11386 raft_consensus.cc:504] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.830649 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c5fa9633057485b917f117819d79398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.831988 11386 leader_election.cc:288] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:48.836624 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16674be53bd54f9395b650e19edd3cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.837294 11479 raft_consensus.cc:482] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.837543 11479 raft_consensus.cc:504] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.838555 11479 leader_election.cc:288] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:48.842954 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a00b0b51f574bfb843b65c0876ab4fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.844642 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 937a7467093a414882c34a3958af1deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.842025 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 937a7467093a414882c34a3958af1deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:48.844969 11368 tablet_replica.cc:330] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:48.851713 11368 raft_consensus.cc:2229] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:48.861749 11371 ts_tablet_manager.cc:1918] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:48.863142 11371 log.cc:1196] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bc7fcb33853948a0a54b9ba93cbe2f53
I20260811 06:16:48.866608 11371 ts_tablet_manager.cc:1939] T bc7fcb33853948a0a54b9ba93cbe2f53 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:48.867539 11046 leader_election.cc:341] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 577207be9523447c95f752e6861a3baf
I20260811 06:16:48.869103 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0391df1c64954f66a3987aba9257ca4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.877558 11371 tablet_replica.cc:330] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:48.883051 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f5ff2bf414524d4dbcab4dbfcd8f4ff4" } new_table_name: "default.Table_44e6a24dad8848d5838d7d8f351a2b37" modify_external_catalogs: true
I20260811 06:16:48.883710 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_889fe834de014fd8add63e0a4fec5334"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.884495 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_889fe834de014fd8add63e0a4fec5334 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.884742 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_67bb6fd937f14bd9b83287f166dd7563" } new_table_name: "default.Table_22da2514559b4b45ba484d557c75fb21" modify_external_catalogs: true
I20260811 06:16:48.886001 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4118842221c9462f8bc4cad981c9d859"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.886725 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4118842221c9462f8bc4cad981c9d859 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.893095 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_830bbd5a95fc4f45addf2c57b787c2d9" } modify_external_catalogs: true
I20260811 06:16:48.899758 10871 tablet_service.cc:1467] Processing CreateTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 (DEFAULT_TABLE table=default.Table_c94c766b75e749a7bf08f8b110567bf6 [id=93e85671b313459588f530b2d88ef20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.902424 11368 pending_rounds.cc:62] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:16:48.910703 10337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f29d57725aa74ed2b2d8eb05bd1e2990" } modify_external_catalogs: true
I20260811 06:16:48.910989 10337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f29d57725aa74ed2b2d8eb05bd1e2990" } modify_external_catalogs: true
I20260811 06:16:48.911844 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_830bbd5a95fc4f45addf2c57b787c2d9" } modify_external_catalogs: true
I20260811 06:16:48.912719 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bc7fcb33853948a0a54b9ba93cbe2f53 (table default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
W20260811 06:16:48.913151 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b1d6641dd44340889879d3b92018b3f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1d6641dd44340889879d3b92018b3f0 already in progress: creating tablet
W20260811 06:16:48.913554 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet cbab2b67ef434ebebe7fe947e9c4ff66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbab2b67ef434ebebe7fe947e9c4ff66 already in progress: creating tablet
W20260811 06:16:48.920737 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 57144ad37b874c91a89a25665a85eeb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57144ad37b874c91a89a25665a85eeb2 already in progress: creating tablet
I20260811 06:16:48.910405 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 9c5fa9633057485b917f117819d79398 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.921830 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c5fa9633057485b917f117819d79398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.916851 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 16674be53bd54f9395b650e19edd3cf4 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.924434 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16674be53bd54f9395b650e19edd3cf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.924860 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ff1ad74f2034ed9b24c9712bae14cd3 already in progress: creating tablet
I20260811 06:16:48.925225 11371 raft_consensus.cc:2229] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:48.926235 11371 raft_consensus.cc:2258] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.939059 11371 ts_tablet_manager.cc:1905] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.945607 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b0c01936f89f4b849994b96605913860" } new_table_name: "default.Table_92530abb51c3445489f381a0d398b1aa" modify_external_catalogs: true
I20260811 06:16:48.945906 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_79a06e688c7f4536bb78d323d80892cf" } modify_external_catalogs: true
I20260811 06:16:48.946089 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_79a06e688c7f4536bb78d323d80892cf" } modify_external_catalogs: true
I20260811 06:16:48.946916 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_501489cfe36b4568bbc061b271ba8f06" } new_table_name: "default.Table_e13ac4cebe1a4159afc5c09e66f266b0" modify_external_catalogs: true
I20260811 06:16:48.947522 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6401c9c79a224ae58509e8d8cf313d0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.948127 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6401c9c79a224ae58509e8d8cf313d0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.949118 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f855f0704b4a4ffdb05fc1987726f090" } modify_external_catalogs: true
I20260811 06:16:48.949307 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f855f0704b4a4ffdb05fc1987726f090" } modify_external_catalogs: true
I20260811 06:16:48.950255 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0a8f5d2ee57a420eabeb83b561548598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:48.950805 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a8f5d2ee57a420eabeb83b561548598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:48.953914 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8de5ee7cac9e43459ba7480c93abb7e6" } new_table_name: "default.Table_64c34f7955a74a59ac3a81ca903e25f3" modify_external_catalogs: true
W20260811 06:16:48.955446 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd7390a2221f4a1b9948c8a1353e4a49 consensus state has no leader
I20260811 06:16:48.903611 10868 tablet_service.cc:1467] Processing CreateTablet for tablet e7d44fa2df924751a4835821901b56de (DEFAULT_TABLE table=default.Table_f3920e2166f84954861eb83e3296fed4 [id=5b9959e1b81d47a7a923c6d7dbbc3020]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.960294 11368 pending_rounds.cc:68] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213218244694016 op_type: NO_OP noop_request { }
I20260811 06:16:48.960659 11368 raft_consensus.cc:2866] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:48.963480 11378 raft_consensus.cc:482] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:48.963923 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88af70bbada49309a0e7cc7c333d6f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.963878 11365 tablet_bootstrap.cc:492] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:48.964823 11378 raft_consensus.cc:504] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:48.964986 11365 ts_tablet_manager.cc:1397] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.199s user 0.011s sys 0.067s
I20260811 06:16:48.965528 11378 leader_election.cc:288] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:48.966763 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:48.967044 10664 raft_consensus.cc:2454] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:48.968358 11368 raft_consensus.cc:2258] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:48.967437 11365 raft_consensus.cc:348] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.968864 11365 raft_consensus.cc:374] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:48.969632 11365 raft_consensus.cc:729] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:48.973129 11368 ts_tablet_manager.cc:1905] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:48.973532 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.973776 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c00b6bdfc8ac4b5db81de9f614fcf213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.974108 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d44fa2df924751a4835821901b56de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:48.979509 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c5efe8eb16e84575abd18a5079aad2c9 consensus state has no leader
W20260811 06:16:48.980325 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 714247a11705421b9c012d99bdbf3d04 consensus state has no leader
I20260811 06:16:48.973513 11365 consensus_queue.cc:260] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:48.984381 11365 ts_tablet_manager.cc:1428] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260811 06:16:48.985289 11365 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:48.987299 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 3025339a6c9e4e07bba4104006206bb8 (DEFAULT_TABLE table=default.Table_88237316c36548428404ae24db07eee6 [id=38608eecd4ea4c92a3cedbfad1d631a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.988736 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3025339a6c9e4e07bba4104006206bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.987728 10632 tablet_service.cc:1467] Processing CreateTablet for tablet a378a6f20c564eb685b655a762b638ae (DEFAULT_TABLE table=default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.990542 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a378a6f20c564eb685b655a762b638ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:48.973423 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d (DEFAULT_TABLE table=default.Table_8de5ee7cac9e43459ba7480c93abb7e6 [id=9ead873f818d428d989ee530a0993eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.964654 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 16674be53bd54f9395b650e19edd3cf4 (DEFAULT_TABLE table=default.Table_bb77b27494bc4806ac4da4ede8cb81ef [id=2b421f86f2ea4c92a7b124bbf300a02e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.963766 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 0391df1c64954f66a3987aba9257ca4b (DEFAULT_TABLE table=default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:48.997795 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 577207be9523447c95f752e6861a3baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:48.998167 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 with delete_type TABLET_DATA_DELETED (replaced by tablet e1ee53b81b8a441d8f9186bceb61129c) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.003019 11371 ts_tablet_manager.cc:1918] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.003206 11371 log.cc:1196] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/818859f61e754a75baf8804939864fd7
I20260811 06:16:49.003598 11371 ts_tablet_manager.cc:1939] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.004305 11371 tablet_replica.cc:330] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.004519 11371 raft_consensus.cc:2229] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.004714 11371 raft_consensus.cc:2258] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.005290 11371 ts_tablet_manager.cc:1905] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.006044 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 818859f61e754a75baf8804939864fd7 (table default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]) successfully deleted
I20260811 06:16:49.007978 11365 tablet_bootstrap.cc:654] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.013415 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e29856ff2b0e4fae84c701e646151d4b" } modify_external_catalogs: true
I20260811 06:16:49.013872 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e29856ff2b0e4fae84c701e646151d4b" } modify_external_catalogs: true
I20260811 06:16:49.017510 11365 tablet_bootstrap.cc:492] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.018358 11365 ts_tablet_manager.cc:1397] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.002s
I20260811 06:16:49.018618 10324 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:49.019201 11365 raft_consensus.cc:348] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.019481 11365 raft_consensus.cc:374] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.019573 11365 raft_consensus.cc:729] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.019979 10810 leader_election.cc:302] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:49.019824 11365 consensus_queue.cc:260] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.022193 11365 ts_tablet_manager.cc:1428] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:16:49.024148 11365 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.027658 11365 tablet_bootstrap.cc:654] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.033568 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.033897 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 818859f61e754a75baf8804939864fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.036664 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 9c5fa9633057485b917f117819d79398 (DEFAULT_TABLE table=default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:49.034471 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 52491.2us
I20260811 06:16:49.033643 11371 ts_tablet_manager.cc:1918] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.034772 11365 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.041586 11371 log.cc:1196] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/937a7467093a414882c34a3958af1deb
I20260811 06:16:49.041894 11365 ts_tablet_manager.cc:1397] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260811 06:16:49.042138 11371 ts_tablet_manager.cc:1939] T 937a7467093a414882c34a3958af1deb P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.042994 11365 raft_consensus.cc:348] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.043267 11365 raft_consensus.cc:374] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.043366 11365 raft_consensus.cc:729] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.043430 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]) successfully deleted
I20260811 06:16:49.043619 11365 consensus_queue.cc:260] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.044191 11365 ts_tablet_manager.cc:1428] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:49.044811 11365 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.045965 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet cd7390a2221f4a1b9948c8a1353e4a49 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:49.047863 11365 tablet_bootstrap.cc:654] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.048499 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a46cec25944310a838d8323b119883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.047286 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 3025339a6c9e4e07bba4104006206bb8 (DEFAULT_TABLE table=default.Table_88237316c36548428404ae24db07eee6 [id=38608eecd4ea4c92a3cedbfad1d631a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.051832 11371 tablet_replica.cc:330] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.052274 11371 raft_consensus.cc:2229] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.053634 11371 raft_consensus.cc:2258] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.054723 10324 master_service.cc:946] ReplaceTablet: received request to replace tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:49.055286 11371 ts_tablet_manager.cc:1905] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.056463 11365 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.056674 11365 ts_tablet_manager.cc:1397] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260811 06:16:49.050355 10855 tablet_service.cc:1467] Processing CreateTablet for tablet a378a6f20c564eb685b655a762b638ae (DEFAULT_TABLE table=default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.057734 11378 raft_consensus.cc:2781] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.057870 11378 raft_consensus.cc:482] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.059048 11378 raft_consensus.cc:3037] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.057675 11365 raft_consensus.cc:348] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.060072 11365 raft_consensus.cc:374] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.060173 11365 raft_consensus.cc:729] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.060505 11365 consensus_queue.cc:260] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.062484 11365 ts_tablet_manager.cc:1428] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260811 06:16:49.063669 11378 raft_consensus.cc:504] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:49.064193 11365 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.065248 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:49.065527 10664 raft_consensus.cc:3037] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.067404 11365 tablet_bootstrap.cc:654] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.077797 11371 ts_tablet_manager.cc:1918] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.078066 11371 log.cc:1196] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7d45b7d1994a40cc83d2ce0d6de5a249
I20260811 06:16:49.078562 11371 ts_tablet_manager.cc:1939] T 7d45b7d1994a40cc83d2ce0d6de5a249 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.078954 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c5fa9633057485b917f117819d79398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.078570 10664 raft_consensus.cc:2454] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:49.080371 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]) successfully deleted
I20260811 06:16:49.082579 11386 raft_consensus.cc:482] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.082765 11386 raft_consensus.cc:504] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.083381 11386 leader_election.cc:288] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.088929 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a378a6f20c564eb685b655a762b638ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.093598 11365 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.094007 11365 ts_tablet_manager.cc:1397] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.004s
I20260811 06:16:49.095470 11365 raft_consensus.cc:348] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.095866 11365 raft_consensus.cc:374] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.096494 11365 raft_consensus.cc:729] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.097082 11365 consensus_queue.cc:260] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.098116 11365 ts_tablet_manager.cc:1428] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:16:49.095965 11378 leader_election.cc:288] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.099467 11365 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.099709 11479 raft_consensus.cc:482] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.100440 11479 raft_consensus.cc:504] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.101153 11479 leader_election.cc:288] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:49.102332 11046 leader_election.cc:341] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:49.106987 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3025339a6c9e4e07bba4104006206bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.107244 10810 leader_election.cc:302] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:49.109918 11365 tablet_bootstrap.cc:654] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:49.110303 11289 log.cc:924] Time spent T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260811 06:16:49.112193 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516021603ee24b3f9bdffd1e30e5ea9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.127230 11378 raft_consensus.cc:2781] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:49.128176 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0391df1c64954f66a3987aba9257ca4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.128587 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16674be53bd54f9395b650e19edd3cf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:49.129357 11442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:16:49.129899 11442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:16:49.130154 11442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 06:16:49.133611 11370 ts_tablet_manager.cc:1918] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.134183 11361 tablet_bootstrap.cc:492] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.136092 11386 raft_consensus.cc:482] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.136468 11386 raft_consensus.cc:504] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.136974 11370 log.cc:1196] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/937a7467093a414882c34a3958af1deb
I20260811 06:16:49.137383 11361 ts_tablet_manager.cc:1397] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.447s user 0.059s sys 0.088s
I20260811 06:16:49.137377 11386 leader_election.cc:288] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.135751 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:49.135289 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.138857 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:49.139006 11365 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.139279 11365 ts_tablet_manager.cc:1397] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.007s
I20260811 06:16:49.139828 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 7368c0252cf84fe6831dc07eb173a7d6 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:49.142133 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.142638 11365 raft_consensus.cc:348] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.143039 11365 raft_consensus.cc:374] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.143182 11365 raft_consensus.cc:729] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:16:49.143630 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5b681f10c3de4bd798b9d519f10da103 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b681f10c3de4bd798b9d519f10da103 already in progress: creating tablet
I20260811 06:16:49.143507 11365 consensus_queue.cc:260] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.143740 10331 master_service.cc:946] ReplaceTablet: received request to replace tablet a3e6bf8789594a91a1a35e6c750a0ddd from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:49.144382 11365 ts_tablet_manager.cc:1428] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260811 06:16:49.144793 11365 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.147823 11370 ts_tablet_manager.cc:1939] T 937a7467093a414882c34a3958af1deb P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.148630 11365 tablet_bootstrap.cc:654] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.149010 11370 tablet_replica.cc:330] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.149664 11370 raft_consensus.cc:2229] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.149894 11370 raft_consensus.cc:2258] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.150733 11361 raft_consensus.cc:348] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:49.152079 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 516021603ee24b3f9bdffd1e30e5ea9d consensus state has no leader
I20260811 06:16:49.153074 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8041eb9d4b2f475ca05f2a96278befd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.154018 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8041eb9d4b2f475ca05f2a96278befd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.157331 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ee0f6ba0c08149f981fe27c5d40346cc
W20260811 06:16:49.158344 11442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:16:49.158627 11442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:16:49.158771 11442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260811 06:16:49.158505 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d8cc9675043642d78621843c4e0c7600"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.158933 11442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 06:16:49.159276 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8cc9675043642d78621843c4e0c7600 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.159660 11365 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.159842 11365 ts_tablet_manager.cc:1397] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260811 06:16:49.161890 11370 ts_tablet_manager.cc:1905] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.161973 11361 raft_consensus.cc:374] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.162187 11361 raft_consensus.cc:729] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.163570 11361 consensus_queue.cc:260] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.164885 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.165630 11361 ts_tablet_manager.cc:1428] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.028s user 0.000s sys 0.003s
I20260811 06:16:49.165675 11365 raft_consensus.cc:348] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.166000 11365 raft_consensus.cc:374] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.166211 11365 raft_consensus.cc:729] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.166531 11365 consensus_queue.cc:260] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:16:49.166708 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ee0f6ba0c08149f981fe27c5d40346cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee0f6ba0c08149f981fe27c5d40346cc already in progress: creating tablet
I20260811 06:16:49.167326 11365 ts_tablet_manager.cc:1428] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:16:49.167776 11365 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.170778 11365 tablet_bootstrap.cc:654] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.171077 11361 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.171351 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:49.172188 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_919cbb1f6a0e4d029dd90ae72e326608"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.172923 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_919cbb1f6a0e4d029dd90ae72e326608 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.174196 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet cb854704951e4a399267766fb5be40e2
I20260811 06:16:49.175177 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8c02798e56e74a03b0a45aa15d15d200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.175912 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c02798e56e74a03b0a45aa15d15d200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.180223 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.180223 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:49.182314 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet cb854704951e4a399267766fb5be40e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb854704951e4a399267766fb5be40e2 already in progress: creating tablet
W20260811 06:16:49.182777 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5d0530ec053f47df800cf2abf549b068 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d0530ec053f47df800cf2abf549b068 already in progress: creating tablet
I20260811 06:16:49.183344 11361 tablet_bootstrap.cc:654] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.188722 10321 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_e13ac4cebe1a4159afc5c09e66f266b0 [id=a66e3380ba3d46ca93a6f98468b36cc3]). Expected version 2 got 0
I20260811 06:16:49.189446 11442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.125:35327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.9.203.125
--webserver_port=45215
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:16:49.191488 11442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:16:49.194221 11442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 06:16:49.189610 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_959c1a8bfd794c13b012f7ce1d150c7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.200129 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_959c1a8bfd794c13b012f7ce1d150c7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.203634 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 34c4f425aa214a7a9e8a029389d59a04
I20260811 06:16:49.206624 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.207163 11371 tablet_replica.cc:330] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.207442 11371 raft_consensus.cc:2229] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.207661 11371 raft_consensus.cc:2258] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.208691 11371 ts_tablet_manager.cc:1905] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.208756 11361 tablet_bootstrap.cc:492] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.209051 11361 ts_tablet_manager.cc:1397] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.003s
I20260811 06:16:49.214550 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.214174 11361 raft_consensus.cc:348] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.215018 11361 raft_consensus.cc:374] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.215240 11361 raft_consensus.cc:729] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.215693 11361 consensus_queue.cc:260] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.221640 11361 ts_tablet_manager.cc:1428] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260811 06:16:49.223989 11361 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.224501 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe5eea681072477ab52a822d721629cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.229612 11378 raft_consensus.cc:686] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:49.230229 11378 consensus_queue.cc:237] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:49.235761 11361 tablet_bootstrap.cc:654] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.239065 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67f458dba9444bfa8841a84cdb798588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.238983 11370 ts_tablet_manager.cc:1918] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.242249 11370 log.cc:1196] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7d45b7d1994a40cc83d2ce0d6de5a249
I20260811 06:16:49.242780 11370 ts_tablet_manager.cc:1939] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.243562 11370 tablet_replica.cc:330] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.243854 11370 raft_consensus.cc:2229] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.244159 11370 raft_consensus.cc:2258] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.244469 11371 ts_tablet_manager.cc:1918] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.244705 11371 log.cc:1196] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/34c4f425aa214a7a9e8a029389d59a04
I20260811 06:16:49.245548 11371 ts_tablet_manager.cc:1939] T 34c4f425aa214a7a9e8a029389d59a04 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.245918 11370 ts_tablet_manager.cc:1905] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.246452 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.246644 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:49.247946 10813 leader_election.cc:341] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:49.246498 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.261217 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.261960 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.262403 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c62cbef937a46dfbc4dbf934e887139. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:49.265815 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 101522us
I20260811 06:16:49.267023 11362 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
W20260811 06:16:49.271450 10813 leader_election.cc:341] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:49.274757 11362 ts_tablet_manager.cc:1397] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.532s user 0.006s sys 0.008s
I20260811 06:16:49.277150 11361 tablet_bootstrap.cc:492] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.281108 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:49.281876 10330 catalog_manager.cc:6565] ReplaceTablet: tablet cd7390a2221f4a1b9948c8a1353e4a49 deleted and replaced by tablet 58fdb5920003438d983987ff242f6dce
I20260811 06:16:49.283062 11361 ts_tablet_manager.cc:1397] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.003s
I20260811 06:16:49.284417 11361 raft_consensus.cc:348] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.284543 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_169104a730344ae6b72202968cfdc9dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.285492 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_169104a730344ae6b72202968cfdc9dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.290135 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]) successfully deleted
I20260811 06:16:49.291836 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.298271 11361 raft_consensus.cc:374] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.299017 11361 raft_consensus.cc:729] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.300971 11361 consensus_queue.cc:260] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.307358 11361 ts_tablet_manager.cc:1428] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260811 06:16:49.312225 11361 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.313973 11511 raft_consensus.cc:482] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.318441 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ff35295f6a4a4f53b8f6af0a0f3c4e29
I20260811 06:16:49.319237 10324 catalog_manager.cc:6565] ReplaceTablet: tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 deleted and replaced by tablet e29473031c72482fad2969fd940d1571
I20260811 06:16:49.303202 11370 ts_tablet_manager.cc:1918] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.323370 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 with delete_type TABLET_DATA_DELETED (replaced by tablet e29473031c72482fad2969fd940d1571) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.324184 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bb77b27494bc4806ac4da4ede8cb81ef" } new_table_name: "default.Table_16a7feffa91f405e9d4c28e60d193045" modify_external_catalogs: true
I20260811 06:16:49.325788 11370 log.cc:1196] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bc7fcb33853948a0a54b9ba93cbe2f53
I20260811 06:16:49.329257 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.331334 11370 ts_tablet_manager.cc:1939] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.332185 11370 tablet_replica.cc:330] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.332530 11370 raft_consensus.cc:2229] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.333662 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 with delete_type TABLET_DATA_DELETED (replaced by tablet e29473031c72482fad2969fd940d1571) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.334051 11370 raft_consensus.cc:2258] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.339746 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:49.340631 10337 catalog_manager.cc:6565] ReplaceTablet: tablet 7368c0252cf84fe6831dc07eb173a7d6 deleted and replaced by tablet 9d24d909b82640a386b612fba1f38fac
I20260811 06:16:49.341252 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:49.341744 10331 catalog_manager.cc:6565] ReplaceTablet: tablet a3e6bf8789594a91a1a35e6c750a0ddd deleted and replaced by tablet 97b348d30dc44fa383a27d9097c2e598
I20260811 06:16:49.342710 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f2364840e195411d8525c4d0f0f6b7e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.343596 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2364840e195411d8525c4d0f0f6b7e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.347404 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d24d909b82640a386b612fba1f38fac) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.348222 11386 raft_consensus.cc:482] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.348563 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd with delete_type TABLET_DATA_DELETED (replaced by tablet 97b348d30dc44fa383a27d9097c2e598) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.348610 11386 raft_consensus.cc:504] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.349398 11386 leader_election.cc:288] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.350957 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3602836ee9884ec38d9454df8b4e628c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.351841 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3602836ee9884ec38d9454df8b4e628c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.353053 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0a8f5d2ee57a420eabeb83b561548598" } new_table_name: "default.Table_4f065771f7724a1fafa66eba960633cb" modify_external_catalogs: true
I20260811 06:16:49.355556 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f01adcdde391454abf2f768c080313c1" } new_table_name: "default.Table_ab7d7297b9254dd2b1ac985f3a308b74" modify_external_catalogs: true
I20260811 06:16:49.334446 11361 tablet_bootstrap.cc:654] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.360486 11370 ts_tablet_manager.cc:1905] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:49.363023 11047 leader_election.cc:341] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 7d45b7d1994a40cc83d2ce0d6de5a249
I20260811 06:16:49.365283 11047 leader_election.cc:302] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:49.365705 11047 raft_consensus.cc:2670] T 7d45b7d1994a40cc83d2ce0d6de5a249 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:49.371420 11361 tablet_bootstrap.cc:492] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:49.372180 11047 leader_election.cc:341] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: bc7fcb33853948a0a54b9ba93cbe2f53
I20260811 06:16:49.372277 11361 ts_tablet_manager.cc:1397] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.005s
I20260811 06:16:49.372399 11047 leader_election.cc:302] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:49.372704 11047 raft_consensus.cc:2670] T bc7fcb33853948a0a54b9ba93cbe2f53 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:49.374768 11361 raft_consensus.cc:348] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:49.375434 11361 raft_consensus.cc:374] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.377069 11361 raft_consensus.cc:729] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.377444 11361 consensus_queue.cc:260] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:49.314342 11511 raft_consensus.cc:504] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.378739 11361 ts_tablet_manager.cc:1428] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:16:49.379294 11361 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.379256 11362 raft_consensus.cc:348] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.379712 11362 raft_consensus.cc:374] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:49.384615 10309 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 516021603ee24b3f9bdffd1e30e5ea9d (table default.Table_64c34f7955a74a59ac3a81ca903e25f3 [id=9ead873f818d428d989ee530a0993eb9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 516021603ee24b3f9bdffd1e30e5ea9d consensus state has no leader
I20260811 06:16:49.389346 11361 tablet_bootstrap.cc:654] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.391004 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e7d2f44fbe0746df9f34637def4bdd58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.391793 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7d2f44fbe0746df9f34637def4bdd58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.395054 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d24d909b82640a386b612fba1f38fac) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.377787 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818859f61e754a75baf8804939864fd7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.396911 11362 raft_consensus.cc:729] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.397465 11362 consensus_queue.cc:260] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.409004 11361 tablet_bootstrap.cc:492] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.410887 11370 ts_tablet_manager.cc:1918] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.411950 11370 log.cc:1196] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:49.412302 11378 raft_consensus.cc:482] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.412148 11361 ts_tablet_manager.cc:1397] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.003s
I20260811 06:16:49.412715 11370 ts_tablet_manager.cc:1939] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.413029 11378 raft_consensus.cc:504] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.415228 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbbaa377ea524e57ab23d73928d70775" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.415480 11163 raft_consensus.cc:2454] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:49.414988 11361 raft_consensus.cc:348] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.416925 11361 raft_consensus.cc:374] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.417047 11361 raft_consensus.cc:729] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.418277 10813 leader_election.cc:302] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.418032 11361 consensus_queue.cc:260] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.419516 11361 ts_tablet_manager.cc:1428] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:16:49.426745 11370 tablet_replica.cc:330] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.427914 11361 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.428747 11370 raft_consensus.cc:2229] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.429054 11370 raft_consensus.cc:2258] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.430001 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c4f425aa214a7a9e8a029389d59a04" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.431190 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "577207be9523447c95f752e6861a3baf" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.432896 11370 ts_tablet_manager.cc:1905] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.433375 11361 tablet_bootstrap.cc:654] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.435038 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818859f61e754a75baf8804939864fd7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.440801 11361 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:49.441059 10886 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.006s sys 0.005s
I20260811 06:16:49.441087 11361 ts_tablet_manager.cc:1397] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.006s
I20260811 06:16:49.396673 10922 raft_consensus.cc:2454] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:49.442617 11511 leader_election.cc:288] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.443493 11361 raft_consensus.cc:348] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.444645 11361 raft_consensus.cc:374] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:49.444743 10813 leader_election.cc:341] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:49.445246 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd with delete_type TABLET_DATA_DELETED (replaced by tablet 97b348d30dc44fa383a27d9097c2e598) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.445300 11361 raft_consensus.cc:729] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.445349 11047 leader_election.cc:302] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
W20260811 06:16:49.445900 11047 raft_consensus.cc:2670] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:49.430661 10923 raft_consensus.cc:2454] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:49.446123 11361 consensus_queue.cc:260] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.447271 11361 ts_tablet_manager.cc:1428] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:16:49.448629 11047 leader_election.cc:302] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:49.449126 11479 raft_consensus.cc:2781] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.449232 11479 raft_consensus.cc:482] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.449337 11479 raft_consensus.cc:3037] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.450698 11361 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.451828 11371 tablet_replica.cc:330] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.452179 11371 raft_consensus.cc:2229] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.452422 11371 raft_consensus.cc:2258] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:49.453006 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 34c4f425aa214a7a9e8a029389d59a04 because the tablet was not found. No further retry: Not found: Tablet not found: 34c4f425aa214a7a9e8a029389d59a04
W20260811 06:16:49.453321 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet cd7390a2221f4a1b9948c8a1353e4a49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd7390a2221f4a1b9948c8a1353e4a49 already in progress: creating tablet
W20260811 06:16:49.453617 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 already in progress: creating tablet
W20260811 06:16:49.453984 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7368c0252cf84fe6831dc07eb173a7d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7368c0252cf84fe6831dc07eb173a7d6 already in progress: creating tablet
I20260811 06:16:49.453145 11479 raft_consensus.cc:504] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:49.455240 11047 leader_election.cc:341] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 2da20f0fe3ab4d85be35081e3d72f56a
I20260811 06:16:49.456768 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbbaa377ea524e57ab23d73928d70775" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:49.457088 10664 raft_consensus.cc:2454] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:49.457142 11047 leader_election.cc:302] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:49.457399 11047 raft_consensus.cc:2670] T 2da20f0fe3ab4d85be35081e3d72f56a P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:49.458336 11361 tablet_bootstrap.cc:654] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:49.460789 11046 leader_election.cc:341] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 34c4f425aa214a7a9e8a029389d59a04
I20260811 06:16:49.461308 11365 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.461649 11365 ts_tablet_manager.cc:1397] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.294s user 0.112s sys 0.143s
I20260811 06:16:49.462491 11479 leader_election.cc:288] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.462713 11479 raft_consensus.cc:482] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.462800 11365 raft_consensus.cc:348] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.462949 11479 raft_consensus.cc:504] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.463266 11365 raft_consensus.cc:374] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.463413 11365 raft_consensus.cc:729] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.463586 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b51f2e988c1941248eaf6280965ee906" } new_table_name: "default.Table_3ae91f4b99784386b61c6b22b804b906" modify_external_catalogs: true
I20260811 06:16:49.463804 11365 consensus_queue.cc:260] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.464637 11365 ts_tablet_manager.cc:1428] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:16:49.465085 11365 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.465554 11479 leader_election.cc:288] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.468948 11365 tablet_bootstrap.cc:654] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.469074 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2bc3fd5062864693aa7108fd630a0c63" } modify_external_catalogs: true
I20260811 06:16:49.469326 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2bc3fd5062864693aa7108fd630a0c63" } modify_external_catalogs: true
I20260811 06:16:49.470098 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]) successfully deleted
W20260811 06:16:49.470794 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2bdb349406a46629e6c307e1ebfd9dc has no consensus state
I20260811 06:16:49.471122 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 3025339a6c9e4e07bba4104006206bb8 (DEFAULT_TABLE table=default.Table_88237316c36548428404ae24db07eee6 [id=38608eecd4ea4c92a3cedbfad1d631a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.471868 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3025339a6c9e4e07bba4104006206bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.471764 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ccb9de8c002144dda1c7faff8b803de8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.472258 11106 tablet_service.cc:1467] Processing CreateTablet for tablet a378a6f20c564eb685b655a762b638ae (DEFAULT_TABLE table=default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:49.472498 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccb9de8c002144dda1c7faff8b803de8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.473976 11370 ts_tablet_manager.cc:1918] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.474256 11370 log.cc:1196] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/818859f61e754a75baf8804939864fd7
I20260811 06:16:49.474311 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a378a6f20c564eb685b655a762b638ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.483017 10318 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:49.484735 10321 catalog_manager.cc:5495] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:16:49.485371 10321 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:49.488952 10322 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_e13ac4cebe1a4159afc5c09e66f266b0 [id=a66e3380ba3d46ca93a6f98468b36cc3]). Expected version 2 got 0
W20260811 06:16:49.491230 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae1e42440ff14857b297621ca6031835 consensus state has no leader
I20260811 06:16:49.491241 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.491384 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.491657 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.491962 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.491981 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.492518 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.492764 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.493242 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d24d909b82640a386b612fba1f38fac) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.493686 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet a3e6bf8789594a91a1a35e6c750a0ddd with delete_type TABLET_DATA_DELETED (replaced by tablet 97b348d30dc44fa383a27d9097c2e598) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.493924 11370 ts_tablet_manager.cc:1939] T 818859f61e754a75baf8804939864fd7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.494099 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_714fea9e28ef4d1facbeb57e1d41a03b" } new_table_name: "default.Table_97d2925aeaee4b19a82c011e43fe3969" modify_external_catalogs: true
I20260811 06:16:49.494395 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.494180 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 with delete_type TABLET_DATA_DELETED (replaced by tablet e29473031c72482fad2969fd940d1571) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.495471 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b63b26856f794ef6abd6c07660a63664" } modify_external_catalogs: true
I20260811 06:16:49.495599 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (DEFAULT_TABLE table=default.Table_6401c9c79a224ae58509e8d8cf313d0a [id=f4e741c74f0a430cb9b21deec24831fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.495709 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b63b26856f794ef6abd6c07660a63664" } modify_external_catalogs: true
I20260811 06:16:49.496080 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7246e1f0cdb049c6855b8bdbd42936f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.496814 11361 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.498847 11361 ts_tablet_manager.cc:1397] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.046s user 0.012s sys 0.004s
I20260811 06:16:49.499599 11365 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.499810 11365 ts_tablet_manager.cc:1397] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.014s
I20260811 06:16:49.500991 11365 raft_consensus.cc:348] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.501269 11365 raft_consensus.cc:374] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.501423 11365 raft_consensus.cc:729] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.501886 11365 consensus_queue.cc:260] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.504480 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d8cc9675043642d78621843c4e0c7600" } modify_external_catalogs: true
I20260811 06:16:49.504931 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d8cc9675043642d78621843c4e0c7600" } modify_external_catalogs: true
I20260811 06:16:49.505645 11365 ts_tablet_manager.cc:1428] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:16:49.507782 11361 raft_consensus.cc:348] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.508347 11361 raft_consensus.cc:374] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.508533 11365 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.508550 11361 raft_consensus.cc:729] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.508265 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bf629c6c917c4c6fbbd8fceed0452997" } modify_external_catalogs: true
I20260811 06:16:49.509413 11361 consensus_queue.cc:260] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.509546 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bf629c6c917c4c6fbbd8fceed0452997" } modify_external_catalogs: true
I20260811 06:16:49.510118 11361 ts_tablet_manager.cc:1428] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:16:49.506528 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 0bbf657cb27f4da9a4f595242864163a (DEFAULT_TABLE table=default.Table_b51f2e988c1941248eaf6280965ee906 [id=e3f87a09fef5439a9dbc3d579d073d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.510885 11361 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.511811 11365 tablet_bootstrap.cc:654] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.514812 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 (DEFAULT_TABLE table=default.Table_4118842221c9462f8bc4cad981c9d859 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.520162 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_64c34f7955a74a59ac3a81ca903e25f3" } modify_external_catalogs: true
I20260811 06:16:49.520841 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_64c34f7955a74a59ac3a81ca903e25f3" } modify_external_catalogs: true
W20260811 06:16:49.521821 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16674be53bd54f9395b650e19edd3cf4 consensus state has no leader
I20260811 06:16:49.522096 11361 tablet_bootstrap.cc:654] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.522564 11365 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.522862 11365 ts_tablet_manager.cc:1397] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.007s
I20260811 06:16:49.524657 11103 tablet_service.cc:1467] Processing CreateTablet for tablet ae1e42440ff14857b297621ca6031835 (DEFAULT_TABLE table=default.Table_f01adcdde391454abf2f768c080313c1 [id=23ec4328fe004a8ab2e8cff534a30e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.525656 11117 tablet_service.cc:1467] Processing CreateTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 (DEFAULT_TABLE table=default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.525964 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 681736b44af04718b800d503ca645c1a (DEFAULT_TABLE table=default.Table_6fe2d394a0cd40908c7e8c378458a6d2 [id=2590d2d487344033b794724044194981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.526759 11109 tablet_service.cc:1467] Processing CreateTablet for tablet cdb93dcd940a47e78c5458041c768e36 (DEFAULT_TABLE table=default.Table_889fe834de014fd8add63e0a4fec5334 [id=16a23a037e8c4fb8946fd77eb4629e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.524040 11365 raft_consensus.cc:348] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.527391 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.527535 11365 raft_consensus.cc:374] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.527715 11365 raft_consensus.cc:729] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.528012 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bc7fcb33853948a0a54b9ba93cbe2f53 (table default.Table_fc6c3d54d9c04ab0ad9278dd8e534505 [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
I20260811 06:16:49.528146 11365 consensus_queue.cc:260] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.528412 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.528733 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 818859f61e754a75baf8804939864fd7 (table default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]) successfully deleted
I20260811 06:16:49.528759 11161 raft_consensus.cc:2454] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:49.529274 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.529253 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.529796 11163 raft_consensus.cc:2379] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:16:49.529871 11159 raft_consensus.cc:2454] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:49.530913 11370 tablet_replica.cc:330] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:16:49.531116 10564 leader_election.cc:341] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 818859f61e754a75baf8804939864fd7
I20260811 06:16:49.531675 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bbf657cb27f4da9a4f595242864163a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.531813 10564 leader_election.cc:302] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.532343 10564 leader_election.cc:302] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.532949 11386 raft_consensus.cc:2781] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.533084 11386 raft_consensus.cc:482] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.533306 11386 raft_consensus.cc:3037] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.533566 11365 ts_tablet_manager.cc:1428] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.011s user 0.000s sys 0.004s
I20260811 06:16:49.536949 11365 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:49.537487 11386 raft_consensus.cc:504] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.538146 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c3bbf1e004579a4d0be809f83ca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.538741 11386 leader_election.cc:288] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.539788 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1e42440ff14857b297621ca6031835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.540135 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb93dcd940a47e78c5458041c768e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.541306 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (DEFAULT_TABLE table=default.Table_6401c9c79a224ae58509e8d8cf313d0a [id=f4e741c74f0a430cb9b21deec24831fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.541877 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7246e1f0cdb049c6855b8bdbd42936f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.541920 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39dfcd1a66b4241bc6f5c38e930f048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.542670 11365 tablet_bootstrap.cc:654] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.545701 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681736b44af04718b800d503ca645c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.553309 11386 raft_consensus.cc:2781] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.554152 11386 raft_consensus.cc:482] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 06:16:49.557288 10810 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 54932.2us
I20260811 06:16:49.431777 10918 raft_consensus.cc:2454] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:49.569873 11479 raft_consensus.cc:482] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:49.573390 10886 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.669s user 0.006s sys 0.005s
I20260811 06:16:49.570187 11479 raft_consensus.cc:504] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:49.575460 11479 leader_election.cc:288] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:49.576849 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0bbf657cb27f4da9a4f595242864163a consensus state has no leader
I20260811 06:16:49.579098 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_cf999672f4d34be0baa2e667bc984941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.579941 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf999672f4d34be0baa2e667bc984941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.582552 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 9c5fa9633057485b917f117819d79398
W20260811 06:16:49.583396 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d24d909b82640a386b612fba1f38fac has no consensus state
I20260811 06:16:49.583830 11361 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.584038 11361 ts_tablet_manager.cc:1397] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.074s user 0.006s sys 0.001s
I20260811 06:16:49.584180 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 67f458dba9444bfa8841a84cdb798588
I20260811 06:16:49.585326 11361 raft_consensus.cc:348] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.585618 11361 raft_consensus.cc:374] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.585942 11361 raft_consensus.cc:729] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.586267 11361 consensus_queue.cc:260] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.587560 11361 ts_tablet_manager.cc:1428] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:49.588650 11511 raft_consensus.cc:482] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.589975 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_412dd522d392407980cd5633bfba2091"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.590732 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_412dd522d392407980cd5633bfba2091 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.590719 11047 leader_election.cc:302] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:49.587987 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 (DEFAULT_TABLE table=default.Table_4118842221c9462f8bc4cad981c9d859 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.593494 10328 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet e29473031c72482fad2969fd940d1571
I20260811 06:16:49.596488 11530 raft_consensus.cc:482] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.597052 11530 raft_consensus.cc:504] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.599907 11378 leader_election.cc:288] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.590150 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (DEFAULT_TABLE table=default.Table_6401c9c79a224ae58509e8d8cf313d0a [id=f4e741c74f0a430cb9b21deec24831fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.604030 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.604173 11368 ts_tablet_manager.cc:1918] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:49.604380 11368 log.cc:1196] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/937a7467093a414882c34a3958af1deb
I20260811 06:16:49.604357 10923 raft_consensus.cc:2454] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:49.604910 11047 leader_election.cc:302] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.606904 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c3bbf1e004579a4d0be809f83ca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.531275 11370 raft_consensus.cc:2229] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.608587 11530 leader_election.cc:288] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.608628 11479 raft_consensus.cc:2684] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260811 06:16:49.609422 10886 tablet_service.cc:1467] Processing CreateTablet for tablet ae1e42440ff14857b297621ca6031835 (DEFAULT_TABLE table=default.Table_f01adcdde391454abf2f768c080313c1 [id=23ec4328fe004a8ab2e8cff534a30e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.611238 11479 raft_consensus.cc:2781] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.611403 11479 raft_consensus.cc:482] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.613157 11361 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.613293 11479 raft_consensus.cc:3037] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.613852 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c4f425aa214a7a9e8a029389d59a04" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:49.614384 10916 raft_consensus.cc:3037] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:49.615734 11545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:16:49.616973 11517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:49.618968 11361 tablet_bootstrap.cc:654] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.627516 11442 server_base.cc:1034] running on GCE node
I20260811 06:16:49.631630 11527 raft_consensus.cc:2781] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.635571 11479 raft_consensus.cc:504] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.636616 11370 raft_consensus.cc:2258] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.636904 11479 leader_election.cc:288] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.638417 11370 ts_tablet_manager.cc:1905] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.648804 11370 ts_tablet_manager.cc:1918] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.649365 11370 log.cc:1196] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/577207be9523447c95f752e6861a3baf
I20260811 06:16:49.645223 11527 raft_consensus.cc:482] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.648804 10872 tablet_service.cc:1467] Processing CreateTablet for tablet cdb93dcd940a47e78c5458041c768e36 (DEFAULT_TABLE table=default.Table_889fe834de014fd8add63e0a4fec5334 [id=16a23a037e8c4fb8946fd77eb4629e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.650259 11370 ts_tablet_manager.cc:1939] T 577207be9523447c95f752e6861a3baf P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.650285 11361 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.650629 11361 ts_tablet_manager.cc:1397] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
W20260811 06:16:49.650954 10810 leader_election.cc:341] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 818859f61e754a75baf8804939864fd7
I20260811 06:16:49.651497 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 0bbf657cb27f4da9a4f595242864163a (DEFAULT_TABLE table=default.Table_b51f2e988c1941248eaf6280965ee906 [id=e3f87a09fef5439a9dbc3d579d073d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.651917 11361 raft_consensus.cc:348] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.652220 11370 tablet_replica.cc:330] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.652357 11361 raft_consensus.cc:374] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.652308 10855 tablet_service.cc:1467] Processing CreateTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 (DEFAULT_TABLE table=default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.652477 11361 raft_consensus.cc:729] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.652534 11370 raft_consensus.cc:2229] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.652849 11361 consensus_queue.cc:260] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.652870 11511 raft_consensus.cc:504] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:49.652575 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 47459.9us
I20260811 06:16:49.653560 11370 raft_consensus.cc:2258] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.653982 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.654562 11370 ts_tablet_manager.cc:1905] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.654757 11361 ts_tablet_manager.cc:1428] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260811 06:16:49.655170 11361 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.649530 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 681736b44af04718b800d503ca645c1a (DEFAULT_TABLE table=default.Table_6fe2d394a0cd40908c7e8c378458a6d2 [id=2590d2d487344033b794724044194981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.656687 10810 leader_election.cc:302] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:49.660362 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.661919 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7246e1f0cdb049c6855b8bdbd42936f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:49.661856 10307 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 89840.4us
I20260811 06:16:49.664096 11386 raft_consensus.cc:3037] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.665444 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.668298 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.668630 11361 tablet_bootstrap.cc:654] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.670593 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.667423 11378 raft_consensus.cc:2726] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:49.672245 11511 leader_election.cc:288] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.672341 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.674190 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 577207be9523447c95f752e6861a3baf (table default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]) successfully deleted
W20260811 06:16:49.674615 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ee0f6ba0c08149f981fe27c5d40346cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee0f6ba0c08149f981fe27c5d40346cc already in progress: creating tablet
W20260811 06:16:49.674909 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5d0530ec053f47df800cf2abf549b068 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d0530ec053f47df800cf2abf549b068 already in progress: creating tablet
W20260811 06:16:49.675237 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet cb854704951e4a399267766fb5be40e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb854704951e4a399267766fb5be40e2 already in progress: creating tablet
W20260811 06:16:49.675482 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet cd7390a2221f4a1b9948c8a1353e4a49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd7390a2221f4a1b9948c8a1353e4a49 already in progress: creating tablet
I20260811 06:16:49.675740 11527 raft_consensus.cc:3037] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.676072 11371 ts_tablet_manager.cc:1905] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.676430 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:49.677232 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 98976.7us
I20260811 06:16:49.680202 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb93dcd940a47e78c5458041c768e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.681432 10918 raft_consensus.cc:2454] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:49.682054 10813 leader_election.cc:341] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 577207be9523447c95f752e6861a3baf
I20260811 06:16:49.682435 11047 leader_election.cc:302] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.682251 11370 ts_tablet_manager.cc:1918] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.683281 11539 raft_consensus.cc:482] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.684254 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:49.684618 10923 raft_consensus.cc:3037] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.685422 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bbf657cb27f4da9a4f595242864163a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.687089 11546 raft_consensus.cc:2781] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.687378 11546 raft_consensus.cc:482] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.687832 11546 raft_consensus.cc:3037] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.690001 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39dfcd1a66b4241bc6f5c38e930f048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.689059 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 (DEFAULT_TABLE table=default.Table_4118842221c9462f8bc4cad981c9d859 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.691013 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 0bbf657cb27f4da9a4f595242864163a (DEFAULT_TABLE table=default.Table_b51f2e988c1941248eaf6280965ee906 [id=e3f87a09fef5439a9dbc3d579d073d62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.692140 10626 tablet_service.cc:1467] Processing CreateTablet for tablet ae1e42440ff14857b297621ca6031835 (DEFAULT_TABLE table=default.Table_f01adcdde391454abf2f768c080313c1 [id=23ec4328fe004a8ab2e8cff534a30e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.690805 11539 raft_consensus.cc:504] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.693425 11546 raft_consensus.cc:504] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.693933 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.694612 11361 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.695043 11546 leader_election.cc:288] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.695088 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864c3bbf1e004579a4d0be809f83ca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.695165 11361 ts_tablet_manager.cc:1397] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
I20260811 06:16:49.697855 11361 raft_consensus.cc:348] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.698246 11361 raft_consensus.cc:374] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.698814 11361 raft_consensus.cc:729] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.699092 11361 consensus_queue.cc:260] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.699848 11361 ts_tablet_manager.cc:1428] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 06:16:49.695251 11370 log.cc:1196] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/34c4f425aa214a7a9e8a029389d59a04
I20260811 06:16:49.700162 11368 ts_tablet_manager.cc:1939] T 937a7467093a414882c34a3958af1deb P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:49.700557 11370 ts_tablet_manager.cc:1939] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.701042 11361 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.705507 11370 tablet_replica.cc:330] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.706017 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681736b44af04718b800d503ca645c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.705886 11370 raft_consensus.cc:2229] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.706300 11370 raft_consensus.cc:2258] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.706025 11368 tablet_replica.cc:330] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:49.709431 11370 ts_tablet_manager.cc:1905] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.710345 11361 tablet_bootstrap.cc:654] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:49.701433 10810 leader_election.cc:341] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 577207be9523447c95f752e6861a3baf
I20260811 06:16:49.713224 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 34c4f425aa214a7a9e8a029389d59a04 (table default.Table_e29856ff2b0e4fae84c701e646151d4b [id=d41d2864aded430783e667b5f3a87e84]) successfully deleted
I20260811 06:16:49.714090 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:49.714491 11511 raft_consensus.cc:482] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.714682 11511 raft_consensus.cc:504] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.718007 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:49.718506 11163 raft_consensus.cc:2454] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:49.718957 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 937a7467093a414882c34a3958af1deb (table default.Table_02fc64f6fff6403bba126deaa2a74ffe [id=72559661450c4fd7b7459b56611f41e8]) successfully deleted
I20260811 06:16:49.720219 10634 tablet_service.cc:1467] Processing CreateTablet for tablet cdb93dcd940a47e78c5458041c768e36 (DEFAULT_TABLE table=default.Table_889fe834de014fd8add63e0a4fec5334 [id=16a23a037e8c4fb8946fd77eb4629e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.720734 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 681736b44af04718b800d503ca645c1a (DEFAULT_TABLE table=default.Table_6fe2d394a0cd40908c7e8c378458a6d2 [id=2590d2d487344033b794724044194981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.720826 11370 ts_tablet_manager.cc:1918] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.721117 10629 tablet_service.cc:1467] Processing CreateTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 (DEFAULT_TABLE table=default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:49.721359 11534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:16:49.721271 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_795a58b37e3a43e4b20318a4b44fa3e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.722384 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_795a58b37e3a43e4b20318a4b44fa3e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.724665 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6ae50c6bd40447b191f2b98dc7c35552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.726122 11442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:16:49.725466 11370 log.cc:1196] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bbbaa377ea524e57ab23d73928d70775
W20260811 06:16:49.727356 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae50c6bd40447b191f2b98dc7c35552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.742964 11365 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:49.743330 11365 ts_tablet_manager.cc:1397] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.206s user 0.033s sys 0.059s
I20260811 06:16:49.744064 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d1d83013125d4639944453abb28be339"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.744755 11546 raft_consensus.cc:482] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.745019 11546 raft_consensus.cc:504] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.745381 11365 raft_consensus.cc:348] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.745679 11365 raft_consensus.cc:374] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.746146 11546 leader_election.cc:288] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:49.746290 11365 raft_consensus.cc:729] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:16:49.746884 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1d83013125d4639944453abb28be339 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.746678 11365 consensus_queue.cc:260] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.748212 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c4f425aa214a7a9e8a029389d59a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.748607 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet bbbaa377ea524e57ab23d73928d70775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.748785 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet bf1a831788df4431b32c07c1e18b2c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.748256 11370 ts_tablet_manager.cc:1939] T bbbaa377ea524e57ab23d73928d70775 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:49.748802 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e83ccea892504992b1e3339408fb4cd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.749248 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f996348e4ca94119a8fe9d98abe1cb11" } new_table_name: "default.Table_c49eaa773a9b406c97a485419779c804" modify_external_catalogs: true
W20260811 06:16:49.749624 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e83ccea892504992b1e3339408fb4cd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.751030 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_95a321ec44e440debe3917e0853e2b65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.751717 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95a321ec44e440debe3917e0853e2b65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.753106 11442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:16:49.754106 11361 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.754411 11361 ts_tablet_manager.cc:1397] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.005s
I20260811 06:16:49.754683 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0089417971bb4740ae9d280e00967549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.755347 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0089417971bb4740ae9d280e00967549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.755699 11361 raft_consensus.cc:348] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.756049 11361 raft_consensus.cc:374] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.756173 11361 raft_consensus.cc:729] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.756528 11361 consensus_queue.cc:260] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.759145 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:49.760113 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_eb85295bb9934680a6da7f1cc38fea21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.760830 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb85295bb9934680a6da7f1cc38fea21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.762588 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1e42440ff14857b297621ca6031835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.763135 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6401c9c79a224ae58509e8d8cf313d0a" } new_table_name: "default.Table_a519b5dc9dc84a9cbabbb5e5eedff2dd" modify_external_catalogs: true
I20260811 06:16:49.763753 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bbf657cb27f4da9a4f595242864163a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.763784 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.764482 11361 ts_tablet_manager.cc:1428] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260811 06:16:49.764622 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.764760 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 22cac1c339574b1fa26555b18811539b
I20260811 06:16:49.759435 11539 leader_election.cc:288] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.766963 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.767527 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e13ac4cebe1a4159afc5c09e66f266b0" } new_table_name: "default.Table_5176a922b48f4f5696b177bc0f0b266d" modify_external_catalogs: true
I20260811 06:16:49.767635 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.767953 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.769562 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.770298 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39dfcd1a66b4241bc6f5c38e930f048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.773581 10619 tablet_service.cc:1467] Processing CreateTablet for tablet dc6254bf781740019c3f71b26179f25d (DEFAULT_TABLE table=default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.774422 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 7368c0252cf84fe6831dc07eb173a7d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d24d909b82640a386b612fba1f38fac) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.775664 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb93dcd940a47e78c5458041c768e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.776762 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6254bf781740019c3f71b26179f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.777416 11442 hybrid_clock.cc:648] HybridClock initialized: now 1786429009777115 us; error 172 us; skew 500 ppm
I20260811 06:16:49.778007 11442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:16:49.780387 11361 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.781527 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681736b44af04718b800d503ca645c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.778563 11370 tablet_replica.cc:330] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:49.785033 11370 raft_consensus.cc:2229] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.787930 10620 tablet_service.cc:1467] Processing CreateTablet for tablet b0d203f652b24b4897e62fc8c03d32df (DEFAULT_TABLE table=default.Table_8041eb9d4b2f475ca05f2a96278befd8 [id=90300626ac5742358dc29caf32dc323d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.790129 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.790831 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (DEFAULT_TABLE table=default.Table_919cbb1f6a0e4d029dd90ae72e326608 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.793102 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bbbaa377ea524e57ab23d73928d70775 (table default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]) successfully deleted
I20260811 06:16:49.793084 10616 tablet_service.cc:1467] Processing CreateTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc (DEFAULT_TABLE table=default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.794088 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d203f652b24b4897e62fc8c03d32df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.796442 11361 tablet_bootstrap.cc:654] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.790947 11362 ts_tablet_manager.cc:1428] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.439s user 0.007s sys 0.003s
W20260811 06:16:49.799816 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b4eb7864cc742929ac1756949b6bec5 consensus state has no leader
W20260811 06:16:49.800444 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5b681f10c3de4bd798b9d519f10da103 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b681f10c3de4bd798b9d519f10da103 already in progress: creating tablet
I20260811 06:16:49.800702 11370 raft_consensus.cc:2258] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.805992 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2bdb349406a46629e6c307e1ebfd9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.807861 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:49.809288 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e721083b8b2428bbea6b9e87a4a6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.810322 11361 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.810227 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 22cac1c339574b1fa26555b18811539b (DEFAULT_TABLE table=default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.810371 11106 tablet_service.cc:1467] Processing CreateTablet for tablet dc6254bf781740019c3f71b26179f25d (DEFAULT_TABLE table=default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.810557 11361 ts_tablet_manager.cc:1397] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.005s
I20260811 06:16:49.810914 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cac1c339574b1fa26555b18811539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.810925 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6254bf781740019c3f71b26179f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.811748 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 9d24d909b82640a386b612fba1f38fac (DEFAULT_TABLE table=default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.812063 11361 raft_consensus.cc:348] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.812391 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d24d909b82640a386b612fba1f38fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.812386 11361 raft_consensus.cc:374] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.812716 11361 raft_consensus.cc:729] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:16:49.817677 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7246e1f0cdb049c6855b8bdbd42936f6 consensus state has no leader
I20260811 06:16:49.813210 11361 consensus_queue.cc:260] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:49.824296 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 240239us
I20260811 06:16:49.826917 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:49.827419 10664 raft_consensus.cc:2379] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:16:49.828883 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc53fcee3ed5480f85804f29c94c13f8" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:49.829267 10664 raft_consensus.cc:2379] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
W20260811 06:16:49.830472 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 714247a11705421b9c012d99bdbf3d04 consensus state has no leader
I20260811 06:16:49.830770 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:49.831169 10665 raft_consensus.cc:2379] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:16:49.831454 11361 ts_tablet_manager.cc:1428] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.021s user 0.000s sys 0.004s
I20260811 06:16:49.832290 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:49.832544 10665 raft_consensus.cc:3037] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.835253 11361 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.836344 10665 raft_consensus.cc:2454] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:49.837052 11378 consensus_queue.cc:1035] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.142s
I20260811 06:16:49.844339 11361 tablet_bootstrap.cc:654] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:49.845616 11371 ts_tablet_manager.cc:1918] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:49.846081 10871 tablet_service.cc:1467] Processing CreateTablet for tablet dc6254bf781740019c3f71b26179f25d (DEFAULT_TABLE table=default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.849560 11371 log.cc:1196] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:49.849891 11442 webserver.cc:460] Webserver started at http://127.9.203.125:45215/ using document root <none> and password file <none>
I20260811 06:16:49.849978 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (DEFAULT_TABLE table=default.Table_919cbb1f6a0e4d029dd90ae72e326608 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.851188 11442 fs_manager.cc:359] Metadata directory not provided
I20260811 06:16:49.851384 11442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:16:49.852975 11371 ts_tablet_manager.cc:1939] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.854879 11371 tablet_replica.cc:330] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.855729 10322 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_c49eaa773a9b406c97a485419779c804 [id=8444a45079b34969a38481a4b00c1352]). Expected version 4 got 0
I20260811 06:16:49.856282 11371 raft_consensus.cc:2229] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.860282 10322 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_c49eaa773a9b406c97a485419779c804 [id=8444a45079b34969a38481a4b00c1352]). Expected version 4 got 0
I20260811 06:16:49.861650 11371 raft_consensus.cc:2258] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.862812 11371 ts_tablet_manager.cc:1905] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.864921 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8c02798e56e74a03b0a45aa15d15d200" } new_table_name: "default.Table_4139f5fbebcd4a32973c454aaaa079f5" modify_external_catalogs: true
I20260811 06:16:49.864903 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1e42440ff14857b297621ca6031835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.866076 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_88237316c36548428404ae24db07eee6" } modify_external_catalogs: true
I20260811 06:16:49.866361 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1ea175c323534584b69d9595c09821d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.868156 11546 raft_consensus.cc:482] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.868395 11546 raft_consensus.cc:504] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.869158 11546 leader_election.cc:288] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:49.869632 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_44e6a24dad8848d5838d7d8f351a2b37" } new_table_name: "default.Table_dd5a9f221bf94e10a6b32d763d44281b" modify_external_catalogs: true
I20260811 06:16:49.871062 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_88237316c36548428404ae24db07eee6" } modify_external_catalogs: true
W20260811 06:16:49.874238 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fbdda840466420f8d67a8cb5868ba03 consensus state has no leader
I20260811 06:16:49.875233 10916 raft_consensus.cc:2454] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:49.875614 10918 raft_consensus.cc:3037] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.877046 11511 leader_election.cc:288] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:49.877288 10813 leader_election.cc:302] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:16:49.877560 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ea175c323534584b69d9595c09821d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.877787 10810 leader_election.cc:302] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:49.878471 11511 raft_consensus.cc:2726] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:16:49.879208 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 186256us
I20260811 06:16:49.880405 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:49.881419 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.882220 11371 ts_tablet_manager.cc:1918] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:49.882339 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97b348d30dc44fa383a27d9097c2e598 consensus state has no leader
I20260811 06:16:49.882949 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:49.883325 11371 log.cc:1196] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bbbaa377ea524e57ab23d73928d70775
I20260811 06:16:49.883841 11371 ts_tablet_manager.cc:1939] T bbbaa377ea524e57ab23d73928d70775 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:49.883841 10881 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48778 (request call id 72) took 1148 ms. Trace:
I20260811 06:16:49.886579 11371 tablet_replica.cc:330] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:49.888185 11371 raft_consensus.cc:2229] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:49.889096 11371 raft_consensus.cc:2258] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:49.889465 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e721083b8b2428bbea6b9e87a4a6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.894212 11361 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:49.898610 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (DEFAULT_TABLE table=default.Table_919cbb1f6a0e4d029dd90ae72e326608 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.899222 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e721083b8b2428bbea6b9e87a4a6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.899665 11370 ts_tablet_manager.cc:1905] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:49.890347 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 9d24d909b82640a386b612fba1f38fac (DEFAULT_TABLE table=default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.894511 11361 ts_tablet_manager.cc:1397] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.004s
I20260811 06:16:49.908751 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_412dd522d392407980cd5633bfba2091" } modify_external_catalogs: true
I20260811 06:16:49.909094 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_412dd522d392407980cd5633bfba2091" } modify_external_catalogs: true
I20260811 06:16:49.909403 11539 raft_consensus.cc:482] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:49.910627 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5158afff0daf485d8ebd8e03934c96b9" } modify_external_catalogs: true
I20260811 06:16:49.910972 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5158afff0daf485d8ebd8e03934c96b9" } modify_external_catalogs: true
I20260811 06:16:49.911365 11361 raft_consensus.cc:348] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.911783 11361 raft_consensus.cc:374] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:49.911944 11361 raft_consensus.cc:729] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:49.912261 11361 consensus_queue.cc:260] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:49.914199 11442 fs_manager.cc:709] Time spent opening directory manager: real 0.033s user 0.009s sys 0.005s
W20260811 06:16:49.920302 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 169463us
I20260811 06:16:49.921274 11047 leader_election.cc:302] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:49.921466 10865 tablet_service.cc:1514] Processing DeleteTablet for tablet c4b809805d1e43128b5b18f558002036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:47 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.922286 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 (DEFAULT_TABLE table=default.Table_8c02798e56e74a03b0a45aa15d15d200 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:49.921648 11047 raft_consensus.cc:2670] T 34c4f425aa214a7a9e8a029389d59a04 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:49.922897 11361 ts_tablet_manager.cc:1428] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260811 06:16:49.924036 11109 tablet_service.cc:1467] Processing CreateTablet for tablet b0d203f652b24b4897e62fc8c03d32df (DEFAULT_TABLE table=default.Table_8041eb9d4b2f475ca05f2a96278befd8 [id=90300626ac5742358dc29caf32dc323d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.924501 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d203f652b24b4897e62fc8c03d32df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.885071 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 22cac1c339574b1fa26555b18811539b (DEFAULT_TABLE table=default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.927882 11046 leader_election.cc:302] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:49.928200 10923 raft_consensus.cc:2454] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:49.928444 11546 raft_consensus.cc:3037] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.928591 10882 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48778 (request call id 69) took 1129 ms. Trace:
I20260811 06:16:49.928732 10882 rpcz_store.cc:276] 0811 06:16:48.734835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.736486 (+ 1651us) service_pool.cc:227] Handling call
0811 06:16:48.760246 (+ 23760us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:48.760265 (+ 19us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:49.647255 (+886990us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:49.864048 (+216793us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:49.864207 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:49.929975 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 (DEFAULT_TABLE table=default.Table_169104a730344ae6b72202968cfdc9dc [id=0f621f2014f34e6a9de177f2843c8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.934757 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_86b99ada84ec46e1973bf3fec95b2a1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.935527 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b99ada84ec46e1973bf3fec95b2a1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.935997 10867 tablet_service.cc:1467] Processing CreateTablet for tablet b0d203f652b24b4897e62fc8c03d32df (DEFAULT_TABLE table=default.Table_8041eb9d4b2f475ca05f2a96278befd8 [id=90300626ac5742358dc29caf32dc323d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.929518 10882 tablet_service.cc:1467] Processing CreateTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 (DEFAULT_TABLE table=default.Table_959c1a8bfd794c13b012f7ce1d150c7e [id=41effa9bdd8c47bca930b230e16c6091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.939173 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.939777 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:49.941286 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:49.943172 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:16:49.946053 11574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:16:49.949409 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 97b348d30dc44fa383a27d9097c2e598 (DEFAULT_TABLE table=default.Table_44e6a24dad8848d5838d7d8f351a2b37 [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.950115 11511 raft_consensus.cc:2781] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:49.950352 11511 raft_consensus.cc:482] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:49.950624 11511 raft_consensus.cc:3037] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:49.953076 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57144ad37b874c91a89a25665a85eeb2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.952560 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.955524 11442 fs_manager.cc:725] Time spent opening block manager: real 0.033s user 0.002s sys 0.009s
I20260811 06:16:49.949159 10864 tablet_service.cc:1467] Processing CreateTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc (DEFAULT_TABLE table=default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.959029 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_41e1f2dfdfa04338a8cecda87d649f86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:49.959810 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41e1f2dfdfa04338a8cecda87d649f86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:49.960346 11362 ts_tablet_manager.cc:1460] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Tablet startup took 523ms
I20260811 06:16:49.960704 11361 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:49.960978 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:49.961511 11046 leader_election.cc:302] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:49.961907 11479 raft_consensus.cc:2781] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:49.961550 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.962131 11479 raft_consensus.cc:686] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:49.958247 10858 tablet_service.cc:1467] Processing CreateTablet for tablet adc2d99019384c33840f16cbe98d336c (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.962709 11479 consensus_queue.cc:237] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.964192 11047 leader_election.cc:302] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:49.964459 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c94c766b75e749a7bf08f8b110567bf6" } modify_external_catalogs: true
I20260811 06:16:49.964798 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c94c766b75e749a7bf08f8b110567bf6" } modify_external_catalogs: true
I20260811 06:16:49.964957 11530 raft_consensus.cc:2781] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 06:16:49.965147 11047 leader_election.cc:341] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:49.965698 11047 leader_election.cc:341] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:49.966255 11546 raft_consensus.cc:2726] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:49.969733 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0d2536cbb5f54439a910d4be40e09f1b" } modify_external_catalogs: true
I20260811 06:16:49.970176 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0d2536cbb5f54439a910d4be40e09f1b" } modify_external_catalogs: true
I20260811 06:16:49.963624 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 58fdb5920003438d983987ff242f6dce (DEFAULT_TABLE table=default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.973850 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:49.956549 11442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
uuid: "a36d6d06a0cb4489b5014178b9973219"
format_stamp: "Formatted at 2026-08-11 06:16:42 on dist-test-slave-cvwc"
I20260811 06:16:49.978145 10913 raft_consensus.cc:2379] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:49.978212 11442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:16:49.979628 10881 rpcz_store.cc:276] 0811 06:16:48.735280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.735631 (+ 351us) service_pool.cc:227] Handling call
0811 06:16:48.761381 (+ 25750us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:48.761402 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:49.639151 (+877749us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:49.883556 (+244405us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:49.883713 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:49.967056 11527 raft_consensus.cc:504] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:49.982061 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 22cac1c339574b1fa26555b18811539b (DEFAULT_TABLE table=default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.982900 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cac1c339574b1fa26555b18811539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:49.987072 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 107bf6921c6e40f2a337dccc302c8856 (DEFAULT_TABLE table=default.Table_3602836ee9884ec38d9454df8b4e628c [id=8ad2fe8115be403b861c940320695d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.987880 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f88af70bbada49309a0e7cc7c333d6f0
I20260811 06:16:49.989029 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:49.992090 10918 raft_consensus.cc:2454] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:49.992798 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 6c706bf0455341a0a953d937f9778b5f (DEFAULT_TABLE table=default.Table_95a321ec44e440debe3917e0853e2b65 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:49.981763 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.996112 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:16:49.956806 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:49.997670 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 97b348d30dc44fa383a27d9097c2e598 (DEFAULT_TABLE table=default.Table_44e6a24dad8848d5838d7d8f351a2b37 [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.000087 10555 leader_election.cc:302] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:49.996760 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.001708 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818859f61e754a75baf8804939864fd7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.002055 10922 raft_consensus.cc:2454] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:50.004130 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6254bf781740019c3f71b26179f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.004421 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d24d909b82640a386b612fba1f38fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.004573 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3dc6f5f6b1234867a8f80ab8e9fb1362"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:49.996714 11109 tablet_service.cc:1467] Processing CreateTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc (DEFAULT_TABLE table=default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:50.005481 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dc6f5f6b1234867a8f80ab8e9fb1362 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.006067 11530 raft_consensus.cc:686] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.008991 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4139f5fbebcd4a32973c454aaaa079f5" } new_table_name: "default.Table_a8113f59c0e34eb5874fb236cd107426" modify_external_catalogs: true
I20260811 06:16:50.009030 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 9d24d909b82640a386b612fba1f38fac (DEFAULT_TABLE table=default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.009348 11530 consensus_queue.cc:237] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.010673 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_88b42a43d2824f1387ba1ab9fae64f4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.011214 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88b42a43d2824f1387ba1ab9fae64f4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.012259 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 107bf6921c6e40f2a337dccc302c8856 (DEFAULT_TABLE table=default.Table_3602836ee9884ec38d9454df8b4e628c [id=8ad2fe8115be403b861c940320695d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.012595 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_913eb2559720417b833b2fa280d62c67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.013260 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_913eb2559720417b833b2fa280d62c67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.015897 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_02e6c8a000bc4169befaa6bac0d45b3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.016474 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02e6c8a000bc4169befaa6bac0d45b3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.018654 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2bdb349406a46629e6c307e1ebfd9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.020020 11105 tablet_service.cc:1467] Processing CreateTablet for tablet adc2d99019384c33840f16cbe98d336c (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.021206 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d24d909b82640a386b612fba1f38fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.021644 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2d99019384c33840f16cbe98d336c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.021466 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_86b99ada84ec46e1973bf3fec95b2a1a" } new_table_name: "default.Table_24fe968e43e1444082d37474c0da250f" modify_external_catalogs: true
I20260811 06:16:50.024574 11539 raft_consensus.cc:504] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.025454 11539 leader_election.cc:288] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.029871 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107bf6921c6e40f2a337dccc302c8856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.029742 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8931139cf95f4c04a45dd28370231a46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.030818 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8931139cf95f4c04a45dd28370231a46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.033557 10925 raft_consensus.cc:2379] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:50.034344 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 97b348d30dc44fa383a27d9097c2e598 (DEFAULT_TABLE table=default.Table_44e6a24dad8848d5838d7d8f351a2b37 [id=5324723ba4ac4631ac127ce6648b33a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:49.980803 11362 ts_tablet_manager.cc:1462] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Trace:
0811 06:16:47.873750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:47.873811 (+ 61us) service_pool.cc:227] Handling call
0811 06:16:47.874423 (+ 612us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:47.874457 (+ 34us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:47.879889 (+ 5432us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:47.883669 (+ 3780us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:47.883840 (+ 171us) inbound_call.cc:173] Queueing success response
0811 06:16:48.735026 (+851186us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0811 06:16:49.274943 (+539917us) ts_tablet_manager.cc:1429] Starting tablet replica
0811 06:16:49.370815 (+ 95872us) tablet_replica.cc:259] Starting instrumentation
0811 06:16:49.378825 (+ 8010us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":44937,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"tablet-open.queue_time_us":851237,"thread_start_us":315590,"threads_started":1}
I20260811 06:16:50.035069 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97b348d30dc44fa383a27d9097c2e598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.035588 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.035514 11386 raft_consensus.cc:504] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.035930 10664 raft_consensus.cc:2362] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1. Re-sending same reply.
I20260811 06:16:50.036055 10665 raft_consensus.cc:2379] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:16:50.037407 11386 leader_election.cc:288] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.039855 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 (DEFAULT_TABLE table=default.Table_8c02798e56e74a03b0a45aa15d15d200 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.040349 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fbdda840466420f8d67a8cb5868ba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.041554 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 (DEFAULT_TABLE table=default.Table_169104a730344ae6b72202968cfdc9dc [id=0f621f2014f34e6a9de177f2843c8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.042309 11368 raft_consensus.cc:2229] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.042959 11368 raft_consensus.cc:2258] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.047443 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cac1c339574b1fa26555b18811539b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.050441 10810 consensus_peers.cc:487] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:50.051776 11116 tablet_service.cc:1467] Processing CreateTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 (DEFAULT_TABLE table=default.Table_959c1a8bfd794c13b012f7ce1d150c7e [id=41effa9bdd8c47bca930b230e16c6091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.052243 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d668bcfbeff54181ba3b4407b1eb5704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.051807 10610 tablet_service.cc:1467] Processing CreateTablet for tablet adc2d99019384c33840f16cbe98d336c (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.056833 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c42b5ef0fc84627908200331f53b1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.058228 10607 tablet_service.cc:1467] Processing CreateTablet for tablet 58fdb5920003438d983987ff242f6dce (DEFAULT_TABLE table=default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.059068 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58fdb5920003438d983987ff242f6dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.051489 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 (DEFAULT_TABLE table=default.Table_169104a730344ae6b72202968cfdc9dc [id=0f621f2014f34e6a9de177f2843c8180]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.060889 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 (DEFAULT_TABLE table=default.Table_8c02798e56e74a03b0a45aa15d15d200 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.061905 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 6c706bf0455341a0a953d937f9778b5f (DEFAULT_TABLE table=default.Table_95a321ec44e440debe3917e0853e2b65 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.062595 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.064088 10608 tablet_service.cc:1467] Processing CreateTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 (DEFAULT_TABLE table=default.Table_959c1a8bfd794c13b012f7ce1d150c7e [id=41effa9bdd8c47bca930b230e16c6091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.054183 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 107bf6921c6e40f2a337dccc302c8856 (DEFAULT_TABLE table=default.Table_3602836ee9884ec38d9454df8b4e628c [id=8ad2fe8115be403b861c940320695d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.067111 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:50.070695 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 171589us
I20260811 06:16:50.075796 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ff1ad74f2034ed9b24c9712bae14cd3 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:50.052031 10555 raft_consensus.cc:2670] T a3e6bf8789594a91a1a35e6c750a0ddd P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:50.076987 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c42b5ef0fc84627908200331f53b1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.078140 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_169104a730344ae6b72202968cfdc9dc" } new_table_name: "default.Table_41fd7b3230944f5395bc21e68b708026" modify_external_catalogs: true
I20260811 06:16:50.078893 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_959c1a8bfd794c13b012f7ce1d150c7e" } new_table_name: "default.Table_16798efef90c476e88ece60ceda20557" modify_external_catalogs: true
W20260811 06:16:50.079172 10813 leader_election.cc:341] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: bbbaa377ea524e57ab23d73928d70775
I20260811 06:16:50.080245 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_081e5e9b7dd24fc5a0723450c844edf2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.080993 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_081e5e9b7dd24fc5a0723450c844edf2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:50.082363 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fbdda840466420f8d67a8cb5868ba03 consensus state has no leader
W20260811 06:16:50.084209 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 84142.2us
I20260811 06:16:50.084388 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.086948 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_92530abb51c3445489f381a0d398b1aa" } new_table_name: "default.Table_59bc917bf1c440c6a607b0727ef3a8ff" modify_external_catalogs: true
I20260811 06:16:50.087586 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fbdda840466420f8d67a8cb5868ba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.087643 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 58fdb5920003438d983987ff242f6dce (DEFAULT_TABLE table=default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.088640 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_21f0b9c149d7498e8ba846e4f3adb056" } modify_external_catalogs: true
I20260811 06:16:50.088868 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fbdda840466420f8d67a8cb5868ba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.088897 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_21f0b9c149d7498e8ba846e4f3adb056" } modify_external_catalogs: true
I20260811 06:16:50.089790 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58fdb5920003438d983987ff242f6dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.090801 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_11e3880a5ec345918edbff9a7a5b5af0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.091483 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e3880a5ec345918edbff9a7a5b5af0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:50.094766 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 79258.7us
I20260811 06:16:50.060498 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.060681 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57144ad37b874c91a89a25665a85eeb2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.096858 10663 raft_consensus.cc:2454] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:50.097952 11046 leader_election.cc:341] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.098184 11046 leader_election.cc:302] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.098718 11046 leader_election.cc:302] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.099970 10555 leader_election.cc:302] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.100968 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d203f652b24b4897e62fc8c03d32df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.101862 11546 raft_consensus.cc:2726] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:50.102120 11546 raft_consensus.cc:2781] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.102227 11546 raft_consensus.cc:482] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.102305 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 37e73b8798b2455baf642abc532a5d8c (DEFAULT_TABLE table=default.Table_d1d83013125d4639944453abb28be339 [id=4bc106defb5246f6b2ceed8c51ba1516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.102456 11546 raft_consensus.cc:3037] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.104004 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 285b85c854bf400295b288314947840e (DEFAULT_TABLE table=default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.104764 11539 raft_consensus.cc:482] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.105033 11539 raft_consensus.cc:504] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.106374 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97b348d30dc44fa383a27d9097c2e598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.106842 11362 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:50.107074 11546 raft_consensus.cc:504] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.108503 10626 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (DEFAULT_TABLE table=default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.109663 11546 leader_election.cc:288] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:50.110769 11365 ts_tablet_manager.cc:1428] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.247s user 0.011s sys 0.018s
I20260811 06:16:50.114475 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e73b8798b2455baf642abc532a5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.115629 11527 leader_election.cc:288] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.124047 11539 leader_election.cc:288] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.125962 11365 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:50.129637 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c42b5ef0fc84627908200331f53b1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.130409 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57144ad37b874c91a89a25665a85eeb2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.130663 10663 raft_consensus.cc:3037] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.134442 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107bf6921c6e40f2a337dccc302c8856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.137008 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:50.137817 10555 raft_consensus.cc:2670] T 818859f61e754a75baf8804939864fd7 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:50.139187 11527 consensus_queue.cc:1035] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260811 06:16:50.140376 11368 ts_tablet_manager.cc:1905] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.143555 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:50.144143 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57144ad37b874c91a89a25665a85eeb2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:50.144382 10629 tablet_service.cc:1467] Processing CreateTablet for tablet eca9ef015de946548a39e661d0ce3fa9 (DEFAULT_TABLE table=default.Table_ccb9de8c002144dda1c7faff8b803de8 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.145267 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97b348d30dc44fa383a27d9097c2e598. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.145612 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c42b5ef0fc84627908200331f53b1a3 consensus state has no leader
I20260811 06:16:50.151727 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285b85c854bf400295b288314947840e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.151789 11119 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (DEFAULT_TABLE table=default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.152289 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.147825 10810 leader_election.cc:341] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: bbbaa377ea524e57ab23d73928d70775
I20260811 06:16:50.157755 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac8c5daeb3249e38d863ee94f1267b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.157754 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
W20260811 06:16:50.158167 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 34c4f425aa214a7a9e8a029389d59a04 because the tablet was not found. No further retry: Not found: Tablet not found: 34c4f425aa214a7a9e8a029389d59a04
I20260811 06:16:50.158457 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bbbaa377ea524e57ab23d73928d70775 (table default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]) successfully deleted
I20260811 06:16:50.159092 11371 ts_tablet_manager.cc:1905] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.164976 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2d99019384c33840f16cbe98d336c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.165405 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58fdb5920003438d983987ff242f6dce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.166257 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 52197.5us
I20260811 06:16:50.166626 11361 tablet_bootstrap.cc:654] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.166883 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:50.170133 11047 leader_election.cc:341] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.170451 11546 raft_consensus.cc:482] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.171916 11546 raft_consensus.cc:504] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.172565 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac8c5daeb3249e38d863ee94f1267b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.173369 10810 leader_election.cc:302] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.173477 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.174389 11546 leader_election.cc:288] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.177788 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 37e73b8798b2455baf642abc532a5d8c (DEFAULT_TABLE table=default.Table_d1d83013125d4639944453abb28be339 [id=4bc106defb5246f6b2ceed8c51ba1516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.178870 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e73b8798b2455baf642abc532a5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.180069 10619 tablet_service.cc:1467] Processing CreateTablet for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (DEFAULT_TABLE table=default.Table_cf999672f4d34be0baa2e667bc984941 [id=e71c294d8ecb4cb7bba2b41a2153c8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.184906 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc2d99019384c33840f16cbe98d336c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.185950 10662 raft_consensus.cc:2454] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:50.188823 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.189601 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 285b85c854bf400295b288314947840e (DEFAULT_TABLE table=default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.190039 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107bf6921c6e40f2a337dccc302c8856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.187656 11511 raft_consensus.cc:504] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.191617 11046 leader_election.cc:302] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:50.192085 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.192809 10915 raft_consensus.cc:2379] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:16:50.194139 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 285b85c854bf400295b288314947840e (DEFAULT_TABLE table=default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.195293 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.195570 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.199128 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3dc6f5f6b1234867a8f80ab8e9fb1362" } modify_external_catalogs: true
I20260811 06:16:50.199514 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3dc6f5f6b1234867a8f80ab8e9fb1362" } modify_external_catalogs: true
I20260811 06:16:50.199949 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d5687a6765814d33beccc599bc6876f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.200686 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5687a6765814d33beccc599bc6876f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.201238 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_536e393707744871ad51373ed03d8ae8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.193506 10810 raft_consensus.cc:2670] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260811 06:16:50.201810 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_536e393707744871ad51373ed03d8ae8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:50.201987 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 111723us
I20260811 06:16:50.202026 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:50.202626 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d668bcfbeff54181ba3b4407b1eb5704 consensus state has no leader
I20260811 06:16:50.203178 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_29feb2450eea49108943aac8a6045185"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:50.204566 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2bdb349406a46629e6c307e1ebfd9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.204741 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 006d3214480c47babe390496b335de70 (DEFAULT_TABLE table=default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:50.205147 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea4eb7f5db2e4e75818bfb228b64ed0d has no consensus state
W20260811 06:16:50.205761 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29feb2450eea49108943aac8a6045185 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.207211 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4f065771f7724a1fafa66eba960633cb" } modify_external_catalogs: true
I20260811 06:16:50.207521 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4f065771f7724a1fafa66eba960633cb" } modify_external_catalogs: true
I20260811 06:16:50.213044 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d668bcfbeff54181ba3b4407b1eb5704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.217453 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c706bf0455341a0a953d937f9778b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.218501 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_41fd7b3230944f5395bc21e68b708026" } modify_external_catalogs: true
I20260811 06:16:50.218801 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_41fd7b3230944f5395bc21e68b708026" } modify_external_catalogs: true
I20260811 06:16:50.225579 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d668bcfbeff54181ba3b4407b1eb5704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.193317 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (DEFAULT_TABLE table=default.Table_cf999672f4d34be0baa2e667bc984941 [id=e71c294d8ecb4cb7bba2b41a2153c8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.230710 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_795a58b37e3a43e4b20318a4b44fa3e4" } modify_external_catalogs: true
I20260811 06:16:50.231478 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.232059 10663 raft_consensus.cc:2454] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:50.232702 11046 leader_election.cc:302] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.231873 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 6c706bf0455341a0a953d937f9778b5f (DEFAULT_TABLE table=default.Table_95a321ec44e440debe3917e0853e2b65 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.234748 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c706bf0455341a0a953d937f9778b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.232141 11546 raft_consensus.cc:2781] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.236667 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_795a58b37e3a43e4b20318a4b44fa3e4" } modify_external_catalogs: true
I20260811 06:16:50.239461 11362 tablet_bootstrap.cc:654] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.241802 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.242230 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.242626 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.243636 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca9ef015de946548a39e661d0ce3fa9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.245615 10555 leader_election.cc:341] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:50.254418 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 69162.5us
W20260811 06:16:50.254935 10310 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 -> Peer a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327): Couldn't send request to peer a36d6d06a0cb4489b5014178b9973219. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 06:16:50.255357 11368 ts_tablet_manager.cc:1918] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.255723 11368 log.cc:1196] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bbbaa377ea524e57ab23d73928d70775
I20260811 06:16:50.256296 11368 ts_tablet_manager.cc:1939] T bbbaa377ea524e57ab23d73928d70775 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:50.259500 10614 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.259945 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 5322caea49aa4b648b74c7692d6e0372 (DEFAULT_TABLE table=default.Table_0089417971bb4740ae9d280e00967549 [id=ad586796183347dd8029b282665f9a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.260537 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.261965 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8123e24a8bbf4bd6a9344a83ca2163fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.262945 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 006d3214480c47babe390496b335de70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.264827 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5322caea49aa4b648b74c7692d6e0372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.267889 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 2875318863584e659e2b76ad2a72ca45 (DEFAULT_TABLE table=default.Table_eb85295bb9934680a6da7f1cc38fea21 [id=2f798d3676d5463da80a81e029017dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.271311 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_75563fd692aa4a26ac8eaed68d07945d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.272009 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75563fd692aa4a26ac8eaed68d07945d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.278054 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2875318863584e659e2b76ad2a72ca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.280107 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.280893 10663 raft_consensus.cc:2379] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:16:50.287084 11539 raft_consensus.cc:482] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.288654 11539 raft_consensus.cc:504] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.289528 11539 leader_election.cc:288] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.330335 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285b85c854bf400295b288314947840e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.256714 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 285b85c854bf400295b288314947840e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.256875 11511 leader_election.cc:288] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.280030 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.282135 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 37e73b8798b2455baf642abc532a5d8c (DEFAULT_TABLE table=default.Table_d1d83013125d4639944453abb28be339 [id=4bc106defb5246f6b2ceed8c51ba1516]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.288441 10871 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (DEFAULT_TABLE table=default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.289011 10879 tablet_service.cc:1467] Processing CreateTablet for tablet eca9ef015de946548a39e661d0ce3fa9 (DEFAULT_TABLE table=default.Table_ccb9de8c002144dda1c7faff8b803de8 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.293507 11527 consensus_queue.cc:1035] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 06:16:50.305575 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368c0252cf84fe6831dc07eb173a7d6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.318993 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (DEFAULT_TABLE table=default.Table_cf999672f4d34be0baa2e667bc984941 [id=e71c294d8ecb4cb7bba2b41a2153c8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.338722 11365 tablet_bootstrap.cc:654] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.327947 10865 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.329523 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:50.341995 11047 leader_election.cc:341] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.343400 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 2875318863584e659e2b76ad2a72ca45 (DEFAULT_TABLE table=default.Table_eb85295bb9934680a6da7f1cc38fea21 [id=2f798d3676d5463da80a81e029017dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.344676 11546 raft_consensus.cc:482] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.345041 11119 tablet_service.cc:1467] Processing CreateTablet for tablet eca9ef015de946548a39e661d0ce3fa9 (DEFAULT_TABLE table=default.Table_ccb9de8c002144dda1c7faff8b803de8 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:50.345854 10555 leader_election.cc:341] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:50.346534 10555 leader_election.cc:341] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:50.350401 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 146858us
I20260811 06:16:50.344889 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 006d3214480c47babe390496b335de70 (DEFAULT_TABLE table=default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.356215 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8123e24a8bbf4bd6a9344a83ca2163fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.356633 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2875318863584e659e2b76ad2a72ca45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.359349 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet ee0f6ba0c08149f981fe27c5d40346cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.366514 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 83) took 1386 ms. Trace:
I20260811 06:16:50.366956 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca9ef015de946548a39e661d0ce3fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.367259 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e73b8798b2455baf642abc532a5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.374042 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.375466 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 5322caea49aa4b648b74c7692d6e0372 (DEFAULT_TABLE table=default.Table_0089417971bb4740ae9d280e00967549 [id=ad586796183347dd8029b282665f9a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.376467 11371 ts_tablet_manager.cc:1918] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.376549 11546 raft_consensus.cc:3037] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.377134 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ac8c5daeb3249e38d863ee94f1267b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.377674 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.380420 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:50.382375 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.382422 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.382691 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.383404 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c706bf0455341a0a953d937f9778b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.384416 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 2875318863584e659e2b76ad2a72ca45 (DEFAULT_TABLE table=default.Table_eb85295bb9934680a6da7f1cc38fea21 [id=2f798d3676d5463da80a81e029017dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.385052 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 006d3214480c47babe390496b335de70 (DEFAULT_TABLE table=default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.385548 11161 raft_consensus.cc:3037] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.387223 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 006d3214480c47babe390496b335de70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.389636 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca9ef015de946548a39e661d0ce3fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.366856 11368 rpcz_store.cc:276] 0811 06:16:48.966261 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.968298 (+ 2037us) service_pool.cc:227] Handling call
0811 06:16:49.704375 (+736077us) ts_tablet_manager.cc:1145] Deleting tablet bbbaa377ea524e57ab23d73928d70775
0811 06:16:49.704385 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.042643 (+338258us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x6150000940a4. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f194748504d 00007f19487295ec 00007f194b0b82e6 00007f194b0ea404 00007f194b0cb870 00007f194b0cb5fd 00000000009edb7c 00007f193bf8f344 00007f193bf9291b 00007f193bf92798
0811 06:16:50.206159 (+163516us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.255215 (+ 49056us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.353041 (+ 97826us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":631549184,"tablet-delete.queue_time_us":730700}
W20260811 06:16:50.393352 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7d45b7d1994a40cc83d2ce0d6de5a249 (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7d45b7d1994a40cc83d2ce0d6de5a249 consensus state has no leader
I20260811 06:16:50.393947 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bbbaa377ea524e57ab23d73928d70775 (table default.Table_ea082d040262438eaf58a7135960e338 [id=9faa566913284916bcd1a34de78ec26d]) successfully deleted
I20260811 06:16:50.391789 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 5322caea49aa4b648b74c7692d6e0372 (DEFAULT_TABLE table=default.Table_0089417971bb4740ae9d280e00967549 [id=ad586796183347dd8029b282665f9a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.398845 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8123e24a8bbf4bd6a9344a83ca2163fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.402160 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5322caea49aa4b648b74c7692d6e0372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.422379 11368 tablet_replica.cc:330] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:50.395396 11582 raft_consensus.cc:2781] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.426802 10330 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 459a4df4399c4e948fdfc91d3ee4364f
I20260811 06:16:50.427471 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f108c0e6821b45039886e052f9f9dba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.428031 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c5efe8eb16e84575abd18a5079aad2c9 consensus state has no leader
W20260811 06:16:50.428172 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f108c0e6821b45039886e052f9f9dba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.428539 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ed0d878c78764cc6870d654cf10c1e80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:50.423132 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2875318863584e659e2b76ad2a72ca45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.429250 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed0d878c78764cc6870d654cf10c1e80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.430178 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0089417971bb4740ae9d280e00967549" } new_table_name: "default.Table_2d00d7a0119d41f1b1d393a5e9b884cd" modify_external_catalogs: true
I20260811 06:16:50.430820 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_91a2a9c15d324a14af5161c4cd05fb24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.431437 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91a2a9c15d324a14af5161c4cd05fb24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.432983 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_dcb5c77404034038a23416b22f0fff3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.433531 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcb5c77404034038a23416b22f0fff3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.378371 11539 raft_consensus.cc:482] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.435335 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.435737 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.438957 11368 raft_consensus.cc:2229] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.441159 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.444274 11361 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:50.444821 11361 ts_tablet_manager.cc:1397] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.517s user 0.022s sys 0.012s
I20260811 06:16:50.451709 10627 tablet_service.cc:1467] Processing CreateTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d (DEFAULT_TABLE table=default.Table_24fe968e43e1444082d37474c0da250f [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.455938 11368 raft_consensus.cc:2258] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.457451 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 006d3214480c47babe390496b335de70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.468803 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet f88af70bbada49309a0e7cc7c333d6f0 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.468931 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_913eb2559720417b833b2fa280d62c67" } new_table_name: "default.Table_114dbf96c3564c16a7998bc190cb2d35" modify_external_catalogs: true
I20260811 06:16:50.469538 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet fe5eea681072477ab52a822d721629cf from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.470572 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c49eaa773a9b406c97a485419779c804" } new_table_name: "default.Table_4227de75e23646f2a53a023b660c907f" modify_external_catalogs: true
I20260811 06:16:50.470932 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 937a7467093a414882c34a3958af1deb from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.471735 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_16a7feffa91f405e9d4c28e60d193045" } new_table_name: "default.Table_a64d6f4bab3143d38f8607e0bcd63898" modify_external_catalogs: true
I20260811 06:16:50.473459 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_615fc66df6ed4c148a1fc40f406cbb31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.474135 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_615fc66df6ed4c148a1fc40f406cbb31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:50.476106 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5322caea49aa4b648b74c7692d6e0372 consensus state has no leader
I20260811 06:16:50.482326 11539 raft_consensus.cc:504] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.489646 10866 tablet_service.cc:1467] Processing CreateTablet for tablet d6063a34ee55495584ed5623215a130f (DEFAULT_TABLE table=default.Table_1ea175c323534584b69d9595c09821d7 [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:50.491434 11583 log.cc:924] Time spent T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.054s user 0.000s sys 0.001s
I20260811 06:16:50.492178 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:50.494933 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.494971 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8b12e80bc54e58a63d45bde8faac89 (DEFAULT_TABLE table=default.Table_41e1f2dfdfa04338a8cecda87d649f86 [id=06b4ac61ca8a41f788cc0949b6991ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.503293 11530 raft_consensus.cc:482] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.496148 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5322caea49aa4b648b74c7692d6e0372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.503590 11530 raft_consensus.cc:504] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.498654 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 7db813cbb8f74b329015b163ebd58c00 (DEFAULT_TABLE table=default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.505151 11368 ts_tablet_manager.cc:1905] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.509959 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.514442 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e00a80287d844b2eb51fe2cea5882336"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.515596 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e00a80287d844b2eb51fe2cea5882336 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.518517 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6063a34ee55495584ed5623215a130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.518414 10608 tablet_service.cc:1467] Processing CreateTablet for tablet d6063a34ee55495584ed5623215a130f (DEFAULT_TABLE table=default.Table_1ea175c323534584b69d9595c09821d7 [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.519523 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 7db813cbb8f74b329015b163ebd58c00 (DEFAULT_TABLE table=default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.520081 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8b12e80bc54e58a63d45bde8faac89 (DEFAULT_TABLE table=default.Table_41e1f2dfdfa04338a8cecda87d649f86 [id=06b4ac61ca8a41f788cc0949b6991ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.520507 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea4eb7f5db2e4e75818bfb228b64ed0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:50.521485 10555 leader_election.cc:341] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.521731 11479 raft_consensus.cc:482] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.466658 11582 raft_consensus.cc:686] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.523118 10662 raft_consensus.cc:2454] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:50.523046 11479 raft_consensus.cc:504] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.523797 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6063a34ee55495584ed5623215a130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.524181 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8b12e80bc54e58a63d45bde8faac89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.525434 11371 log.cc:1196] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bf1a831788df4431b32c07c1e18b2c4a
I20260811 06:16:50.525451 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf1a831788df4431b32c07c1e18b2c4a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:50.528301 11530 leader_election.cc:288] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.525151 11539 leader_election.cc:288] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:50.536034 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7368c0252cf84fe6831dc07eb173a7d6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:50.536453 10564 leader_election.cc:302] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.536751 11365 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:16:50.536712 10564 raft_consensus.cc:2670] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:50.537021 11046 leader_election.cc:302] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:50.537492 11109 tablet_service.cc:1467] Processing CreateTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d (DEFAULT_TABLE table=default.Table_24fe968e43e1444082d37474c0da250f [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.538051 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea4eb7f5db2e4e75818bfb228b64ed0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.542884 11479 leader_election.cc:288] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.543114 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db813cbb8f74b329015b163ebd58c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.543494 11161 raft_consensus.cc:2454] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:50.537200 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:50.542186 11361 raft_consensus.cc:348] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.532236 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:50.546772 11365 ts_tablet_manager.cc:1397] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.426s user 0.002s sys 0.012s
I20260811 06:16:50.547070 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8b12e80bc54e58a63d45bde8faac89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.547328 11530 raft_consensus.cc:2781] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.548023 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 7db813cbb8f74b329015b163ebd58c00 (DEFAULT_TABLE table=default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.523074 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:50.549432 11530 raft_consensus.cc:482] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.549643 11530 raft_consensus.cc:3037] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.549551 11365 raft_consensus.cc:348] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.549818 11362 tablet_bootstrap.cc:492] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:50.550386 11365 raft_consensus.cc:374] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.550504 11365 raft_consensus.cc:729] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.550691 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db813cbb8f74b329015b163ebd58c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.551244 11365 consensus_queue.cc:260] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.551935 11365 ts_tablet_manager.cc:1428] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260811 06:16:50.552953 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.527323 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714247a11705421b9c012d99bdbf3d04" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:50.554726 11371 ts_tablet_manager.cc:1939] T bf1a831788df4431b32c07c1e18b2c4a P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:50.557505 10663 raft_consensus.cc:2454] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:50.546670 11157 raft_consensus.cc:2454] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:50.558583 11046 leader_election.cc:302] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:50.558930 11156 raft_consensus.cc:2379] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:16:50.559089 11479 raft_consensus.cc:2781] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.559636 11479 raft_consensus.cc:482] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.559811 11479 raft_consensus.cc:3037] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.543231 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4b809805d1e43128b5b18f558002036" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:50.563264 11365 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:50.563119 11546 raft_consensus.cc:504] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.564023 10858 tablet_service.cc:1467] Processing CreateTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d (DEFAULT_TABLE table=default.Table_24fe968e43e1444082d37474c0da250f [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.564666 11546 leader_election.cc:288] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.565217 11155 raft_consensus.cc:2379] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:50.565522 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.547566 11582 consensus_queue.cc:237] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.566679 10813 leader_election.cc:302] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:50.567281 10663 raft_consensus.cc:3037] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.567469 11511 raft_consensus.cc:2781] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.573387 11362 ts_tablet_manager.cc:1397] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.525s user 0.006s sys 0.005s
I20260811 06:16:50.574725 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7db813cbb8f74b329015b163ebd58c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.575497 10663 raft_consensus.cc:2454] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:50.576252 11046 leader_election.cc:302] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:50.577951 11582 raft_consensus.cc:2781] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.583019 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 285b85c854bf400295b288314947840e
I20260811 06:16:50.584122 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 1c42b5ef0fc84627908200331f53b1a3
I20260811 06:16:50.585862 10324 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:50.586345 11582 raft_consensus.cc:686] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.586742 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 577207be9523447c95f752e6861a3baf from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.586949 11582 consensus_queue.cc:237] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.587541 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a4a46cec25944310a838d8323b119883
I20260811 06:16:50.588276 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:16:50.578006 11361 raft_consensus.cc:374] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.594931 11361 raft_consensus.cc:729] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.595440 11361 consensus_queue.cc:260] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.598639 11361 ts_tablet_manager.cc:1428] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.154s user 0.001s sys 0.003s
I20260811 06:16:50.599509 11361 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:50.601178 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.602468 10331 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:50.604101 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.605320 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.609993 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 with delete_type TABLET_DATA_DELETED (replaced by tablet e29473031c72482fad2969fd940d1571) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.610286 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.610872 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.611420 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:50.611732 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.611949 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.612032 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.612429 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.612880 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccb7050ea9f4cc2a1b924814a204de5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:50.615206 11365 tablet_bootstrap.cc:654] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.616219 11362 raft_consensus.cc:348] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.616600 11362 raft_consensus.cc:374] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.616835 11362 raft_consensus.cc:729] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.617141 11362 consensus_queue.cc:260] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.617956 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea4eb7f5db2e4e75818bfb228b64ed0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.623936 11371 tablet_replica.cc:330] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:50.619279 11602 tablet.cc:1722] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:16:50.631937 11371 raft_consensus.cc:2229] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.632481 11371 raft_consensus.cc:2258] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.633401 11371 ts_tablet_manager.cc:1905] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.642475 11530 raft_consensus.cc:504] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.643061 11153 raft_consensus.cc:2379] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
W20260811 06:16:50.643046 11047 leader_election.cc:341] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:50.643724 11047 leader_election.cc:341] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.644236 11530 leader_election.cc:288] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.645102 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.645191 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee0f6ba0c08149f981fe27c5d40346cc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:16:50.644511 11047 leader_election.cc:341] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.645992 10662 raft_consensus.cc:3037] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:50.646116 11047 leader_election.cc:341] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.645763 11511 raft_consensus.cc:686] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:50.646536 11511 consensus_queue.cc:237] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.647786 11479 raft_consensus.cc:504] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.648871 11479 leader_election.cc:288] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.649799 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:16:50.650573 11046 leader_election.cc:341] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:50.654121 11118 tablet_service.cc:1467] Processing CreateTablet for tablet d6063a34ee55495584ed5623215a130f (DEFAULT_TABLE table=default.Table_1ea175c323534584b69d9595c09821d7 [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.654760 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6063a34ee55495584ed5623215a130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.580154 11370 ts_tablet_manager.cc:1918] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.656986 11370 log.cc:1196] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:50.657371 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.656900 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 8b8b12e80bc54e58a63d45bde8faac89 (DEFAULT_TABLE table=default.Table_41e1f2dfdfa04338a8cecda87d649f86 [id=06b4ac61ca8a41f788cc0949b6991ce2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.658254 10662 raft_consensus.cc:2454] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:50.660895 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.660341 11365 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:50.662040 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b8b12e80bc54e58a63d45bde8faac89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.662115 11046 leader_election.cc:302] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.662484 11365 ts_tablet_manager.cc:1397] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.005s
I20260811 06:16:50.663920 11365 raft_consensus.cc:348] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.664271 11365 raft_consensus.cc:374] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.664502 11365 raft_consensus.cc:729] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.664887 11365 consensus_queue.cc:260] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.665041 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3ae91f4b99784386b61c6b22b804b906" } modify_external_catalogs: true
I20260811 06:16:50.665445 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3ae91f4b99784386b61c6b22b804b906" } modify_external_catalogs: true
I20260811 06:16:50.669279 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6fe2d394a0cd40908c7e8c378458a6d2" } new_table_name: "default.Table_ecbfc78f213d4d2f9efe02b95e85e6ef" modify_external_catalogs: true
I20260811 06:16:50.670487 11365 ts_tablet_manager.cc:1428] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260811 06:16:50.674923 11365 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:50.675293 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_bb432c883f1b4eae996f883c77495069"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.676252 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb432c883f1b4eae996f883c77495069 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.680189 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4cb530bc98f0491895f0802931cba06c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.680961 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cb530bc98f0491895f0802931cba06c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:50.679256 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 71982.6us
I20260811 06:16:50.681941 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8b262229dd4b26b862527d2e17cb27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:50.682185 10921 raft_consensus.cc:3037] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.684280 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bf1a831788df4431b32c07c1e18b2c4a (table default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]) successfully deleted
I20260811 06:16:50.687289 11442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:16:50.689056 11442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:16:50.689559 11442 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260811 06:16:50.693446 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52ecffcf4a0e46428caed6f7d72199bd has no consensus state
I20260811 06:16:50.694875 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_29660dc47bf14aeda6bf58332ba39430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.695623 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29660dc47bf14aeda6bf58332ba39430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.696483 11365 tablet_bootstrap.cc:654] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.696921 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet fe5eea681072477ab52a822d721629cf
I20260811 06:16:50.697373 10332 catalog_manager.cc:6565] ReplaceTablet: tablet fe5eea681072477ab52a822d721629cf deleted and replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e
W20260811 06:16:50.697921 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b4eb7864cc742929ac1756949b6bec5 consensus state has no leader
W20260811 06:16:50.698448 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16674be53bd54f9395b650e19edd3cf4 consensus state has no leader
I20260811 06:16:50.699162 11371 ts_tablet_manager.cc:1918] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.702040 11371 log.cc:1196] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ef8b262229dd4b26b862527d2e17cb27
I20260811 06:16:50.703042 11371 ts_tablet_manager.cc:1939] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:50.703935 11371 tablet_replica.cc:330] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:50.704387 11371 raft_consensus.cc:2229] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.705487 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.708016 11371 raft_consensus.cc:2258] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.712975 11371 ts_tablet_manager.cc:1905] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:50.714212 10564 leader_election.cc:341] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:50.714455 10564 leader_election.cc:302] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.715762 10564 leader_election.cc:302] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:50.716106 10564 raft_consensus.cc:2670] T ef8b262229dd4b26b862527d2e17cb27 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:50.716876 11362 ts_tablet_manager.cc:1428] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.130s user 0.001s sys 0.006s
I20260811 06:16:50.717501 10564 leader_election.cc:302] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.717685 11479 raft_consensus.cc:2781] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.718118 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.718357 11539 raft_consensus.cc:2726] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:50.718389 11479 raft_consensus.cc:686] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.718667 11539 raft_consensus.cc:2726] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:16:50.719969 11479 consensus_queue.cc:237] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.721180 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.721774 11530 raft_consensus.cc:482] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.722033 11530 raft_consensus.cc:504] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.723848 11530 leader_election.cc:288] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:50.726032 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbab2b67ef434ebebe7fe947e9c4ff66" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:50.728441 11047 leader_election.cc:341] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.734714 10564 leader_election.cc:302] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:50.742597 10307 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 53905us
I20260811 06:16:50.747489 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.747594 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:50.747856 11370 ts_tablet_manager.cc:1939] T 7368c0252cf84fe6831dc07eb173a7d6 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:50.748581 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:50.748562 10564 raft_consensus.cc:2670] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:50.748837 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 97) took 1255 ms. Trace:
I20260811 06:16:50.758430 11603 tablet.cc:1722] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:16:50.761526 10921 raft_consensus.cc:2454] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:50.762653 10564 leader_election.cc:302] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.763739 10564 leader_election.cc:302] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:50.763773 10318 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]). Expected version 1 got 0
I20260811 06:16:50.764058 11539 raft_consensus.cc:2726] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:50.764396 11362 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:50.748077 11602 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:48778 (request call id 70) took 2013 ms. Trace:
I20260811 06:16:50.766456 11365 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:50.766588 11047 leader_election.cc:302] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:50.767256 11530 raft_consensus.cc:2781] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.769815 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 7a00b0b51f574bfb843b65c0876ab4fc from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.757369 11370 rpcz_store.cc:276] 0811 06:16:49.493134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.493178 (+ 44us) service_pool.cc:227] Handling call
0811 06:16:49.770492 (+277314us) ts_tablet_manager.cc:1145] Deleting tablet 7368c0252cf84fe6831dc07eb173a7d6
0811 06:16:49.770736 (+ 244us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.234082 (+463346us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.579988 (+345906us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.748792 (+168804us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":277006}
I20260811 06:16:50.771513 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7368c0252cf84fe6831dc07eb173a7d6 (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]) successfully deleted
I20260811 06:16:50.772188 11635 raft_consensus.cc:2726] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:50.776381 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c2c7668245a4461ea61b06122149f946"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.777122 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2c7668245a4461ea61b06122149f946 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.778229 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbab2b67ef434ebebe7fe947e9c4ff66" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.778682 10665 raft_consensus.cc:2454] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:50.781236 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9acf8fc7ef294818b6d7ef52993c33ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.781991 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9acf8fc7ef294818b6d7ef52993c33ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.783478 11365 ts_tablet_manager.cc:1397] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.093s user 0.006s sys 0.009s
I20260811 06:16:50.784739 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9db3f79baf3a4a6caba9a984f0fa3866"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.785444 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9db3f79baf3a4a6caba9a984f0fa3866 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.786984 11365 raft_consensus.cc:348] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.787397 11370 tablet_replica.cc:330] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:50.787948 11370 raft_consensus.cc:2229] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.788439 11370 raft_consensus.cc:2258] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.788857 11530 raft_consensus.cc:686] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.777886 11637 tablet.cc:1722] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:16:50.803737 11365 raft_consensus.cc:374] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.804384 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a8fee33e3e334393a747f831b0ceb733"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:50.805065 11365 raft_consensus.cc:729] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:16:50.805401 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8fee33e3e334393a747f831b0ceb733 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.805958 11365 consensus_queue.cc:260] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.809248 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ef8b262229dd4b26b862527d2e17cb27 (table default.Table_a64d6f4bab3143d38f8607e0bcd63898 [id=2b421f86f2ea4c92a7b124bbf300a02e]) successfully deleted
W20260811 06:16:50.812405 10813 consensus_peers.cc:487] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:50.814509 11046 leader_election.cc:302] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.789242 11530 consensus_queue.cc:237] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:16:50.816993 11046 consensus_peers.cc:487] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf1a831788df4431b32c07c1e18b2c4a. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:50.817454 11365 ts_tablet_manager.cc:1428] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.032s user 0.003s sys 0.000s
I20260811 06:16:50.819625 11479 raft_consensus.cc:2781] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.821084 11365 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:50.821564 11479 raft_consensus.cc:482] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.796164 11602 rpcz_store.cc:276] 0811 06:16:48.734989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.735044 (+ 55us) service_pool.cc:227] Handling call
0811 06:16:50.747994 (+2012950us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:49.420922 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0811 06:16:49.600944 (+180022us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0811 06:16:49.600985 (+ 41us) alter_schema_op.cc:65] Acquired schema lock
0811 06:16:49.601021 (+ 36us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0811 06:16:49.604938 (+ 3917us) alter_schema_op.cc:126] START. Timestamp: 1786429009604733
0811 06:16:49.604946 (+ 8us) op_driver.cc:331] REPLICATION: starting
0811 06:16:49.616280 (+ 11334us) log.cc:842] Serialized 173 byte log entry
0811 06:16:50.456706 (+840426us) op_driver.cc:444] REPLICATION: finished
0811 06:16:50.593068 (+136362us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0811 06:16:50.628645 (+ 35577us) log.cc:842] Serialized 5 byte log entry
0811 06:16:50.736401 (+107756us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.747686 (+ 11285us) log.cc:842] Serialized 14 byte log entry
0811 06:16:50.747788 (+ 102us) alter_schema_op.cc:71] Released schema lock
0811 06:16:50.747862 (+ 74us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":136179,"prepare.queue_time_us":648568,"prepare.run_cpu_time_us":25570,"prepare.run_wall_time_us":441349,"replication_time_us":851685,"thread_start_us":1194012,"threads_started":3,"wal-append.queue_time_us":245240}]]}
I20260811 06:16:50.821877 11479 raft_consensus.cc:3037] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.822458 11602 tablet.cc:1722] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:16:50.823302 11365 tablet_bootstrap.cc:654] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.824537 11368 ts_tablet_manager.cc:1918] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.824747 11368 log.cc:1196] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/577207be9523447c95f752e6861a3baf
I20260811 06:16:50.825237 11368 ts_tablet_manager.cc:1939] T 577207be9523447c95f752e6861a3baf P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:50.825659 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 84) took 1828 ms. Trace:
I20260811 06:16:50.825891 11368 rpcz_store.cc:276] 0811 06:16:48.997573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.997681 (+ 108us) service_pool.cc:227] Handling call
0811 06:16:50.394449 (+1396768us) ts_tablet_manager.cc:1145] Deleting tablet 577207be9523447c95f752e6861a3baf
0811 06:16:50.394464 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.744375 (+349911us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.810787 (+ 66412us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.825620 (+ 14833us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1396450}
I20260811 06:16:50.826468 11368 tablet_replica.cc:330] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:50.826790 11368 raft_consensus.cc:2229] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.829250 11362 tablet_bootstrap.cc:654] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.831274 11368 raft_consensus.cc:2258] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.831712 11479 raft_consensus.cc:504] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.825145 11371 ts_tablet_manager.cc:1918] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.833487 11371 log.cc:1196] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c4b809805d1e43128b5b18f558002036
I20260811 06:16:50.834308 11371 ts_tablet_manager.cc:1939] T c4b809805d1e43128b5b18f558002036 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:50.834738 11368 ts_tablet_manager.cc:1905] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.838760 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 106) took 1084 ms. Trace:
I20260811 06:16:50.845216 11371 rpcz_store.cc:276] 0811 06:16:49.763019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.763109 (+ 90us) service_pool.cc:227] Handling call
0811 06:16:50.703870 (+940761us) ts_tablet_manager.cc:1145] Deleting tablet c4b809805d1e43128b5b18f558002036
0811 06:16:50.703882 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.763838 (+ 59956us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.825015 (+ 61177us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.838691 (+ 13676us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":939119}
I20260811 06:16:50.847174 11371 tablet_replica.cc:330] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:50.847489 11371 raft_consensus.cc:2229] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:50.847829 11371 raft_consensus.cc:2258] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:50.848559 11371 ts_tablet_manager.cc:1905] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.839846 11361 tablet_bootstrap.cc:654] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.843395 11641 tablet.cc:1722] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:16:50.861624 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbab2b67ef434ebebe7fe947e9c4ff66" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:16:50.862697 11047 leader_election.cc:341] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.864029 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbab2b67ef434ebebe7fe947e9c4ff66" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.864403 10665 raft_consensus.cc:3037] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.868161 10665 raft_consensus.cc:2454] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:50.868856 11046 leader_election.cc:302] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:50.870460 11530 raft_consensus.cc:2781] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:50.870764 11530 raft_consensus.cc:686] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:50.871114 11530 consensus_queue.cc:237] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.872406 11365 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:50.872707 11365 ts_tablet_manager.cc:1397] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20260811 06:16:50.874119 11365 raft_consensus.cc:348] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.874495 11365 raft_consensus.cc:374] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.874672 11365 raft_consensus.cc:729] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.875073 11370 ts_tablet_manager.cc:1905] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:50.875089 11365 consensus_queue.cc:260] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.876380 11365 ts_tablet_manager.cc:1428] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 06:16:50.876827 11365 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:50.880663 11582 raft_consensus.cc:482] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:50.880908 11582 raft_consensus.cc:504] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.881857 11582 leader_election.cc:288] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:50.883462 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:50.883778 10665 raft_consensus.cc:2454] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:50.884317 11046 leader_election.cc:302] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:50.884680 11582 raft_consensus.cc:2781] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:50.884917 11582 raft_consensus.cc:482] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:50.885039 11582 raft_consensus.cc:3037] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.890010 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:50.890836 11047 leader_election.cc:341] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.891052 11582 raft_consensus.cc:504] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:50.892321 11582 leader_election.cc:288] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:50.892766 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:50.893097 10665 raft_consensus.cc:3037] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:50.893173 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:16:50.894096 11047 leader_election.cc:341] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:50.898139 11479 leader_election.cc:288] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
W20260811 06:16:50.898793 10307 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 85252.8us
W20260811 06:16:50.898797 10309 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 81133.3us
I20260811 06:16:50.900185 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c4b809805d1e43128b5b18f558002036 (table default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]) successfully deleted
I20260811 06:16:50.902088 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 577207be9523447c95f752e6861a3baf (table default.Table_c377592be3df4bc8ae946bba086fa15a [id=99dc879670654c6cbe70f5eed55862ba]) successfully deleted
W20260811 06:16:50.903373 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 681736b44af04718b800d503ca645c1a consensus state has no leader
I20260811 06:16:50.904529 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a519b5dc9dc84a9cbabbb5e5eedff2dd" } new_table_name: "default.Table_90e19188370640aea2f976c2cd7ec2da" modify_external_catalogs: true
I20260811 06:16:50.906081 11362 tablet_bootstrap.cc:492] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:50.906445 11362 ts_tablet_manager.cc:1397] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.157s user 0.000s sys 0.009s
I20260811 06:16:50.913429 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (DEFAULT_TABLE table=default.Table_536e393707744871ad51373ed03d8ae8 [id=9ff629224da14068a65b686d658a40e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.914130 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d0f4cb9da96451ab351e1ad1aff7530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.916545 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_11e3880a5ec345918edbff9a7a5b5af0" } modify_external_catalogs: true
I20260811 06:16:50.916606 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_60f9ff39184a401d92a346f88abbd7e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:50.916991 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_11e3880a5ec345918edbff9a7a5b5af0" } modify_external_catalogs: true
W20260811 06:16:50.917433 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60f9ff39184a401d92a346f88abbd7e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.919872 10322 catalog_manager.cc:5495] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:16:50.920619 10322 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_5176a922b48f4f5696b177bc0f0b266d [id=a66e3380ba3d46ca93a6f98468b36cc3]). Expected version 3 got 0
I20260811 06:16:50.913599 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 52953438e7c248b1a758ee219405d7da (DEFAULT_TABLE table=default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.922175 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52953438e7c248b1a758ee219405d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.922190 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 6dee9af5a4504b8284c9150298ab3462 (DEFAULT_TABLE table=default.Table_29feb2450eea49108943aac8a6045185 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.926923 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 52953438e7c248b1a758ee219405d7da (DEFAULT_TABLE table=default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.927590 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 6119212ae4be4204852a5d9437dcee72 (DEFAULT_TABLE table=default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.927659 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52953438e7c248b1a758ee219405d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.928316 11109 tablet_service.cc:1467] Processing CreateTablet for tablet f12c8618198f4413b2727d04f850a10f (DEFAULT_TABLE table=default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.928853 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12c8618198f4413b2727d04f850a10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.932175 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119212ae4be4204852a5d9437dcee72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.927090 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dee9af5a4504b8284c9150298ab3462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.938495 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 (DEFAULT_TABLE table=default.Table_02e6c8a000bc4169befaa6bac0d45b3f [id=dd42ee7602454afc9b1a9de67c56b4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.939559 10337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_22da2514559b4b45ba484d557c75fb21" } modify_external_catalogs: true
I20260811 06:16:50.939814 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c4e76ecde14d0a86fedc84815e78a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.940032 10337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_22da2514559b4b45ba484d557c75fb21" } modify_external_catalogs: true
I20260811 06:16:50.931778 11362 raft_consensus.cc:348] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.942147 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9dd290af671e42d6a5d6545e9651028b" } modify_external_catalogs: true
I20260811 06:16:50.942382 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9dd290af671e42d6a5d6545e9651028b" } modify_external_catalogs: true
I20260811 06:16:50.944402 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_88b42a43d2824f1387ba1ab9fae64f4b" } modify_external_catalogs: true
I20260811 06:16:50.944691 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_88b42a43d2824f1387ba1ab9fae64f4b" } modify_external_catalogs: true
I20260811 06:16:50.947152 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 52953438e7c248b1a758ee219405d7da (DEFAULT_TABLE table=default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.949023 10619 tablet_service.cc:1467] Processing CreateTablet for tablet f4f14a0add084048b92a501476ad6588 (DEFAULT_TABLE table=default.Table_d5687a6765814d33beccc599bc6876f4 [id=7792bcddbdd44cad988860223ed4e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.949846 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (DEFAULT_TABLE table=default.Table_536e393707744871ad51373ed03d8ae8 [id=9ff629224da14068a65b686d658a40e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.950331 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 (DEFAULT_TABLE table=default.Table_02e6c8a000bc4169befaa6bac0d45b3f [id=dd42ee7602454afc9b1a9de67c56b4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.950932 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 6dee9af5a4504b8284c9150298ab3462 (DEFAULT_TABLE table=default.Table_29feb2450eea49108943aac8a6045185 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.954273 10324 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2] alter complete (version 1)
I20260811 06:16:50.955020 10324 master_service.cc:946] ReplaceTablet: received request to replace tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.955616 10324 master_service.cc:946] ReplaceTablet: received request to replace tablet adc2d99019384c33840f16cbe98d336c from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:50.959965 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7246e1f0cdb049c6855b8bdbd42936f6 consensus state has no leader
I20260811 06:16:50.960419 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet 9ac8c5daeb3249e38d863ee94f1267b1 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:50.960847 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 0bbf657cb27f4da9a4f595242864163a
I20260811 06:16:50.961462 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_24fe968e43e1444082d37474c0da250f" } new_table_name: "default.Table_77d905944afa4e60841edba6884de3a4" modify_external_catalogs: true
I20260811 06:16:50.962062 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:16:50.962610 10328 catalog_manager.cc:6565] ReplaceTablet: tablet 7a00b0b51f574bfb843b65c0876ab4fc deleted and replaced by tablet dd6584701c23406e83122bd2493b7972
I20260811 06:16:50.963092 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_114dbf96c3564c16a7998bc190cb2d35" } new_table_name: "default.Table_f43d88571e7e47fcb747e066587c6812" modify_external_catalogs: true
I20260811 06:16:50.963505 11365 tablet_bootstrap.cc:654] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:50.964859 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52953438e7c248b1a758ee219405d7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.968981 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5176a922b48f4f5696b177bc0f0b266d" } new_table_name: "default.Table_1668695b60f3456580d886578b815b54" modify_external_catalogs: true
I20260811 06:16:50.971215 10618 tablet_service.cc:1467] Processing CreateTablet for tablet f12c8618198f4413b2727d04f850a10f (DEFAULT_TABLE table=default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.972048 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 6119212ae4be4204852a5d9437dcee72 (DEFAULT_TABLE table=default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.972757 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 (DEFAULT_TABLE table=default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.974087 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.974382 11371 ts_tablet_manager.cc:1918] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:50.974638 11371 log.cc:1196] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ee0f6ba0c08149f981fe27c5d40346cc
I20260811 06:16:50.975257 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 (DEFAULT_TABLE table=default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.975520 11371 ts_tablet_manager.cc:1939] T ee0f6ba0c08149f981fe27c5d40346cc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:50.975735 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52543aa31a1749d1a0fd5e48cbe30889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.976284 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 58fdb5920003438d983987ff242f6dce
I20260811 06:16:50.976348 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 107) took 1211 ms. Trace:
I20260811 06:16:50.976570 11371 rpcz_store.cc:276] 0811 06:16:49.765367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.765486 (+ 119us) service_pool.cc:227] Handling call
0811 06:16:50.847000 (+1081514us) ts_tablet_manager.cc:1145] Deleting tablet ee0f6ba0c08149f981fe27c5d40346cc
0811 06:16:50.847015 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.895699 (+ 48684us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.953411 (+ 57712us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:50.976307 (+ 22896us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079888}
I20260811 06:16:50.977360 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d0f4cb9da96451ab351e1ad1aff7530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.977200 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3c3274039b55474a90dfb2f66912aff6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.978027 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c3274039b55474a90dfb2f66912aff6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.978087 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ee0f6ba0c08149f981fe27c5d40346cc (table default.Table_830bbd5a95fc4f45addf2c57b787c2d9 [id=257d5c1ee6aa4f1c8060822ef0fae341]) successfully deleted
I20260811 06:16:50.978868 11362 raft_consensus.cc:374] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:50.979068 11362 raft_consensus.cc:729] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:50.979168 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd (DEFAULT_TABLE table=default.Table_114dbf96c3564c16a7998bc190cb2d35 [id=6265dc35475144bd9f4b3348ed37447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.979635 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52ecffcf4a0e46428caed6f7d72199bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.979482 11362 consensus_queue.cc:260] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:50.980261 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 52953438e7c248b1a758ee219405d7da
I20260811 06:16:50.981294 11362 ts_tablet_manager.cc:1428] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.075s user 0.001s sys 0.003s
I20260811 06:16:50.981160 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_42136fc7f8704bc18984cc34a3514702"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:50.982107 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42136fc7f8704bc18984cc34a3514702 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:50.982126 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 6119212ae4be4204852a5d9437dcee72 (DEFAULT_TABLE table=default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.982653 10884 tablet_service.cc:1467] Processing CreateTablet for tablet f4f14a0add084048b92a501476ad6588 (DEFAULT_TABLE table=default.Table_d5687a6765814d33beccc599bc6876f4 [id=7792bcddbdd44cad988860223ed4e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.983789 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 (DEFAULT_TABLE table=default.Table_02e6c8a000bc4169befaa6bac0d45b3f [id=dd42ee7602454afc9b1a9de67c56b4a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.985258 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:50.984316 10882 tablet_service.cc:1467] Processing CreateTablet for tablet f12c8618198f4413b2727d04f850a10f (DEFAULT_TABLE table=default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.985689 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd (DEFAULT_TABLE table=default.Table_114dbf96c3564c16a7998bc190cb2d35 [id=6265dc35475144bd9f4b3348ed37447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:50.986212 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52ecffcf4a0e46428caed6f7d72199bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.986804 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.984143 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.987571 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.987726 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:50.987923 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f14a0add084048b92a501476ad6588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.990411 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52543aa31a1749d1a0fd5e48cbe30889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.991207 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12c8618198f4413b2727d04f850a10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.993050 11362 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:50.993358 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c4e76ecde14d0a86fedc84815e78a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.994112 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dee9af5a4504b8284c9150298ab3462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.995626 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119212ae4be4204852a5d9437dcee72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:50.997959 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12c8618198f4413b2727d04f850a10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.002624 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6119212ae4be4204852a5d9437dcee72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.004897 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c4e76ecde14d0a86fedc84815e78a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.005887 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.007990 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f14a0add084048b92a501476ad6588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.008807 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.013276 11371 tablet_replica.cc:330] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.015633 11371 raft_consensus.cc:2229] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.017099 11121 tablet_service.cc:1467] Processing CreateTablet for tablet f4f14a0add084048b92a501476ad6588 (DEFAULT_TABLE table=default.Table_d5687a6765814d33beccc599bc6876f4 [id=7792bcddbdd44cad988860223ed4e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.017257 11371 raft_consensus.cc:2258] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.017751 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4f14a0add084048b92a501476ad6588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.019142 11371 ts_tablet_manager.cc:1905] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.022053 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.022477 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:51.022720 11046 consensus_peers.cc:487] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4b809805d1e43128b5b18f558002036. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:51.025189 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.026523 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6119212ae4be4204852a5d9437dcee72
I20260811 06:16:51.027549 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet bc53fcee3ed5480f85804f29c94c13f8
W20260811 06:16:51.028359 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea4eb7f5db2e4e75818bfb228b64ed0d consensus state has no leader
I20260811 06:16:51.029063 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet adc2d99019384c33840f16cbe98d336c
I20260811 06:16:51.029888 10324 catalog_manager.cc:6565] ReplaceTablet: tablet adc2d99019384c33840f16cbe98d336c deleted and replaced by tablet 217f60a1ca044af38f9ee9093e021c27
I20260811 06:16:51.030516 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:16:51.031170 10321 catalog_manager.cc:6565] ReplaceTablet: tablet 9ac8c5daeb3249e38d863ee94f1267b1 deleted and replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e
W20260811 06:16:51.031939 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52ecffcf4a0e46428caed6f7d72199bd consensus state has no leader
I20260811 06:16:51.035336 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.035509 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.029906 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 (DEFAULT_TABLE table=default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.039187 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.041961 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.044881 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.046814 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.048389 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 6dee9af5a4504b8284c9150298ab3462 (DEFAULT_TABLE table=default.Table_29feb2450eea49108943aac8a6045185 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.049134 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd (DEFAULT_TABLE table=default.Table_114dbf96c3564c16a7998bc190cb2d35 [id=6265dc35475144bd9f4b3348ed37447a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.050510 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.052500 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.055150 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.054986 10665 raft_consensus.cc:2454] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:51.062651 11635 raft_consensus.cc:482] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.066699 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52543aa31a1749d1a0fd5e48cbe30889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.073292 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.073447 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.073930 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet c00b6bdfc8ac4b5db81de9f614fcf213 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.076242 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8b262229dd4b26b862527d2e17cb27 with delete_type TABLET_DATA_DELETED (replaced by tablet 16674be53bd54f9395b650e19edd3cf4) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.079888 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52ecffcf4a0e46428caed6f7d72199bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.081576 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.081815 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet bc53fcee3ed5480f85804f29c94c13f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.084102 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (DEFAULT_TABLE table=default.Table_536e393707744871ad51373ed03d8ae8 [id=9ff629224da14068a65b686d658a40e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.086957 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.063102 11635 raft_consensus.cc:504] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.092881 10665 raft_consensus.cc:1261] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Refusing update from remote peer 56a371f7ed104f68a5db9ca097eb237e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:16:51.093608 11365 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.095476 11365 ts_tablet_manager.cc:1397] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.009s
I20260811 06:16:51.095536 11635 leader_election.cc:288] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:51.100085 11153 raft_consensus.cc:1261] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Refusing update from remote peer 56a371f7ed104f68a5db9ca097eb237e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:16:51.104897 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2b0908c490b34de1b667987b39b6b8cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.105593 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b0908c490b34de1b667987b39b6b8cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.107167 11511 consensus_queue.cc:1035] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260811 06:16:51.112224 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_daa79a35a77f423793b799f850523035"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.112685 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_eb85295bb9934680a6da7f1cc38fea21" } new_table_name: "default.Table_3aeade8d5c694298954b38d3d3ed01bb" modify_external_catalogs: true
W20260811 06:16:51.113108 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa79a35a77f423793b799f850523035 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.110201 11365 raft_consensus.cc:348] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.113869 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_940e7658aef54574be7fd31c40f81ec2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.114758 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_940e7658aef54574be7fd31c40f81ec2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.115800 11365 raft_consensus.cc:374] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.115924 11365 raft_consensus.cc:729] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.116657 11362 tablet_bootstrap.cc:654] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.116678 11365 consensus_queue.cc:260] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.117542 11365 ts_tablet_manager.cc:1428] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260811 06:16:51.117929 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:51.119037 11365 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.122278 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ace7c736f5c144488e5dead2e48b82cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.123121 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ace7c736f5c144488e5dead2e48b82cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.124344 11046 leader_election.cc:302] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:51.125244 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0239afa9778a4851b82c1ed6655dc6dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.125814 11371 ts_tablet_manager.cc:1918] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:51.125994 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0239afa9778a4851b82c1ed6655dc6dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.126502 11371 log.cc:1196] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/4ccb7050ea9f4cc2a1b924814a204de5
I20260811 06:16:51.128289 11371 ts_tablet_manager.cc:1939] T 4ccb7050ea9f4cc2a1b924814a204de5 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.128772 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_fa6e7eb493bf4dbb86702a219a388acb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.129426 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa6e7eb493bf4dbb86702a219a388acb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.130967 11361 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:51.131290 10555 leader_election.cc:341] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.131995 11361 ts_tablet_manager.cc:1397] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.532s user 0.004s sys 0.008s
I20260811 06:16:51.133077 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dee9af5a4504b8284c9150298ab3462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.134042 11530 raft_consensus.cc:2781] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 06:16:51.135702 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 71366.3us
I20260811 06:16:51.136230 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:51.138461 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6e207ab6e5fb44668aa0245cedde4b40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.139330 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e207ab6e5fb44668aa0245cedde4b40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.138972 11365 tablet_bootstrap.cc:654] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.131727 11511 consensus_queue.cc:1035] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260811 06:16:51.143654 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d0f4cb9da96451ab351e1ad1aff7530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.144097 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 108) took 1376 ms. Trace:
W20260811 06:16:51.148263 11047 consensus_peers.cc:487] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:51.149956 11371 rpcz_store.cc:276] 0811 06:16:49.767089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.767444 (+ 355us) service_pool.cc:227] Handling call
0811 06:16:51.006598 (+1239154us) ts_tablet_manager.cc:1145] Deleting tablet 4ccb7050ea9f4cc2a1b924814a204de5
0811 06:16:51.006614 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.108725 (+102111us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.125603 (+ 16878us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.143892 (+ 18289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1238832}
I20260811 06:16:51.147048 11530 raft_consensus.cc:686] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:51.151407 11153 raft_consensus.cc:2454] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:51.151978 10564 leader_election.cc:302] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:51.160107 11635 raft_consensus.cc:2781] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:51.160223 11635 raft_consensus.cc:482] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:51.160326 11635 raft_consensus.cc:3037] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:51.162900 11361 raft_consensus.cc:348] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.163020 11635 raft_consensus.cc:504] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.164408 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:51.164690 11635 leader_election.cc:288] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:51.165213 10555 leader_election.cc:341] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.165232 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 4ccb7050ea9f4cc2a1b924814a204de5 (table default.Table_586d663235904c22bb85aeb30236801f [id=6e7fa977ab2a4b8e963cb21ebab03568]) successfully deleted
I20260811 06:16:51.167375 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ab7d7297b9254dd2b1ac985f3a308b74" } new_table_name: "default.Table_c8d20a5f7aac4067a814f33c43709f5f" modify_external_catalogs: true
I20260811 06:16:51.167798 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 110) took 1400 ms. Trace:
I20260811 06:16:51.170266 11371 rpcz_store.cc:276] 0811 06:16:49.767400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.767819 (+ 419us) service_pool.cc:227] Handling call
0811 06:16:51.165587 (+1397768us) ts_tablet_manager.cc:1145] Deleting tablet 67f458dba9444bfa8841a84cdb798588
0811 06:16:51.165603 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.167743 (+ 2140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1397515}
W20260811 06:16:51.171399 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 67f458dba9444bfa8841a84cdb798588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f458dba9444bfa8841a84cdb798588 already in progress: creating tablet
I20260811 06:16:51.171962 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 109) took 1404 ms. Trace:
I20260811 06:16:51.172073 11530 consensus_queue.cc:237] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.172585 11371 rpcz_store.cc:276] 0811 06:16:49.767257 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.768166 (+ 909us) service_pool.cc:227] Handling call
0811 06:16:51.171785 (+1403619us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:16:51.171796 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.171895 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1402083}
W20260811 06:16:51.173627 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9c5fa9633057485b917f117819d79398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c5fa9633057485b917f117819d79398 already in progress: creating tablet
I20260811 06:16:51.174383 11371 tablet_replica.cc:330] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.175740 11371 raft_consensus.cc:2229] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.176563 11371 raft_consensus.cc:2258] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.177531 11371 ts_tablet_manager.cc:1905] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.179232 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:51.182369 10337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ed0d878c78764cc6870d654cf10c1e80" } modify_external_catalogs: true
I20260811 06:16:51.182823 10337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ed0d878c78764cc6870d654cf10c1e80" } modify_external_catalogs: true
I20260811 06:16:51.187255 11368 ts_tablet_manager.cc:1918] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.189814 11368 log.cc:1196] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bf1a831788df4431b32c07c1e18b2c4a
I20260811 06:16:51.190768 11368 ts_tablet_manager.cc:1939] T bf1a831788df4431b32c07c1e18b2c4a P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:51.195680 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 85) took 2197 ms. Trace:
I20260811 06:16:51.196691 11365 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.196873 11365 ts_tablet_manager.cc:1397] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.003s
I20260811 06:16:51.197741 11365 raft_consensus.cc:348] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.196898 11362 tablet_bootstrap.cc:492] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:51.198004 11365 raft_consensus.cc:374] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.198109 11365 raft_consensus.cc:729] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.198241 11362 ts_tablet_manager.cc:1397] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.210s user 0.006s sys 0.007s
I20260811 06:16:51.199625 11362 raft_consensus.cc:348] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.200307 11362 raft_consensus.cc:374] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.200600 11362 raft_consensus.cc:729] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.200726 11163 raft_consensus.cc:3037] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:51.201140 11362 consensus_queue.cc:260] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.203320 11362 ts_tablet_manager.cc:1428] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260811 06:16:51.203547 11640 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:16:51.203953 11362 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:51.205582 11609 mvcc.cc:205] Tried to move back new op lower bound from 7317213229358039040 to 7317213227610734592. Current Snapshot: MvccSnapshot[applied={T|T < 7317213229358039040}]
I20260811 06:16:51.206039 11637 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:16:51.213230 11368 rpcz_store.cc:276] 0811 06:16:48.998390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.998447 (+ 57us) service_pool.cc:227] Handling call
0811 06:16:50.826401 (+1827954us) ts_tablet_manager.cc:1145] Deleting tablet bf1a831788df4431b32c07c1e18b2c4a
0811 06:16:50.826413 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:50.893871 (+ 67458us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.187124 (+293253us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.195557 (+ 8433us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1792608}
I20260811 06:16:51.213955 11368 tablet_replica.cc:330] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:51.214159 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bf1a831788df4431b32c07c1e18b2c4a (table default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]) successfully deleted
I20260811 06:16:51.214238 11368 raft_consensus.cc:2229] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.214576 11368 raft_consensus.cc:2258] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.215384 11368 ts_tablet_manager.cc:1905] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.218168 11365 consensus_queue.cc:260] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.225922 11598 mvcc.cc:205] Tried to move back new op lower bound from 7317213229358039040 to 7317213227610734592. Current Snapshot: MvccSnapshot[applied={T|T < 7317213229358039040}]
I20260811 06:16:51.226154 11362 tablet_bootstrap.cc:654] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.229662 11637 tablet.cc:1717] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Skipping requested alter to schema version 4, tablet already version 4
I20260811 06:16:51.231014 11361 raft_consensus.cc:374] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.231710 11640 tablet.cc:1717] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Skipping requested alter to schema version 4, tablet already version 4
I20260811 06:16:51.237802 11365 ts_tablet_manager.cc:1428] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.041s user 0.000s sys 0.003s
I20260811 06:16:51.240319 11362 tablet_bootstrap.cc:492] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:51.242547 11362 ts_tablet_manager.cc:1397] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.003s
I20260811 06:16:51.243741 11365 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.245621 10331 master_service.cc:946] ReplaceTablet: received request to replace tablet 94d04b025b1b45009260ddd9f1b0aabb from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.246150 11365 tablet_bootstrap.cc:654] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.246469 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a64d6f4bab3143d38f8607e0bcd63898" } modify_external_catalogs: true
I20260811 06:16:51.246743 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a64d6f4bab3143d38f8607e0bcd63898" } modify_external_catalogs: true
W20260811 06:16:51.248167 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2875318863584e659e2b76ad2a72ca45 consensus state has no leader
I20260811 06:16:51.248771 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dcb5c77404034038a23416b22f0fff3f" } modify_external_catalogs: true
I20260811 06:16:51.249063 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dcb5c77404034038a23416b22f0fff3f" } modify_external_catalogs: true
I20260811 06:16:51.250566 11371 ts_tablet_manager.cc:1918] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.250844 11371 log.cc:1196] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:51.251554 11371 ts_tablet_manager.cc:1939] T 7368c0252cf84fe6831dc07eb173a7d6 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.253508 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 111) took 1485 ms. Trace:
I20260811 06:16:51.253692 11371 rpcz_store.cc:276] 0811 06:16:49.769896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.770162 (+ 266us) service_pool.cc:227] Handling call
0811 06:16:51.174290 (+1404128us) ts_tablet_manager.cc:1145] Deleting tablet 7368c0252cf84fe6831dc07eb173a7d6
0811 06:16:51.174301 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.183378 (+ 9077us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.250365 (+ 66987us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.253469 (+ 3104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1399724}
I20260811 06:16:51.254300 10322 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352]). Expected version 5 got 0
I20260811 06:16:51.254482 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 116) took 1467 ms. Trace:
I20260811 06:16:51.254729 11371 rpcz_store.cc:276] 0811 06:16:49.787168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.787964 (+ 796us) service_pool.cc:227] Handling call
0811 06:16:51.254238 (+1466274us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:16:51.254251 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.254415 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463909}
W20260811 06:16:51.248183 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae1e42440ff14857b297621ca6031835 consensus state has no leader
I20260811 06:16:51.246254 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ca2a465c1d9f4cd795b051d2a16f84d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.256739 11368 ts_tablet_manager.cc:1918] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.256937 11368 log.cc:1196] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/818859f61e754a75baf8804939864fd7
I20260811 06:16:51.257421 11368 ts_tablet_manager.cc:1939] T 818859f61e754a75baf8804939864fd7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:51.257490 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 117) took 1449 ms. Trace:
I20260811 06:16:51.257596 11371 rpcz_store.cc:276] 0811 06:16:49.807687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.807750 (+ 63us) service_pool.cc:227] Handling call
0811 06:16:51.257317 (+1449567us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:16:51.257329 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.257457 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1449311}
I20260811 06:16:51.258277 11362 raft_consensus.cc:348] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.258616 11362 raft_consensus.cc:374] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.258737 11362 raft_consensus.cc:729] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.260205 10865 tablet_service.cc:1467] Processing CreateTablet for tablet e873e2f7b3d34988856b3be044de1ed7 (DEFAULT_TABLE table=default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.260859 10882 tablet_service.cc:1467] Processing CreateTablet for tablet f9fd17e8c6264f898493c15b0aa5518d (DEFAULT_TABLE table=default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.261483 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 134) took 1189 ms. Trace:
I20260811 06:16:51.261483 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 847df543db4244a6b2900fc16fea7c07 (DEFAULT_TABLE table=default.Table_29660dc47bf14aeda6bf58332ba39430 [id=984fbc452ec24ab6ab362a27179e1623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.261600 11371 rpcz_store.cc:276] 0811 06:16:50.072147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.162458 (+ 90311us) service_pool.cc:227] Handling call
0811 06:16:51.261306 (+1098848us) ts_tablet_manager.cc:1145] Deleting tablet 3025339a6c9e4e07bba4104006206bb8
0811 06:16:51.261319 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.261447 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072295}
I20260811 06:16:51.262154 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 136) took 1172 ms. Trace:
I20260811 06:16:51.262513 11371 rpcz_store.cc:276] 0811 06:16:50.089406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.189048 (+ 99642us) service_pool.cc:227] Handling call
0811 06:16:51.262013 (+1072965us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:16:51.262024 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.262126 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1059852}
I20260811 06:16:51.262740 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e873e2f7b3d34988856b3be044de1ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.263254 11371 tablet_replica.cc:330] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.263479 11371 raft_consensus.cc:2229] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.264211 11371 raft_consensus.cc:2258] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.265337 11371 ts_tablet_manager.cc:1905] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.265558 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 9c5fa9633057485b917f117819d79398 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.266086 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9fd17e8c6264f898493c15b0aa5518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.268808 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847df543db4244a6b2900fc16fea7c07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.269230 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca2a465c1d9f4cd795b051d2a16f84d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.271523 10859 tablet_service.cc:1467] Processing CreateTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 (DEFAULT_TABLE table=default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.271975 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3091f8a8f9442da50b17d4752cedb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.278684 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 5119e9bb88844329aea123dc3805d91d (DEFAULT_TABLE table=default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.279256 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5119e9bb88844329aea123dc3805d91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.279477 10609 tablet_service.cc:1467] Processing CreateTablet for tablet e873e2f7b3d34988856b3be044de1ed7 (DEFAULT_TABLE table=default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.279897 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e873e2f7b3d34988856b3be044de1ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.281834 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 3250276181a24e58a2db92376b7520e7 (DEFAULT_TABLE table=default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.281849 10618 tablet_service.cc:1467] Processing CreateTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 (DEFAULT_TABLE table=default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.282006 10629 tablet_service.cc:1467] Processing CreateTablet for tablet f9fd17e8c6264f898493c15b0aa5518d (DEFAULT_TABLE table=default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.282280 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3250276181a24e58a2db92376b7520e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.282285 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3091f8a8f9442da50b17d4752cedb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.282537 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 847df543db4244a6b2900fc16fea7c07 (DEFAULT_TABLE table=default.Table_29660dc47bf14aeda6bf58332ba39430 [id=984fbc452ec24ab6ab362a27179e1623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.282873 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847df543db4244a6b2900fc16fea7c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.285941 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.286083 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 5797f3ba59924b41b92fbd089397218e (DEFAULT_TABLE table=default.Table_615fc66df6ed4c148a1fc40f406cbb31 [id=076c234f71704866b8327a959de28b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.286453 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5797f3ba59924b41b92fbd089397218e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.286705 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 5119e9bb88844329aea123dc3805d91d (DEFAULT_TABLE table=default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.287066 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5119e9bb88844329aea123dc3805d91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.287492 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 5797f3ba59924b41b92fbd089397218e (DEFAULT_TABLE table=default.Table_615fc66df6ed4c148a1fc40f406cbb31 [id=076c234f71704866b8327a959de28b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.287909 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5797f3ba59924b41b92fbd089397218e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.289856 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9fd17e8c6264f898493c15b0aa5518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.290109 10855 tablet_service.cc:1467] Processing CreateTablet for tablet ab32f96671984766a54b5ee904c465f7 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.290472 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab32f96671984766a54b5ee904c465f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.293180 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.293599 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.298336 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 2f243c792a634abf83484aef820dbb48 (DEFAULT_TABLE table=default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.298939 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f243c792a634abf83484aef820dbb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.299942 11479 consensus_queue.cc:1035] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260811 06:16:51.303035 10619 tablet_service.cc:1467] Processing CreateTablet for tablet 3250276181a24e58a2db92376b7520e7 (DEFAULT_TABLE table=default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.303620 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3250276181a24e58a2db92376b7520e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.305253 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 2f243c792a634abf83484aef820dbb48 (DEFAULT_TABLE table=default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.306969 10608 tablet_service.cc:1467] Processing CreateTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.307242 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7368c0252cf84fe6831dc07eb173a7d6 (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]) successfully deleted
W20260811 06:16:51.307660 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516021603ee24b3f9bdffd1e30e5ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516021603ee24b3f9bdffd1e30e5ea9d already in progress: creating tablet
I20260811 06:16:51.307855 10620 tablet_service.cc:1467] Processing CreateTablet for tablet a1da7a10783f4bb9aadb20668aee95c2 (DEFAULT_TABLE table=default.Table_f108c0e6821b45039886e052f9f9dba3 [id=5936fbf06baf4ab0b2e34f9997c81e3b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:51.307976 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 22cac1c339574b1fa26555b18811539b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cac1c339574b1fa26555b18811539b already in progress: creating tablet
W20260811 06:16:51.308372 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3025339a6c9e4e07bba4104006206bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3025339a6c9e4e07bba4104006206bb8 already in progress: creating tablet
I20260811 06:16:51.308672 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f243c792a634abf83484aef820dbb48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.309044 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 already in progress: creating tablet
I20260811 06:16:51.310122 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da7a10783f4bb9aadb20668aee95c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.310664 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f2364840e195411d8525c4d0f0f6b7e6" } modify_external_catalogs: true
I20260811 06:16:51.311064 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f2364840e195411d8525c4d0f0f6b7e6" } modify_external_catalogs: true
I20260811 06:16:51.311501 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 22feadfa433d46cc9f5dc052b3421e56 (DEFAULT_TABLE table=default.Table_75563fd692aa4a26ac8eaed68d07945d [id=da44c33a0b9d49fa8b0df0afa70e6fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.312076 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22feadfa433d46cc9f5dc052b3421e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.313617 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_fc6c3d54d9c04ab0ad9278dd8e534505" } new_table_name: "default.Table_ceb4c433db0b4d098442695e2441817e" modify_external_catalogs: true
I20260811 06:16:51.315784 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_22654c0987894b08a5c3fdb36c77e3e1" } new_table_name: "default.Table_61a9560977f5458a85388ed6ddeb069b" modify_external_catalogs: true
I20260811 06:16:51.316157 10854 tablet_service.cc:1467] Processing CreateTablet for tablet a1da7a10783f4bb9aadb20668aee95c2 (DEFAULT_TABLE table=default.Table_f108c0e6821b45039886e052f9f9dba3 [id=5936fbf06baf4ab0b2e34f9997c81e3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.317082 10853 tablet_service.cc:1467] Processing CreateTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.320326 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d44dea35e94ed788b7e1e5a8a24d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.323243 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9db3f79baf3a4a6caba9a984f0fa3866" } modify_external_catalogs: true
I20260811 06:16:51.323628 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da7a10783f4bb9aadb20668aee95c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.323606 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9db3f79baf3a4a6caba9a984f0fa3866" } modify_external_catalogs: true
I20260811 06:16:51.330657 11110 tablet_service.cc:1467] Processing CreateTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 (DEFAULT_TABLE table=default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.331200 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc3091f8a8f9442da50b17d4752cedb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.331579 11117 tablet_service.cc:1467] Processing CreateTablet for tablet f9fd17e8c6264f898493c15b0aa5518d (DEFAULT_TABLE table=default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.336162 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 3b658d1cd9b74251981fe1ff3959033a (DEFAULT_TABLE table=default.Table_e00a80287d844b2eb51fe2cea5882336 [id=c1691f7e26814813a6e41eeca1a4ec83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.336436 10872 tablet_service.cc:1467] Processing CreateTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c (DEFAULT_TABLE table=default.Table_a8fee33e3e334393a747f831b0ceb733 [id=328164bbe3754ce7abd0375e1070ee37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.336731 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 5119e9bb88844329aea123dc3805d91d (DEFAULT_TABLE table=default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.337215 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9fd17e8c6264f898493c15b0aa5518d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.334522 11109 tablet_service.cc:1467] Processing CreateTablet for tablet e873e2f7b3d34988856b3be044de1ed7 (DEFAULT_TABLE table=default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.338613 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5119e9bb88844329aea123dc3805d91d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.340852 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 3250276181a24e58a2db92376b7520e7
I20260811 06:16:51.340884 10321 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: default.Table_1668695b60f3456580d886578b815b54 [id=a66e3380ba3d46ca93a6f98468b36cc3] alter complete (version 4)
I20260811 06:16:51.342155 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 16674be53bd54f9395b650e19edd3cf4
I20260811 06:16:51.341995 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_38255a43259b4c3a9e0385991f1730dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.342757 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38255a43259b4c3a9e0385991f1730dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.344950 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_29c22b2f708149d4a6421f424db0e8da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.345520 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29c22b2f708149d4a6421f424db0e8da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.346585 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 2f243c792a634abf83484aef820dbb48
I20260811 06:16:51.341575 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_75563fd692aa4a26ac8eaed68d07945d" } new_table_name: "default.Table_6f3b141d76224d23b743c380e462b237" modify_external_catalogs: true
I20260811 06:16:51.350133 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 94d04b025b1b45009260ddd9f1b0aabb
I20260811 06:16:51.350811 10331 catalog_manager.cc:6565] ReplaceTablet: tablet 94d04b025b1b45009260ddd9f1b0aabb deleted and replaced by tablet 2fcf7c7a470144c0a084aebc2032d896
I20260811 06:16:51.353410 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b658d1cd9b74251981fe1ff3959033a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.359727 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e873e2f7b3d34988856b3be044de1ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.361054 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 3250276181a24e58a2db92376b7520e7 (DEFAULT_TABLE table=default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.356297 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 847df543db4244a6b2900fc16fea7c07 (DEFAULT_TABLE table=default.Table_29660dc47bf14aeda6bf58332ba39430 [id=984fbc452ec24ab6ab362a27179e1623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.363935 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3250276181a24e58a2db92376b7520e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.367985 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1981dc26be24ec5afaa3c0bb5c46c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.368021 11361 raft_consensus.cc:729] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:16:51.370347 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0391df1c64954f66a3987aba9257ca4b consensus state has no leader
W20260811 06:16:51.370936 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4d44dea35e94ed788b7e1e5a8a24d8e consensus state has no leader
I20260811 06:16:51.371483 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet e873e2f7b3d34988856b3be044de1ed7
I20260811 06:16:51.373399 11641 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:16:51.374907 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet dc6254bf781740019c3f71b26179f25d
W20260811 06:16:51.378564 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22feadfa433d46cc9f5dc052b3421e56 consensus state has no leader
I20260811 06:16:51.380254 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 847df543db4244a6b2900fc16fea7c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.381587 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 5797f3ba59924b41b92fbd089397218e (DEFAULT_TABLE table=default.Table_615fc66df6ed4c148a1fc40f406cbb31 [id=076c234f71704866b8327a959de28b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.382285 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5797f3ba59924b41b92fbd089397218e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.384012 10310 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.125:35327, user_credentials={real_user=slave}} blocked reactor thread for 45824.6us
I20260811 06:16:51.384313 11575 mvcc.cc:205] Tried to move back new op lower bound from 7317213229358039040 to 7317213227610734592. Current Snapshot: MvccSnapshot[applied={T|T < 7317213229358039040}]
I20260811 06:16:51.388270 11370 ts_tablet_manager.cc:1918] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:51.388645 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4ff56306486f476382e06c0bc8f15928"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.389693 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ff56306486f476382e06c0bc8f15928 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.390430 11370 log.cc:1196] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:51.368652 11361 consensus_queue.cc:260] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.393616 11163 raft_consensus.cc:2454] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:16:51.397670 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d44dea35e94ed788b7e1e5a8a24d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.403370 11119 tablet_service.cc:1467] Processing CreateTablet for tablet ab32f96671984766a54b5ee904c465f7 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.403951 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab32f96671984766a54b5ee904c465f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.404192 10309 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_ceb4c433db0b4d098442695e2441817e [id=7aa63339f43e4b59ab6af32afc629ccd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0391df1c64954f66a3987aba9257ca4b consensus state has no leader
I20260811 06:16:51.410513 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 22feadfa433d46cc9f5dc052b3421e56 (DEFAULT_TABLE table=default.Table_75563fd692aa4a26ac8eaed68d07945d [id=da44c33a0b9d49fa8b0df0afa70e6fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.410748 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 22feadfa433d46cc9f5dc052b3421e56 (DEFAULT_TABLE table=default.Table_75563fd692aa4a26ac8eaed68d07945d [id=da44c33a0b9d49fa8b0df0afa70e6fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.403059 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.411056 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 2f243c792a634abf83484aef820dbb48 (DEFAULT_TABLE table=default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.413467 11635 raft_consensus.cc:482] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.413877 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22feadfa433d46cc9f5dc052b3421e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.413882 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.414647 10634 tablet_service.cc:1467] Processing CreateTablet for tablet ab32f96671984766a54b5ee904c465f7 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.414884 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcf7c7a470144c0a084aebc2032d896) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.416684 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.416981 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.417959 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22feadfa433d46cc9f5dc052b3421e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.418556 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.419709 11107 tablet_service.cc:1467] Processing CreateTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e (DEFAULT_TABLE table=default.Table_22654c0987894b08a5c3fdb36c77e3e1 [id=bfa0349641894d2a9d2ac610a4e18e6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.421768 11635 raft_consensus.cc:504] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.421969 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f243c792a634abf83484aef820dbb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.422189 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.422570 11635 leader_election.cc:288] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:51.423925 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.423991 11127 tablet_service.cc:1467] Processing CreateTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c (DEFAULT_TABLE table=default.Table_a8fee33e3e334393a747f831b0ceb733 [id=328164bbe3754ce7abd0375e1070ee37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.424111 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 3b658d1cd9b74251981fe1ff3959033a (DEFAULT_TABLE table=default.Table_e00a80287d844b2eb51fe2cea5882336 [id=c1691f7e26814813a6e41eeca1a4ec83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.424499 11115 tablet_service.cc:1467] Processing CreateTablet for tablet a1da7a10783f4bb9aadb20668aee95c2 (DEFAULT_TABLE table=default.Table_f108c0e6821b45039886e052f9f9dba3 [id=5936fbf06baf4ab0b2e34f9997c81e3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.426891 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.428124 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab32f96671984766a54b5ee904c465f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.429960 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.430003 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.430456 10626 tablet_service.cc:1467] Processing CreateTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c (DEFAULT_TABLE table=default.Table_a8fee33e3e334393a747f831b0ceb733 [id=328164bbe3754ce7abd0375e1070ee37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.431339 11370 ts_tablet_manager.cc:1939] T a3e6bf8789594a91a1a35e6c750a0ddd P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:51.432199 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b658d1cd9b74251981fe1ff3959033a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.434309 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.436009 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.434722 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 3b658d1cd9b74251981fe1ff3959033a (DEFAULT_TABLE table=default.Table_e00a80287d844b2eb51fe2cea5882336 [id=c1691f7e26814813a6e41eeca1a4ec83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.438014 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1da7a10783f4bb9aadb20668aee95c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.439482 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:51.440012 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:51.440788 10555 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.440838 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcf7c7a470144c0a084aebc2032d896) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.443751 11371 ts_tablet_manager.cc:1918] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.444953 11371 log.cc:1196] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:51.445253 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1981dc26be24ec5afaa3c0bb5c46c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.447480 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.450176 11361 ts_tablet_manager.cc:1428] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.318s user 0.002s sys 0.002s
I20260811 06:16:51.450235 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b658d1cd9b74251981fe1ff3959033a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.461891 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d44dea35e94ed788b7e1e5a8a24d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.468566 11371 ts_tablet_manager.cc:1939] T 57144ad37b874c91a89a25665a85eeb2 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.470036 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 135) took 1392 ms. Trace:
I20260811 06:16:51.472865 11371 rpcz_store.cc:276] 0811 06:16:50.077698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.177196 (+ 99498us) service_pool.cc:227] Handling call
0811 06:16:51.263170 (+1085974us) ts_tablet_manager.cc:1145] Deleting tablet 57144ad37b874c91a89a25665a85eeb2
0811 06:16:51.263181 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.269667 (+ 6486us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.443632 (+173965us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.469619 (+ 25987us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021116}
I20260811 06:16:51.476462 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 98) took 1949 ms. Trace:
I20260811 06:16:51.477181 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 141) took 1355 ms. Trace:
I20260811 06:16:51.477473 11371 rpcz_store.cc:276] 0811 06:16:50.121320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.242105 (+120785us) service_pool.cc:227] Handling call
0811 06:16:51.476821 (+1234716us) ts_tablet_manager.cc:1145] Deleting tablet c00b6bdfc8ac4b5db81de9f614fcf213
0811 06:16:51.476835 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.477001 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1234358}
I20260811 06:16:51.480175 11361 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:51.480952 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1981dc26be24ec5afaa3c0bb5c46c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.484643 11370 rpcz_store.cc:276] 0811 06:16:49.493556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.493595 (+ 39us) service_pool.cc:227] Handling call
0811 06:16:50.770415 (+1276820us) ts_tablet_manager.cc:1145] Deleting tablet a3e6bf8789594a91a1a35e6c750a0ddd
0811 06:16:50.770426 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.040846 (+270420us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.388153 (+347307us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.443113 (+ 54960us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276576}
I20260811 06:16:51.486245 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.499037 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_7e17eee1017d48ceb5c1208f05e8cc53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.499881 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e17eee1017d48ceb5c1208f05e8cc53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.499727 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1f6ef045b41944bc8268edd5f3832542"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.500536 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f6ef045b41944bc8268edd5f3832542 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.505565 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_cf999672f4d34be0baa2e667bc984941" } new_table_name: "default.Table_bed0d789166c45eea07dc86bda2e8497" modify_external_catalogs: true
I20260811 06:16:51.259022 11362 consensus_queue.cc:260] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.507203 11362 ts_tablet_manager.cc:1428] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.265s user 0.001s sys 0.002s
I20260811 06:16:51.507078 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_fc4b03d50c57434da608ba22b5e91522"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.508008 11362 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:51.508279 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 142) took 1363 ms. Trace:
I20260811 06:16:51.508569 11371 rpcz_store.cc:276] 0811 06:16:50.134957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.242485 (+107528us) service_pool.cc:227] Handling call
0811 06:16:51.496906 (+1254421us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:16:51.496920 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.497863 (+ 943us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1254104}
I20260811 06:16:51.509972 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 140) took 1391 ms. Trace:
I20260811 06:16:51.510221 11371 rpcz_store.cc:276] 0811 06:16:50.117965 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.231203 (+113238us) service_pool.cc:227] Handling call
0811 06:16:51.509100 (+1277897us) ts_tablet_manager.cc:1145] Deleting tablet f88af70bbada49309a0e7cc7c333d6f0
0811 06:16:51.509113 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.509674 (+ 561us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249268}
I20260811 06:16:51.512542 11635 raft_consensus.cc:482] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.513675 11635 raft_consensus.cc:504] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.514758 11635 leader_election.cc:288] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:51.515429 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:51.518074 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc4b03d50c57434da608ba22b5e91522 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.519923 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d118a4eb489941a6a06cd47e966d09a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.521109 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d118a4eb489941a6a06cd47e966d09a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.524776 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 57144ad37b874c91a89a25665a85eeb2 (table default.Table_ceb4c433db0b4d098442695e2441817e [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
I20260811 06:16:51.528553 11371 tablet_replica.cc:330] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.528887 11371 raft_consensus.cc:2229] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.513439 11365 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.529881 11371 raft_consensus.cc:2258] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.530025 11365 ts_tablet_manager.cc:1397] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.286s user 0.030s sys 0.041s
I20260811 06:16:51.531445 11365 raft_consensus.cc:348] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.531834 11365 raft_consensus.cc:374] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.531971 11365 raft_consensus.cc:729] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.532449 11371 ts_tablet_manager.cc:1905] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:51.528240 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c00b6bdfc8ac4b5db81de9f614fcf213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00b6bdfc8ac4b5db81de9f614fcf213 already in progress: creating tablet
I20260811 06:16:51.528107 11530 raft_consensus.cc:482] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.535478 10564 leader_election.cc:302] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:51.535789 10564 raft_consensus.cc:2670] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:51.535917 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:16:51.532249 11365 consensus_queue.cc:260] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.543623 11365 ts_tablet_manager.cc:1428] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260811 06:16:51.547772 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.548655 11365 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:16:51.534845 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39dfcd1a66b4241bc6f5c38e930f048 already in progress: creating tablet
W20260811 06:16:51.550184 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f88af70bbada49309a0e7cc7c333d6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f88af70bbada49309a0e7cc7c333d6f0 already in progress: creating tablet
I20260811 06:16:51.519495 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb854704951e4a399267766fb5be40e2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:51.526192 10915 raft_consensus.cc:3037] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:51.551748 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcf7c7a470144c0a084aebc2032d896) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.526739 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:51.551937 10555 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.553023 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_daa79a35a77f423793b799f850523035" } new_table_name: "default.Table_3d62247a29ac401fb5d29f5a4ba2dd72" modify_external_catalogs: true
I20260811 06:16:51.557085 11365 tablet_bootstrap.cc:654] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.554279 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a74689c2487947639884dc54e461cf46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.558185 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a74689c2487947639884dc54e461cf46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.554858 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d619bfe299b14454abfe4a31106bb81d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.562978 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d619bfe299b14454abfe4a31106bb81d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:51.565016 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 285b85c854bf400295b288314947840e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 285b85c854bf400295b288314947840e already in progress: creating tablet
I20260811 06:16:51.565352 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:51.565749 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 86) took 2558 ms. Trace:
I20260811 06:16:51.565904 11370 tablet_replica.cc:330] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:51.566051 11368 rpcz_store.cc:276] 0811 06:16:48.998755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.998835 (+ 80us) service_pool.cc:227] Handling call
0811 06:16:51.213684 (+2214849us) ts_tablet_manager.cc:1145] Deleting tablet 818859f61e754a75baf8804939864fd7
0811 06:16:51.213698 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.224809 (+ 11111us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.256521 (+ 31712us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.557166 (+300645us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2179648}
I20260811 06:16:51.556789 11530 raft_consensus.cc:504] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.566469 11362 tablet_bootstrap.cc:654] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.568362 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 94) took 2329 ms. Trace:
I20260811 06:16:51.566900 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 818859f61e754a75baf8804939864fd7 (table default.Table_65cc0e4c415b4b0095a28b5ec4bfda05 [id=216d0fcdfe8146318d343dcdc1cfd0eb]) successfully deleted
W20260811 06:16:51.568709 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c42b5ef0fc84627908200331f53b1a3 already in progress: creating tablet
I20260811 06:16:51.568709 11368 rpcz_store.cc:276] 0811 06:16:49.238636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.238693 (+ 57us) service_pool.cc:227] Handling call
0811 06:16:51.568191 (+2329498us) ts_tablet_manager.cc:1145] Deleting tablet 5d0530ec053f47df800cf2abf549b068
0811 06:16:51.568205 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.568326 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2321562}
W20260811 06:16:51.569424 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5d0530ec053f47df800cf2abf549b068 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d0530ec053f47df800cf2abf549b068 already in progress: creating tablet
I20260811 06:16:51.570050 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 92) took 2345 ms. Trace:
I20260811 06:16:51.570218 11368 rpcz_store.cc:276] 0811 06:16:49.224828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.224887 (+ 59us) service_pool.cc:227] Handling call
0811 06:16:51.569607 (+2344720us) ts_tablet_manager.cc:1145] Deleting tablet 5b681f10c3de4bd798b9d519f10da103
0811 06:16:51.569620 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.570006 (+ 386us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322846}
W20260811 06:16:51.570765 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5b681f10c3de4bd798b9d519f10da103 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b681f10c3de4bd798b9d519f10da103 already in progress: creating tablet
I20260811 06:16:51.571092 11371 ts_tablet_manager.cc:1918] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.571184 11368 tablet_replica.cc:330] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:51.571467 11368 raft_consensus.cc:2229] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.571727 11368 raft_consensus.cc:2258] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.571810 11371 log.cc:1196] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ff35295f6a4a4f53b8f6af0a0f3c4e29
I20260811 06:16:51.572432 11371 ts_tablet_manager.cc:1939] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.572486 11368 ts_tablet_manager.cc:1905] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.574429 11371 tablet_replica.cc:330] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.574833 11371 raft_consensus.cc:2229] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.568120 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:51.575382 11371 raft_consensus.cc:2258] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.576792 11371 ts_tablet_manager.cc:1905] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.578222 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:51.578715 10665 raft_consensus.cc:2454] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:51.583148 11479 consensus_queue.cc:1035] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260811 06:16:51.585881 11370 raft_consensus.cc:2229] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:51.593238 11153 raft_consensus.cc:2454] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:51.595693 11365 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.596040 11365 ts_tablet_manager.cc:1397] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.006s
I20260811 06:16:51.596585 10564 leader_election.cc:302] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:51.597121 11635 raft_consensus.cc:2781] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:51.597404 11635 raft_consensus.cc:482] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:51.597606 11635 raft_consensus.cc:3037] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:51.598850 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:51.601359 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ff35295f6a4a4f53b8f6af0a0f3c4e29 (table default.Table_bf629c6c917c4c6fbbd8fceed0452997 [id=946afbec359e4e1b9804a4e6f1141cae]) successfully deleted
W20260811 06:16:51.601912 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a4a46cec25944310a838d8323b119883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a46cec25944310a838d8323b119883 already in progress: creating tablet
I20260811 06:16:51.602064 11635 raft_consensus.cc:504] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.604113 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:51.604956 11641 tablet.cc:1717] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Skipping requested alter to schema version 4, tablet already version 4
W20260811 06:16:51.605072 10555 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.605615 11635 leader_election.cc:288] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:51.606195 11365 raft_consensus.cc:348] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.606428 11046 leader_election.cc:302] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:51.607095 11365 raft_consensus.cc:374] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.607439 11365 raft_consensus.cc:729] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.607900 11365 consensus_queue.cc:260] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.608461 11479 raft_consensus.cc:2781] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:51.608671 11479 raft_consensus.cc:482] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:51.609750 11479 raft_consensus.cc:3037] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:51.610261 11530 leader_election.cc:288] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:51.611726 11365 ts_tablet_manager.cc:1428] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260811 06:16:51.614928 11365 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.616083 11362 tablet_bootstrap.cc:492] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:51.616355 11362 ts_tablet_manager.cc:1397] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.108s user 0.009s sys 0.004s
I20260811 06:16:51.618438 11365 tablet_bootstrap.cc:654] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.618055 11362 raft_consensus.cc:348] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.619270 11362 raft_consensus.cc:374] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.623446 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:16:51.625530 11047 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.626015 11371 ts_tablet_manager.cc:1918] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.626551 11371 log.cc:1196] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/cbab2b67ef434ebebe7fe947e9c4ff66
I20260811 06:16:51.627389 11371 ts_tablet_manager.cc:1939] T cbab2b67ef434ebebe7fe947e9c4ff66 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.628129 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb854704951e4a399267766fb5be40e2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:51.631110 11361 tablet_bootstrap.cc:654] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:51.631644 10564 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.632160 10564 leader_election.cc:302] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:51.632364 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2bdb349406a46629e6c307e1ebfd9dc already in progress: creating tablet
W20260811 06:16:51.632666 11046 consensus_peers.cc:487] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ccb7050ea9f4cc2a1b924814a204de5. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:51.633546 11368 ts_tablet_manager.cc:1918] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.633544 11635 raft_consensus.cc:2726] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:51.636042 11371 tablet_replica.cc:330] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.636571 11371 raft_consensus.cc:2229] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.637507 11371 raft_consensus.cc:2258] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.637779 11362 raft_consensus.cc:729] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.638182 11370 pending_rounds.cc:62] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:51.638126 11362 consensus_queue.cc:260] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.638847 11362 ts_tablet_manager.cc:1428] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260811 06:16:51.639178 11362 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:51.640821 11365 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.641072 11365 ts_tablet_manager.cc:1397] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.002s
I20260811 06:16:51.641072 11368 log.cc:1196] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ee0f6ba0c08149f981fe27c5d40346cc
I20260811 06:16:51.641577 11368 ts_tablet_manager.cc:1939] T ee0f6ba0c08149f981fe27c5d40346cc P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:51.642271 11365 raft_consensus.cc:348] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.642534 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 93) took 2407 ms. Trace:
I20260811 06:16:51.642700 11365 raft_consensus.cc:374] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.642652 11368 rpcz_store.cc:276] 0811 06:16:49.234926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.235980 (+ 1054us) service_pool.cc:227] Handling call
0811 06:16:51.571093 (+2335113us) ts_tablet_manager.cc:1145] Deleting tablet ee0f6ba0c08149f981fe27c5d40346cc
0811 06:16:51.571105 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.576062 (+ 4957us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.633344 (+ 57282us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.642467 (+ 9123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2322420}
I20260811 06:16:51.642866 11365 raft_consensus.cc:729] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.643213 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ee0f6ba0c08149f981fe27c5d40346cc (table default.Table_830bbd5a95fc4f45addf2c57b787c2d9 [id=257d5c1ee6aa4f1c8060822ef0fae341]) successfully deleted
I20260811 06:16:51.643630 11368 tablet_replica.cc:330] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:51.643911 11368 raft_consensus.cc:2229] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.643615 11365 consensus_queue.cc:260] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.644284 11368 raft_consensus.cc:2258] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.644313 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet cbab2b67ef434ebebe7fe947e9c4ff66 (table default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]) successfully deleted
I20260811 06:16:51.644950 11368 ts_tablet_manager.cc:1905] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.645968 11365 ts_tablet_manager.cc:1428] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:51.647080 11365 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.650337 11365 tablet_bootstrap.cc:654] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.650764 11362 tablet_bootstrap.cc:654] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:51.653026 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fe5eea681072477ab52a822d721629cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe5eea681072477ab52a822d721629cf already in progress: creating tablet
W20260811 06:16:51.654656 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0bbf657cb27f4da9a4f595242864163a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bbf657cb27f4da9a4f595242864163a already in progress: creating tablet
I20260811 06:16:51.655577 11365 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.655884 11365 ts_tablet_manager.cc:1397] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
W20260811 06:16:51.661083 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7a00b0b51f574bfb843b65c0876ab4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a00b0b51f574bfb843b65c0876ab4fc already in progress: creating tablet
W20260811 06:16:51.661947 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 58fdb5920003438d983987ff242f6dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58fdb5920003438d983987ff242f6dce already in progress: creating tablet
I20260811 06:16:51.663456 11365 raft_consensus.cc:348] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.654572 11370 pending_rounds.cc:68] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213225001242624 op_type: NO_OP noop_request { }
I20260811 06:16:51.667397 11635 raft_consensus.cc:482] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.667658 11635 raft_consensus.cc:504] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.668520 11635 leader_election.cc:288] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:51.666498 11370 raft_consensus.cc:2866] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:51.670205 11365 raft_consensus.cc:374] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.670138 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd7390a2221f4a1b9948c8a1353e4a49" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:51.671160 10555 leader_election.cc:341] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:51.671700 11365 raft_consensus.cc:729] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.672199 11365 consensus_queue.cc:260] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:51.674113 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 52953438e7c248b1a758ee219405d7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52953438e7c248b1a758ee219405d7da already in progress: creating tablet
W20260811 06:16:51.675985 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6119212ae4be4204852a5d9437dcee72 already in progress: creating tablet
I20260811 06:16:51.676367 11370 raft_consensus.cc:2258] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.678141 11365 ts_tablet_manager.cc:1428] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
W20260811 06:16:51.679488 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet adc2d99019384c33840f16cbe98d336c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adc2d99019384c33840f16cbe98d336c already in progress: creating tablet
I20260811 06:16:51.682349 11365 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.685257 11365 tablet_bootstrap.cc:654] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.693569 11362 tablet_bootstrap.cc:492] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:51.693866 11362 ts_tablet_manager.cc:1397] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.005s
I20260811 06:16:51.695371 11362 raft_consensus.cc:348] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.695641 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet 7368c0252cf84fe6831dc07eb173a7d6 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.695818 11362 raft_consensus.cc:374] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.696005 11362 raft_consensus.cc:729] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.696368 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet cbab2b67ef434ebebe7fe947e9c4ff66 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.697021 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_59bc917bf1c440c6a607b0727ef3a8ff" } modify_external_catalogs: true
I20260811 06:16:51.697238 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_59bc917bf1c440c6a607b0727ef3a8ff" } modify_external_catalogs: true
I20260811 06:16:51.677663 11368 ts_tablet_manager.cc:1918] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:51.697871 11368 log.cc:1196] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/34c4f425aa214a7a9e8a029389d59a04
W20260811 06:16:51.698280 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8123e24a8bbf4bd6a9344a83ca2163fc consensus state has no leader
I20260811 06:16:51.698416 11368 ts_tablet_manager.cc:1939] T 34c4f425aa214a7a9e8a029389d59a04 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:51.698951 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_695c2233e5f54b8da16c476efb46a8fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.699342 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 96) took 2438 ms. Trace:
I20260811 06:16:51.699573 11368 rpcz_store.cc:276] 0811 06:16:49.260695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.260924 (+ 229us) service_pool.cc:227] Handling call
0811 06:16:51.643543 (+2382619us) ts_tablet_manager.cc:1145] Deleting tablet 34c4f425aa214a7a9e8a029389d59a04
0811 06:16:51.643556 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.649418 (+ 5862us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.677466 (+ 28048us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:51.699301 (+ 21835us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2381980}
W20260811 06:16:51.699823 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_695c2233e5f54b8da16c476efb46a8fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.700281 11371 ts_tablet_manager.cc:1905] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.706287 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (DEFAULT_TABLE table=default.Table_0239afa9778a4851b82c1ed6655dc6dd [id=7d8f4d920e5c406e93fefc7efadabd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.706916 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.710338 10865 tablet_service.cc:1467] Processing CreateTablet for tablet d45055341dab44089b2fc3fe25256073 (DEFAULT_TABLE table=default.Table_fa6e7eb493bf4dbb86702a219a388acb [id=8ae837e4085947f783acb33a801b60cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.710897 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45055341dab44089b2fc3fe25256073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.701617 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6b45271419ea4e4a9b82a7aff6a113f7" } modify_external_catalogs: true
I20260811 06:16:51.711992 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6b45271419ea4e4a9b82a7aff6a113f7" } modify_external_catalogs: true
W20260811 06:16:51.702204 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14a36a644dc4491dad838ce4e19793ab consensus state has no leader
I20260811 06:16:51.714417 10866 tablet_service.cc:1467] Processing CreateTablet for tablet b0cdc826a1d8460aba1aae684c13131d (DEFAULT_TABLE table=default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.714715 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_61a9560977f5458a85388ed6ddeb069b" } modify_external_catalogs: true
I20260811 06:16:51.715040 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0cdc826a1d8460aba1aae684c13131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.715073 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_61a9560977f5458a85388ed6ddeb069b" } modify_external_catalogs: true
I20260811 06:16:51.702793 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e7d2f44fbe0746df9f34637def4bdd58" } modify_external_catalogs: true
I20260811 06:16:51.716892 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e7d2f44fbe0746df9f34637def4bdd58" } modify_external_catalogs: true
I20260811 06:16:51.703420 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_77d905944afa4e60841edba6884de3a4" } new_table_name: "default.Table_9d0168019872459bab51e459df1b7a42" modify_external_catalogs: true
I20260811 06:16:51.718382 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (DEFAULT_TABLE table=default.Table_42136fc7f8704bc18984cc34a3514702 [id=8b0b0301a2c646719cae9bc25f613a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.719107 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.722250 10879 tablet_service.cc:1467] Processing CreateTablet for tablet eb437660103845aa98af100aef1c3021 (DEFAULT_TABLE table=default.Table_60f9ff39184a401d92a346f88abbd7e3 [id=3d036ef0c0fb497ba15fe0468f792eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.704020 10337 catalog_manager.cc:5495] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:16:51.722987 10337 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352]). Expected version 5 got 0
I20260811 06:16:51.723418 10337 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_1668695b60f3456580d886578b815b54 [id=a66e3380ba3d46ca93a6f98468b36cc3]). Expected version 4 got 0
I20260811 06:16:51.723515 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb437660103845aa98af100aef1c3021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.704963 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 34c4f425aa214a7a9e8a029389d59a04 (table default.Table_e29856ff2b0e4fae84c701e646151d4b [id=d41d2864aded430783e667b5f3a87e84]) successfully deleted
I20260811 06:16:51.710624 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d5687a6765814d33beccc599bc6876f4" } new_table_name: "default.Table_e8e359f459ab4b79a079b6f990345a9a" modify_external_catalogs: true
I20260811 06:16:51.735996 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb02f61b67147f793b3a2f063d8c56c (DEFAULT_TABLE table=default.Table_3c3274039b55474a90dfb2f66912aff6 [id=5cd54d1a139f4121a3d2ab449eb86c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.736552 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb02f61b67147f793b3a2f063d8c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.741144 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 217f60a1ca044af38f9ee9093e021c27 (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.741942 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217f60a1ca044af38f9ee9093e021c27. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.745234 10307 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 64568.2us
I20260811 06:16:51.747349 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (DEFAULT_TABLE table=default.Table_0239afa9778a4851b82c1ed6655dc6dd [id=7d8f4d920e5c406e93fefc7efadabd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.751605 10855 tablet_service.cc:1467] Processing CreateTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 (DEFAULT_TABLE table=default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.752300 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e5b4cdeb464861ada487eeb1b901a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.754257 10884 tablet_service.cc:1467] Processing CreateTablet for tablet d165ac025ce845c6b2b3621caaf01894 (DEFAULT_TABLE table=default.Table_6e207ab6e5fb44668aa0245cedde4b40 [id=93a54bf553fa4e01b74b150cc9a1790b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.754792 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d165ac025ce845c6b2b3621caaf01894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.756130 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 14a36a644dc4491dad838ce4e19793ab (DEFAULT_TABLE table=default.Table_3d62247a29ac401fb5d29f5a4ba2dd72 [id=4968af03a1a142288a30bac3f6ac9154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.756793 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a36a644dc4491dad838ce4e19793ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.758811 11370 ts_tablet_manager.cc:1905] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.758983 10854 tablet_service.cc:1467] Processing CreateTablet for tablet dd6584701c23406e83122bd2493b7972 (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.759537 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd6584701c23406e83122bd2493b7972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.761420 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 8bd026d2c6064a67b1c432efa4474a0e (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.761936 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bd026d2c6064a67b1c432efa4474a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.765575 10853 tablet_service.cc:1467] Processing CreateTablet for tablet a67daf4bdf45464b916905f432f0ec9c (DEFAULT_TABLE table=default.Table_940e7658aef54574be7fd31c40f81ec2 [id=65bf032e717442739e4e712f716e0fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.777887 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a67daf4bdf45464b916905f432f0ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.779345 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6c62cbef937a46dfbc4dbf934e887139
I20260811 06:16:51.780238 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_081e5e9b7dd24fc5a0723450c844edf2" } modify_external_catalogs: true
I20260811 06:16:51.780511 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_081e5e9b7dd24fc5a0723450c844edf2" } modify_external_catalogs: true
I20260811 06:16:51.782056 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:16:51.781767 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4564bda35a5f4fdc9338a844c1d39733"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.782675 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4564bda35a5f4fdc9338a844c1d39733 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.782830 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_536e393707744871ad51373ed03d8ae8" } new_table_name: "default.Table_e689150437054d989696612d76a1685c" modify_external_catalogs: true
I20260811 06:16:51.784246 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 217f60a1ca044af38f9ee9093e021c27
W20260811 06:16:51.784283 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4f14a0add084048b92a501476ad6588 consensus state has no leader
I20260811 06:16:51.784751 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_df5cfd277a4d425a84441c5670b812f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.785112 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a78aa76e7c2c4be2a021e44457b7091a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.786216 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea4eb7f5db2e4e75818bfb228b64ed0d consensus state has no leader
I20260811 06:16:51.786641 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 7fbdda840466420f8d67a8cb5868ba03 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.788700 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet b1d6641dd44340889879d3b92018b3f0 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.789489 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 0bbf657cb27f4da9a4f595242864163a from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:51.790256 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:16:51.799108 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:51.800169 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a78aa76e7c2c4be2a021e44457b7091a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:51.801544 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df5cfd277a4d425a84441c5670b812f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.802132 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.803946 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:51.809016 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d0f4cb9da96451ab351e1ad1aff7530 consensus state has no leader
I20260811 06:16:51.809620 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.810599 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.818737 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (DEFAULT_TABLE table=default.Table_0239afa9778a4851b82c1ed6655dc6dd [id=7d8f4d920e5c406e93fefc7efadabd89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.819419 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.820933 11106 tablet_service.cc:1467] Processing CreateTablet for tablet d45055341dab44089b2fc3fe25256073 (DEFAULT_TABLE table=default.Table_fa6e7eb493bf4dbb86702a219a388acb [id=8ae837e4085947f783acb33a801b60cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.821141 11105 tablet_service.cc:1467] Processing CreateTablet for tablet b0cdc826a1d8460aba1aae684c13131d (DEFAULT_TABLE table=default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.821450 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45055341dab44089b2fc3fe25256073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.821808 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0cdc826a1d8460aba1aae684c13131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.824760 10626 tablet_service.cc:1467] Processing CreateTablet for tablet d45055341dab44089b2fc3fe25256073 (DEFAULT_TABLE table=default.Table_fa6e7eb493bf4dbb86702a219a388acb [id=8ae837e4085947f783acb33a801b60cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.827648 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 7fbdda840466420f8d67a8cb5868ba03
I20260811 06:16:51.828346 10328 catalog_manager.cc:6565] ReplaceTablet: tablet 7fbdda840466420f8d67a8cb5868ba03 deleted and replaced by tablet 0874f0e73267446fb873f4619f93307e
I20260811 06:16:51.829582 10618 tablet_service.cc:1467] Processing CreateTablet for tablet b0cdc826a1d8460aba1aae684c13131d (DEFAULT_TABLE table=default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.835217 11530 raft_consensus.cc:482] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.835832 11362 consensus_queue.cc:260] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:51.836968 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:16:51.841538 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 95) took 2564 ms. Trace:
I20260811 06:16:51.846131 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.846467 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccb7050ea9f4cc2a1b924814a204de5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.847506 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d45055341dab44089b2fc3fe25256073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.850400 11371 ts_tablet_manager.cc:1918] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:51.850696 11371 log.cc:1196] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bc53fcee3ed5480f85804f29c94c13f8
I20260811 06:16:51.851889 11371 ts_tablet_manager.cc:1939] T bc53fcee3ed5480f85804f29c94c13f8 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:51.853399 11371 tablet_replica.cc:330] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:51.856976 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (DEFAULT_TABLE table=default.Table_42136fc7f8704bc18984cc34a3514702 [id=8b0b0301a2c646719cae9bc25f613a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.863946 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.864310 11362 ts_tablet_manager.cc:1428] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.161s user 0.004s sys 0.000s
I20260811 06:16:51.866914 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 217f60a1ca044af38f9ee9093e021c27 (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.868417 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb02f61b67147f793b3a2f063d8c56c (DEFAULT_TABLE table=default.Table_3c3274039b55474a90dfb2f66912aff6 [id=5cd54d1a139f4121a3d2ab449eb86c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.868844 11368 rpcz_store.cc:276] 0811 06:16:49.247470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.247653 (+ 183us) service_pool.cc:227] Handling call
0811 06:16:51.807452 (+2559799us) ts_tablet_manager.cc:1145] Deleting tablet cb854704951e4a399267766fb5be40e2
0811 06:16:51.807466 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.811909 (+ 4443us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2545336}
I20260811 06:16:51.869120 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0cdc826a1d8460aba1aae684c13131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.870718 11362 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:51.871290 10619 tablet_service.cc:1467] Processing CreateTablet for tablet a67daf4bdf45464b916905f432f0ec9c (DEFAULT_TABLE table=default.Table_940e7658aef54574be7fd31c40f81ec2 [id=65bf032e717442739e4e712f716e0fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.861819 10608 tablet_service.cc:1467] Processing CreateTablet for tablet eb437660103845aa98af100aef1c3021 (DEFAULT_TABLE table=default.Table_60f9ff39184a401d92a346f88abbd7e3 [id=3d036ef0c0fb497ba15fe0468f792eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.872787 11371 raft_consensus.cc:2229] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.873095 11371 raft_consensus.cc:2258] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:51.873208 10629 tablet_service.cc:1467] Processing CreateTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 (DEFAULT_TABLE table=default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.876748 11365 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:51.878346 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.879258 10614 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.879318 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 14a36a644dc4491dad838ce4e19793ab (DEFAULT_TABLE table=default.Table_3d62247a29ac401fb5d29f5a4ba2dd72 [id=4968af03a1a142288a30bac3f6ac9154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.880587 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.881115 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb02f61b67147f793b3a2f063d8c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.864130 11627 raft_consensus.cc:482] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.891074 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 97) took 2582 ms. Trace:
I20260811 06:16:51.892421 11368 rpcz_store.cc:276] 0811 06:16:49.294108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.294179 (+ 71us) service_pool.cc:227] Handling call
0811 06:16:51.869174 (+2574995us) ts_tablet_manager.cc:1145] Deleting tablet cd7390a2221f4a1b9948c8a1353e4a49
0811 06:16:51.869187 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.876445 (+ 7258us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2539729}
I20260811 06:16:51.892830 11368 tablet_replica.cc:330] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:51.891510 11627 raft_consensus.cc:504] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:51.895133 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 57144ad37b874c91a89a25665a85eeb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 0391df1c64954f66a3987aba9257ca4b) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:51.902184 11365 ts_tablet_manager.cc:1397] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.195s user 0.012s sys 0.037s
I20260811 06:16:51.902067 10602 tablet_service.cc:1467] Processing CreateTablet for tablet dd6584701c23406e83122bd2493b7972 (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.903177 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 8bd026d2c6064a67b1c432efa4474a0e (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.903836 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.904251 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.904911 11627 leader_election.cc:288] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:51.905076 11362 tablet_bootstrap.cc:654] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.910622 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4dba9d9bb4f278b5a43c124c7b509 (DEFAULT_TABLE table=default.Table_d619bfe299b14454abfe4a31106bb81d [id=426356f4c6f6426ab91d0dd3cd349304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.912184 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]) successfully deleted
W20260811 06:16:51.912774 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ac8c5daeb3249e38d863ee94f1267b1 already in progress: creating tablet
I20260811 06:16:51.913844 11368 raft_consensus.cc:2229] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:51.914350 11368 raft_consensus.cc:2258] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:51.918462 10810 leader_election.cc:341] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ff35295f6a4a4f53b8f6af0a0f3c4e29
I20260811 06:16:51.920605 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 (DEFAULT_TABLE table=default.Table_a74689c2487947639884dc54e461cf46 [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.921224 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61114d1bcdb94af7b6c55b0331accee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.927121 11368 ts_tablet_manager.cc:1905] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.934793 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.935513 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4209fc7d2efb415e8794fb33e7f2e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.942005 11365 raft_consensus.cc:348] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.942037 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.943632 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.944078 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 (DEFAULT_TABLE table=default.Table_a74689c2487947639884dc54e461cf46 [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.944411 10620 tablet_service.cc:1467] Processing CreateTablet for tablet d165ac025ce845c6b2b3621caaf01894 (DEFAULT_TABLE table=default.Table_6e207ab6e5fb44668aa0245cedde4b40 [id=93a54bf553fa4e01b74b150cc9a1790b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.944078 10607 tablet_service.cc:1467] Processing CreateTablet for tablet 45ebef95922f4e7f93533b54c07b7cec (DEFAULT_TABLE table=default.Table_1f6ef045b41944bc8268edd5f3832542 [id=416217c8551d4037bf36c99fb5572ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.945415 10614 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.946825 11371 ts_tablet_manager.cc:1905] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:51.947043 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a36a644dc4491dad838ce4e19793ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.946175 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.947930 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.948457 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d (DEFAULT_TABLE table=default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.949388 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd6584701c23406e83122bd2493b7972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.949753 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 0dab2b8209e5401c84a187882ef21e08 (DEFAULT_TABLE table=default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.950588 11635 raft_consensus.cc:482] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:51.950587 11530 raft_consensus.cc:504] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.950863 11635 raft_consensus.cc:504] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.952087 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:51.952477 11635 leader_election.cc:288] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:51.953495 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:51.953821 10665 raft_consensus.cc:2454] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:51.954417 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.954674 11365 raft_consensus.cc:374] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:51.954857 11365 raft_consensus.cc:729] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:51.955689 11365 consensus_queue.cc:260] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:51.956529 11365 ts_tablet_manager.cc:1428] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.054s user 0.001s sys 0.002s
I20260811 06:16:51.959967 11365 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:51.959945 11530 leader_election.cc:288] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:51.960222 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.961064 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.962565 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.962976 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61114d1bcdb94af7b6c55b0331accee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.965699 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ebef95922f4e7f93533b54c07b7cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.966055 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d165ac025ce845c6b2b3621caaf01894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.970024 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d483af5774d842edb46c928a435727d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.971392 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6972e78580ee49178a1c6ce6f017dc52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.971566 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bd026d2c6064a67b1c432efa4474a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.971665 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 45ebef95922f4e7f93533b54c07b7cec (DEFAULT_TABLE table=default.Table_1f6ef045b41944bc8268edd5f3832542 [id=416217c8551d4037bf36c99fb5572ef7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:51.971982 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6972e78580ee49178a1c6ce6f017dc52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.972283 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ebef95922f4e7f93533b54c07b7cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.973598 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4209fc7d2efb415e8794fb33e7f2e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.973491 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c8d20a5f7aac4067a814f33c43709f5f" } new_table_name: "default.Table_8f4b4732c67448209df33512a2495a25" modify_external_catalogs: true
I20260811 06:16:51.974690 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4d5c19d1aa486fa6415907628e6f57 (DEFAULT_TABLE table=default.Table_fc4b03d50c57434da608ba22b5e91522 [id=6145f219b330458381821a6aaeb0fa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.975158 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4d5c19d1aa486fa6415907628e6f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.978243 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e5b4cdeb464861ada487eeb1b901a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.978546 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4dba9d9bb4f278b5a43c124c7b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.978724 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c4379e29a9da4cd2a3822f42fdc76315"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.979445 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4379e29a9da4cd2a3822f42fdc76315 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.980858 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227bc4fd6cd84e5eb2043c52f95d606d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.981009 11365 tablet_bootstrap.cc:654] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:51.981598 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dab2b8209e5401c84a187882ef21e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.985782 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_02e6c8a000bc4169befaa6bac0d45b3f" } new_table_name: "default.Table_9fc91bec335145b987dbe074ac9af84c" modify_external_catalogs: true
I20260811 06:16:51.986032 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcf7c7a470144c0a084aebc2032d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.986375 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e6afac09d27f4629896daa31c8399313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:51.987931 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217f60a1ca044af38f9ee9093e021c27. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:51.988559 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6afac09d27f4629896daa31c8399313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:51.989775 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d483af5774d842edb46c928a435727d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.990690 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.991452 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d0335bdbd99c4dcda7ebedcb066eff67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:51.992049 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0335bdbd99c4dcda7ebedcb066eff67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:51.993458 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a67daf4bdf45464b916905f432f0ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.994217 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb437660103845aa98af100aef1c3021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:51.994802 11046 leader_election.cc:302] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:52.001585 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_03a56dbcc387459a9a6ae4fdfb454c6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.002351 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03a56dbcc387459a9a6ae4fdfb454c6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.004746 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_eab05c1288934064b96562cf11ac2675" } modify_external_catalogs: true
I20260811 06:16:52.005144 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_eab05c1288934064b96562cf11ac2675" } modify_external_catalogs: true
I20260811 06:16:52.006992 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d (DEFAULT_TABLE table=default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.009994 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e8e359f459ab4b79a079b6f990345a9a" } modify_external_catalogs: true
I20260811 06:16:52.010288 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e8e359f459ab4b79a079b6f990345a9a" } modify_external_catalogs: true
W20260811 06:16:52.021394 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae1e42440ff14857b297621ca6031835 consensus state has no leader
W20260811 06:16:52.022609 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59c4e76ecde14d0a86fedc84815e78a7 consensus state has no leader
I20260811 06:16:52.023077 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_29c22b2f708149d4a6421f424db0e8da" } modify_external_catalogs: true
I20260811 06:16:52.023505 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_29c22b2f708149d4a6421f424db0e8da" } modify_external_catalogs: true
I20260811 06:16:52.025522 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6e207ab6e5fb44668aa0245cedde4b40" } new_table_name: "default.Table_fdd68632cc9f41e8943d0a2e509efb44" modify_external_catalogs: true
I20260811 06:16:52.027354 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4cb530bc98f0491895f0802931cba06c" } modify_external_catalogs: true
I20260811 06:16:52.027618 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4cb530bc98f0491895f0802931cba06c" } modify_external_catalogs: true
I20260811 06:16:52.029839 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_88a00b589612427496030c899de53854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.030543 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88a00b589612427496030c899de53854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.034363 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_29660dc47bf14aeda6bf58332ba39430" } new_table_name: "default.Table_f87e6f04862c4ce69e2d6650e87e0618" modify_external_catalogs: true
I20260811 06:16:52.021976 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3602836ee9884ec38d9454df8b4e628c" } new_table_name: "default.Table_b5e09f3c2ab94dd8be45a8aaf7697433" modify_external_catalogs: true
I20260811 06:16:52.042425 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d2138c3da06245bcbed00c854667b9ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.043684 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2138c3da06245bcbed00c854667b9ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.046440 10609 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce (DEFAULT_TABLE table=default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:51.973577 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.047062 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad5529d4844f61b0888624e7c8b3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.055007 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1e89b093b0db4f3e8d0d549e42069605"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.055794 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e89b093b0db4f3e8d0d549e42069605 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.060215 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a378a6f20c564eb685b655a762b638ae
I20260811 06:16:52.061043 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f4f14a0add084048b92a501476ad6588
I20260811 06:16:52.061848 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_df5cfd277a4d425a84441c5670b812f5" } modify_external_catalogs: true
I20260811 06:16:52.062232 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_df5cfd277a4d425a84441c5670b812f5" } modify_external_catalogs: true
I20260811 06:16:52.071687 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f5ad5529d4844f61b0888624e7c8b3ce
W20260811 06:16:52.079749 11046 consensus_peers.cc:487] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57144ad37b874c91a89a25665a85eeb2. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.081286 11479 raft_consensus.cc:504] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.083705 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (DEFAULT_TABLE table=default.Table_42136fc7f8704bc18984cc34a3514702 [id=8b0b0301a2c646719cae9bc25f613a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.083948 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb02f61b67147f793b3a2f063d8c56c (DEFAULT_TABLE table=default.Table_3c3274039b55474a90dfb2f66912aff6 [id=5cd54d1a139f4121a3d2ab449eb86c85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.090528 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4d5c19d1aa486fa6415907628e6f57 (DEFAULT_TABLE table=default.Table_fc4b03d50c57434da608ba22b5e91522 [id=6145f219b330458381821a6aaeb0fa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.091259 11094 tablet_service.cc:1467] Processing CreateTablet for tablet dd6584701c23406e83122bd2493b7972 (DEFAULT_TABLE table=default.Table_dcc767edfa7645179a1784037ed2909d [id=f1e28a412606439d97b23c7a273d94e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.094152 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (DEFAULT_TABLE table=default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.097357 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4d5c19d1aa486fa6415907628e6f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.088088 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff35295f6a4a4f53b8f6af0a0f3c4e29" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.088876 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 217f60a1ca044af38f9ee9093e021c27 (DEFAULT_TABLE table=default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.092881 11103 tablet_service.cc:1467] Processing CreateTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 (DEFAULT_TABLE table=default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.100951 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 0dab2b8209e5401c84a187882ef21e08 (DEFAULT_TABLE table=default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.098491 11102 tablet_service.cc:1467] Processing CreateTablet for tablet d165ac025ce845c6b2b3621caaf01894 (DEFAULT_TABLE table=default.Table_6e207ab6e5fb44668aa0245cedde4b40 [id=93a54bf553fa4e01b74b150cc9a1790b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.099303 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (DEFAULT_TABLE table=default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:52.101931 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 83737.1us
I20260811 06:16:52.104031 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:52.102582 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 40c31ffb11484783bca9263c947f37da (DEFAULT_TABLE table=default.Table_ca2a465c1d9f4cd795b051d2a16f84d9 [id=60dc9ff63a44445687155bcf4f239507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.104785 11128 tablet_service.cc:1467] Processing CreateTablet for tablet a67daf4bdf45464b916905f432f0ec9c (DEFAULT_TABLE table=default.Table_940e7658aef54574be7fd31c40f81ec2 [id=65bf032e717442739e4e712f716e0fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.101325 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4dba9d9bb4f278b5a43c124c7b509 (DEFAULT_TABLE table=default.Table_d619bfe299b14454abfe4a31106bb81d [id=426356f4c6f6426ab91d0dd3cd349304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.107851 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 14a36a644dc4491dad838ce4e19793ab (DEFAULT_TABLE table=default.Table_3d62247a29ac401fb5d29f5a4ba2dd72 [id=4968af03a1a142288a30bac3f6ac9154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.107518 10871 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce (DEFAULT_TABLE table=default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.109894 11479 leader_election.cc:288] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:52.110229 11153 raft_consensus.cc:2379] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:52.109157 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.110909 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 8bd026d2c6064a67b1c432efa4474a0e (DEFAULT_TABLE table=default.Table_e83ccea892504992b1e3339408fb4cd2 [id=04cae46b1a9844d6b9924d529d8fb387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.111824 11698 raft_consensus.cc:2781] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:52.097884 11119 tablet_service.cc:1467] Processing CreateTablet for tablet eb437660103845aa98af100aef1c3021 (DEFAULT_TABLE table=default.Table_60f9ff39184a401d92a346f88abbd7e3 [id=3d036ef0c0fb497ba15fe0468f792eab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.109043 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 40c31ffb11484783bca9263c947f37da (DEFAULT_TABLE table=default.Table_ca2a465c1d9f4cd795b051d2a16f84d9 [id=60dc9ff63a44445687155bcf4f239507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.114041 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.115443 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c31ffb11484783bca9263c947f37da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.117877 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb02f61b67147f793b3a2f063d8c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.121203 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc (DEFAULT_TABLE table=default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.126150 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.130249 11361 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:52.130539 11361 ts_tablet_manager.cc:1397] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.680s user 0.020s sys 0.033s
I20260811 06:16:52.131901 11361 raft_consensus.cc:348] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.132280 11361 raft_consensus.cc:374] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.132479 11361 raft_consensus.cc:729] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.132915 11361 consensus_queue.cc:260] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.133472 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.136113 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:52.135681 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532208d7a02d448e8dac702ffe6c2ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.136649 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 844e735c671440c5bfe1035068c7334e (DEFAULT_TABLE table=default.Table_4564bda35a5f4fdc9338a844c1d39733 [id=60579e2911f54f6eada4bb1ee1da78d1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:52.137830 10555 leader_election.cc:341] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.138670 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc (DEFAULT_TABLE table=default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.135313 11479 consensus_queue.cc:1035] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260811 06:16:52.132970 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f (DEFAULT_TABLE table=default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.133666 11698 raft_consensus.cc:482] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:52.140895 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.134886 11046 consensus_peers.cc:487] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbab2b67ef434ebebe7fe947e9c4ff66. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.143328 11163 raft_consensus.cc:2379] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:16:52.147266 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca903ee846a4e5baf3dbb4302607c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.148064 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f (DEFAULT_TABLE table=default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.148762 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:52.151034 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet cb854704951e4a399267766fb5be40e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb854704951e4a399267766fb5be40e2 already in progress: creating tablet
I20260811 06:16:52.147558 10619 tablet_service.cc:1467] Processing CreateTablet for tablet 844e735c671440c5bfe1035068c7334e (DEFAULT_TABLE table=default.Table_4564bda35a5f4fdc9338a844c1d39733 [id=60579e2911f54f6eada4bb1ee1da78d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.150982 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.155941 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.156250 11698 raft_consensus.cc:3037] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:52.156468 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844e735c671440c5bfe1035068c7334e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.157106 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a67daf4bdf45464b916905f432f0ec9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.158038 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bd026d2c6064a67b1c432efa4474a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.158928 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d165ac025ce845c6b2b3621caaf01894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.159584 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb437660103845aa98af100aef1c3021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.160030 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 217f60a1ca044af38f9ee9093e021c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.160718 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e5b4cdeb464861ada487eeb1b901a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.160863 11046 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:52.163072 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 0874f0e73267446fb873f4619f93307e (DEFAULT_TABLE table=default.Table_a8113f59c0e34eb5874fb236cd107426 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.169795 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227bc4fd6cd84e5eb2043c52f95d606d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.170959 11627 raft_consensus.cc:482] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:52.171811 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.173008 11627 raft_consensus.cc:504] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.173727 11627 leader_election.cc:288] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:52.174336 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca903ee846a4e5baf3dbb4302607c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.176508 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:52.180007 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 (DEFAULT_TABLE table=default.Table_a74689c2487947639884dc54e461cf46 [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.183434 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4dba9d9bb4f278b5a43c124c7b509 (DEFAULT_TABLE table=default.Table_d619bfe299b14454abfe4a31106bb81d [id=426356f4c6f6426ab91d0dd3cd349304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.187917 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14a36a644dc4491dad838ce4e19793ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.198148 11698 raft_consensus.cc:504] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.210739 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:52.218706 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 45ebef95922f4e7f93533b54c07b7cec (DEFAULT_TABLE table=default.Table_1f6ef045b41944bc8268edd5f3832542 [id=416217c8551d4037bf36c99fb5572ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.220471 11370 ts_tablet_manager.cc:1918] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:52.220901 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 0dab2b8209e5401c84a187882ef21e08 (DEFAULT_TABLE table=default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.222201 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd6584701c23406e83122bd2493b7972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.222975 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 (DEFAULT_TABLE table=default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.224637 11698 leader_election.cc:288] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:52.225014 11361 ts_tablet_manager.cc:1428] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.042s user 0.002s sys 0.002s
I20260811 06:16:52.225435 11361 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:52.238448 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4dba9d9bb4f278b5a43c124c7b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.247685 11101 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce (DEFAULT_TABLE table=default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:52.248505 11047 consensus_peers.cc:487] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee0f6ba0c08149f981fe27c5d40346cc. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.252414 11370 log.cc:1196] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bf1a831788df4431b32c07c1e18b2c4a
I20260811 06:16:52.252537 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dab2b8209e5401c84a187882ef21e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.263191 11370 ts_tablet_manager.cc:1939] T bf1a831788df4431b32c07c1e18b2c4a P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:52.273208 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad5529d4844f61b0888624e7c8b3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.277801 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4d5c19d1aa486fa6415907628e6f57 (DEFAULT_TABLE table=default.Table_fc4b03d50c57434da608ba22b5e91522 [id=6145f219b330458381821a6aaeb0fa0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.279083 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 99) took 2770 ms. Trace:
I20260811 06:16:52.279349 11370 rpcz_store.cc:276] 0811 06:16:49.494052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.494332 (+ 280us) service_pool.cc:227] Handling call
0811 06:16:51.493806 (+1999474us) ts_tablet_manager.cc:1145] Deleting tablet bf1a831788df4431b32c07c1e18b2c4a
0811 06:16:51.493820 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.811304 (+317484us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.203588 (+392284us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.264253 (+ 60665us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1999295}
I20260811 06:16:52.280241 11370 tablet_replica.cc:330] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:52.280783 11370 raft_consensus.cc:2229] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.290897 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcf7c7a470144c0a084aebc2032d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.294106 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4d5c19d1aa486fa6415907628e6f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.176405 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:52.297149 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844e735c671440c5bfe1035068c7334e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.301182 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61114d1bcdb94af7b6c55b0331accee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.306000 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45ebef95922f4e7f93533b54c07b7cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.306808 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 0874f0e73267446fb873f4619f93307e (DEFAULT_TABLE table=default.Table_a8113f59c0e34eb5874fb236cd107426 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.311064 10813 leader_election.cc:302] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.311355 10813 raft_consensus.cc:2670] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.310567 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 0cec2c3e143a4834a07aef7a31340d9c (DEFAULT_TABLE table=default.Table_695c2233e5f54b8da16c476efb46a8fc [id=1e600dca3e674ce18101f1005808f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.313908 11627 raft_consensus.cc:482] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:52.314075 11627 raft_consensus.cc:504] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:52.314729 11627 leader_election.cc:288] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:52.315327 10921 raft_consensus.cc:3037] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:52.316532 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:52.317816 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (DEFAULT_TABLE table=default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.318363 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.323187 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd7390a2221f4a1b9948c8a1353e4a49" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.323601 11163 raft_consensus.cc:2454] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:52.324766 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.325124 11163 raft_consensus.cc:2379] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:52.332679 11370 raft_consensus.cc:2258] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.332928 11635 raft_consensus.cc:482] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:52.333238 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d165ac025ce845c6b2b3621caaf01894 consensus state has no leader
I20260811 06:16:52.333993 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d1d83013125d4639944453abb28be339" } new_table_name: "default.Table_24b24206598e4f27a32cabb7ed03ed3e" modify_external_catalogs: true
W20260811 06:16:52.329592 11047 leader_election.cc:341] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.336100 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 0cec2c3e143a4834a07aef7a31340d9c (DEFAULT_TABLE table=default.Table_695c2233e5f54b8da16c476efb46a8fc [id=1e600dca3e674ce18101f1005808f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.338784 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5d578b33478a413dac2573d652e6b411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:52.339745 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e689150437054d989696612d76a1685c" } new_table_name: "default.Table_21d24fd15819465b9ffd735474698380" modify_external_catalogs: true
I20260811 06:16:52.344909 11635 raft_consensus.cc:504] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:52.351042 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d578b33478a413dac2573d652e6b411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:52.358299 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 100041us
I20260811 06:16:52.365513 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.362380 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:52.367118 11635 leader_election.cc:288] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:52.371176 10810 leader_election.cc:341] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:52.372167 11635 raft_consensus.cc:482] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:52.372306 11362 tablet_bootstrap.cc:492] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
W20260811 06:16:52.372779 10810 leader_election.cc:341] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:52.372228 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b681f10c3de4bd798b9d519f10da103" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:52.373435 11362 ts_tablet_manager.cc:1397] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.508s user 0.010s sys 0.010s
I20260811 06:16:52.378176 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad5529d4844f61b0888624e7c8b3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.378746 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fcf7c7a470144c0a084aebc2032d896. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.379078 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0874f0e73267446fb873f4619f93307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.373123 11635 raft_consensus.cc:504] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.382156 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cec2c3e143a4834a07aef7a31340d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.383849 11635 leader_election.cc:288] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:52.384176 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d04b025b1b45009260ddd9f1b0aabb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:52.384461 10664 raft_consensus.cc:3037] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:52.386006 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532208d7a02d448e8dac702ffe6c2ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.389204 10664 raft_consensus.cc:2454] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:52.392169 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c31ffb11484783bca9263c947f37da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.394390 10555 leader_election.cc:341] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.409085 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:52.409416 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:52.409597 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:52.409776 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:52.415710 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ae1e42440ff14857b297621ca6031835 (table default.Table_8f4b4732c67448209df33512a2495a25 [id=23ec4328fe004a8ab2e8cff534a30e0b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet ae1e42440ff14857b297621ca6031835 consensus state has no leader
I20260811 06:16:52.428905 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4dba9d9bb4f278b5a43c124c7b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.429642 11362 raft_consensus.cc:348] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:52.432124 11362 raft_consensus.cc:374] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.433139 11362 raft_consensus.cc:729] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.433601 11362 consensus_queue.cc:260] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:52.437518 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0dab2b8209e5401c84a187882ef21e08. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.456122 10310 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.125:35327, user_credentials={real_user=slave}} blocked reactor thread for 126131us
I20260811 06:16:52.469951 11362 ts_tablet_manager.cc:1428] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.067s user 0.004s sys 0.000s
I20260811 06:16:52.470280 11635 raft_consensus.cc:482] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:52.470446 11362 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:52.471604 11635 raft_consensus.cc:504] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.482824 11635 leader_election.cc:288] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:52.485476 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0530ec053f47df800cf2abf549b068" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:52.495932 10555 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.512298 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d6641dd44340889879d3b92018b3f0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:52.514758 10555 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.526088 11362 tablet_bootstrap.cc:654] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.538527 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d (DEFAULT_TABLE table=default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.538165 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:52.541218 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 82300us
I20260811 06:16:52.544664 11370 ts_tablet_manager.cc:1905] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:52.546556 11047 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.546731 11047 leader_election.cc:302] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:52.547288 11046 consensus_peers.cc:487] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef8b262229dd4b26b862527d2e17cb27. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.549078 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 227bc4fd6cd84e5eb2043c52f95d606d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.550511 11047 leader_election.cc:341] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.551344 11698 consensus_queue.cc:1035] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:52.551957 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 40c31ffb11484783bca9263c947f37da (DEFAULT_TABLE table=default.Table_ca2a465c1d9f4cd795b051d2a16f84d9 [id=60dc9ff63a44445687155bcf4f239507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.552379 11582 raft_consensus.cc:2726] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:16:52.552600 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4209fc7d2efb415e8794fb33e7f2e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.553577 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40c31ffb11484783bca9263c947f37da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.558712 11365 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.514s user 0.024s sys 0.077s
W20260811 06:16:52.559168 11365 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.517s user 0.024s sys 0.077s
I20260811 06:16:52.560333 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0874f0e73267446fb873f4619f93307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.563550 11762 raft_consensus.cc:482] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:52.564705 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cec2c3e143a4834a07aef7a31340d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.567584 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc (DEFAULT_TABLE table=default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.568202 11368 ts_tablet_manager.cc:1918] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.570254 11365 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:52.564668 11762 raft_consensus.cc:504] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.572429 11365 ts_tablet_manager.cc:1397] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.614s user 0.027s sys 0.082s
I20260811 06:16:52.577409 11365 raft_consensus.cc:348] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.578922 11365 raft_consensus.cc:374] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.579337 11365 raft_consensus.cc:729] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.579923 11365 consensus_queue.cc:260] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.583314 11046 leader_election.cc:302] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:52.577282 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57144ad37b874c91a89a25665a85eeb2" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.588383 11729 raft_consensus.cc:2781] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:52.588625 11729 raft_consensus.cc:686] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:52.588939 11729 consensus_queue.cc:237] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.589655 11368 log.cc:1196] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ff35295f6a4a4f53b8f6af0a0f3c4e29
I20260811 06:16:52.595844 11368 ts_tablet_manager.cc:1939] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:52.603349 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 98) took 3274 ms. Trace:
I20260811 06:16:52.586580 11371 ts_tablet_manager.cc:1918] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.585707 11365 ts_tablet_manager.cc:1428] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.011s user 0.002s sys 0.002s
I20260811 06:16:52.610134 11371 log.cc:1196] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:52.610594 11371 ts_tablet_manager.cc:1939] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.598179 11762 leader_election.cc:288] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:52.611442 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 174) took 1331 ms. Trace:
I20260811 06:16:52.611608 11371 rpcz_store.cc:276] 0811 06:16:51.280295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.285849 (+ 5554us) service_pool.cc:227] Handling call
0811 06:16:51.853286 (+567437us) ts_tablet_manager.cc:1145] Deleting tablet 11c50f909aad4bb991bfdeae8eab8455
0811 06:16:51.853294 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.399477 (+546183us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.586453 (+186976us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.611374 (+ 24921us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":567209}
I20260811 06:16:52.612811 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 187) took 1188 ms. Trace:
I20260811 06:16:52.612162 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f (DEFAULT_TABLE table=default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.612984 11371 rpcz_store.cc:276] 0811 06:16:51.424739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.424857 (+ 118us) service_pool.cc:227] Handling call
0811 06:16:52.612622 (+1187765us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:16:52.612632 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.612751 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185538}
I20260811 06:16:52.613497 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 189) took 1182 ms. Trace:
I20260811 06:16:52.613657 11371 rpcz_store.cc:276] 0811 06:16:51.431271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.431391 (+ 120us) service_pool.cc:227] Handling call
0811 06:16:52.613347 (+1181956us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:16:52.613356 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.613446 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1178892}
I20260811 06:16:52.613813 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 844e735c671440c5bfe1035068c7334e (DEFAULT_TABLE table=default.Table_4564bda35a5f4fdc9338a844c1d39733 [id=60579e2911f54f6eada4bb1ee1da78d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.614250 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 188) took 1183 ms. Trace:
I20260811 06:16:52.614404 11371 rpcz_store.cc:276] 0811 06:16:51.431081 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.431424 (+ 343us) service_pool.cc:227] Handling call
0811 06:16:52.614098 (+1182674us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:16:52.614108 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.614199 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177949}
I20260811 06:16:52.615371 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 191) took 1177 ms. Trace:
I20260811 06:16:52.615562 11371 rpcz_store.cc:276] 0811 06:16:51.438025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.438125 (+ 100us) service_pool.cc:227] Handling call
0811 06:16:52.614821 (+1176696us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:16:52.614830 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.615018 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174656}
I20260811 06:16:52.615723 11365 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:52.616080 11371 tablet_replica.cc:330] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.616321 11371 raft_consensus.cc:2229] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.616600 11371 raft_consensus.cc:2258] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.617246 11371 ts_tablet_manager.cc:1905] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.624572 11371 ts_tablet_manager.cc:1918] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.629228 11368 rpcz_store.cc:276] 0811 06:16:49.329162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.329490 (+ 328us) service_pool.cc:227] Handling call
0811 06:16:51.892739 (+2563249us) ts_tablet_manager.cc:1145] Deleting tablet ff35295f6a4a4f53b8f6af0a0f3c4e29
0811 06:16:51.892754 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:51.914107 (+ 21353us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x6150000b57a4. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f194748504d 00007f19487295ec 00007f194b0b82e6 00007f194b0ea404 00007f194b0cb870 00007f194b0cb5fd 00000000009edb7c 00007f193bf8f344 00007f193bf9291b 00007f193bf92798
0811 06:16:52.325338 (+411231us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.548484 (+223146us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.603250 (+ 54766us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4704128,"tablet-delete.queue_time_us":2558872}
I20260811 06:16:52.630761 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 0874f0e73267446fb873f4619f93307e (DEFAULT_TABLE table=default.Table_a8113f59c0e34eb5874fb236cd107426 [id=b582c8dd39f849cf8dd18e3aa7d41658]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.632022 11371 log.cc:1196] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/94d04b025b1b45009260ddd9f1b0aabb
I20260811 06:16:52.632870 11371 ts_tablet_manager.cc:1939] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.633275 11368 tablet_replica.cc:330] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:52.634037 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 190) took 1202 ms. Trace:
I20260811 06:16:52.634809 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.634912 11371 rpcz_store.cc:276] 0811 06:16:51.437841 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.438154 (+ 313us) service_pool.cc:227] Handling call
0811 06:16:52.616000 (+1177846us) ts_tablet_manager.cc:1145] Deleting tablet 94d04b025b1b45009260ddd9f1b0aabb
0811 06:16:52.616009 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.620839 (+ 4830us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.624440 (+ 3601us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.633997 (+ 9557us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1174936}
I20260811 06:16:52.636195 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 192) took 1197 ms. Trace:
I20260811 06:16:52.636861 11371 rpcz_store.cc:276] 0811 06:16:51.438909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.439469 (+ 560us) service_pool.cc:227] Handling call
0811 06:16:52.636004 (+1196535us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:16:52.636018 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.636149 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1188346}
I20260811 06:16:52.640753 11371 tablet_replica.cc:330] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.642194 11368 raft_consensus.cc:2229] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.642586 10921 raft_consensus.cc:3037] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:52.644228 11371 raft_consensus.cc:2229] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.644625 11371 raft_consensus.cc:2258] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.645973 11371 ts_tablet_manager.cc:1905] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.647339 11365 tablet_bootstrap.cc:654] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.649053 11368 raft_consensus.cc:2258] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.664008 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.664229 11362 tablet_bootstrap.cc:492] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:52.664502 11371 ts_tablet_manager.cc:1918] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.664788 11368 ts_tablet_manager.cc:1905] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.665516 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.665988 11479 consensus_queue.cc:1035] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:52.667608 11362 ts_tablet_manager.cc:1397] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.194s user 0.016s sys 0.003s
I20260811 06:16:52.669076 11362 raft_consensus.cc:348] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.669894 11371 log.cc:1196] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/cb854704951e4a399267766fb5be40e2
I20260811 06:16:52.670245 11362 raft_consensus.cc:374] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.670548 11362 raft_consensus.cc:729] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.669687 11361 tablet_bootstrap.cc:654] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.670851 11371 ts_tablet_manager.cc:1939] T cb854704951e4a399267766fb5be40e2 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.671164 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532208d7a02d448e8dac702ffe6c2ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.672297 11362 consensus_queue.cc:260] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.675618 11362 ts_tablet_manager.cc:1428] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.002s sys 0.002s
I20260811 06:16:52.677750 11371 tablet_replica.cc:330] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.678038 11371 raft_consensus.cc:2229] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.678447 11371 raft_consensus.cc:2258] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.683060 11371 ts_tablet_manager.cc:1905] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.685071 11362 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:52.684870 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff1ad74f2034ed9b24c9712bae14cd3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:52.674136 10813 leader_election.cc:341] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:52.686184 10813 leader_election.cc:302] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.686571 10813 raft_consensus.cc:2670] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.687592 10813 leader_election.cc:302] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:52.689108 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca903ee846a4e5baf3dbb4302607c1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:52.692934 10555 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.694749 11627 raft_consensus.cc:2726] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:52.696219 11371 ts_tablet_manager.cc:1918] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.698693 11371 log.cc:1196] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1ff1ad74f2034ed9b24c9712bae14cd3
I20260811 06:16:52.699452 11371 ts_tablet_manager.cc:1939] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.702490 11371 tablet_replica.cc:330] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:16:52.698746 11047 consensus_peers.cc:487] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.703099 11371 raft_consensus.cc:2229] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.703127 11362 tablet_bootstrap.cc:654] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.707007 11371 raft_consensus.cc:2258] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.708580 11371 ts_tablet_manager.cc:1905] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.709070 11479 consensus_queue.cc:1035] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 06:16:52.710580 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844e735c671440c5bfe1035068c7334e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.721088 11365 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:52.724654 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0874f0e73267446fb873f4619f93307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.721701 11365 ts_tablet_manager.cc:1397] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.107s user 0.014s sys 0.007s
I20260811 06:16:52.728540 11371 ts_tablet_manager.cc:1918] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.731007 11371 log.cc:1196] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/5d0530ec053f47df800cf2abf549b068
I20260811 06:16:52.731689 11371 ts_tablet_manager.cc:1939] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.731979 11365 raft_consensus.cc:348] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.733399 11365 raft_consensus.cc:374] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.734093 11365 raft_consensus.cc:729] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.736295 11371 tablet_replica.cc:330] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.735522 11365 consensus_queue.cc:260] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.738837 11365 ts_tablet_manager.cc:1428] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260811 06:16:52.739976 11371 raft_consensus.cc:2229] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.743269 11371 raft_consensus.cc:2258] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.744166 11371 ts_tablet_manager.cc:1905] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.742029 11365 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:52.752712 11362 tablet_bootstrap.cc:492] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:52.753000 11362 ts_tablet_manager.cc:1397] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.006s
I20260811 06:16:52.756472 11365 tablet_bootstrap.cc:654] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.759835 11362 raft_consensus.cc:348] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.760497 11362 raft_consensus.cc:374] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.761003 11362 raft_consensus.cc:729] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.761359 11362 consensus_queue.cc:260] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.762795 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 0cec2c3e143a4834a07aef7a31340d9c (DEFAULT_TABLE table=default.Table_695c2233e5f54b8da16c476efb46a8fc [id=1e600dca3e674ce18101f1005808f016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:52.763692 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cec2c3e143a4834a07aef7a31340d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:52.765074 11371 ts_tablet_manager.cc:1918] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.766106 11371 log.cc:1196] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:52.766776 11371 ts_tablet_manager.cc:1939] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.767068 11362 ts_tablet_manager.cc:1428] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260811 06:16:52.768119 11370 ts_tablet_manager.cc:1918] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.768533 11370 log.cc:1196] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ff35295f6a4a4f53b8f6af0a0f3c4e29
I20260811 06:16:52.768671 11371 tablet_replica.cc:330] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.769309 11370 ts_tablet_manager.cc:1939] T ff35295f6a4a4f53b8f6af0a0f3c4e29 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:52.771320 11362 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:52.774581 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bf1a831788df4431b32c07c1e18b2c4a (table default.Table_39c740d7852b4e1898570b4807ba19b7 [id=bf02bdd01cb94183b26152a31fb90461]) successfully deleted
I20260811 06:16:52.775398 11362 tablet_bootstrap.cc:654] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.780160 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b681f10c3de4bd798b9d519f10da103" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.780737 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d6641dd44340889879d3b92018b3f0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.781416 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff1ad74f2034ed9b24c9712bae14cd3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.782131 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0530ec053f47df800cf2abf549b068" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:52.784541 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 11c50f909aad4bb991bfdeae8eab8455 (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
W20260811 06:16:52.785974 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3250276181a24e58a2db92376b7520e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3250276181a24e58a2db92376b7520e7 already in progress: creating tablet
W20260811 06:16:52.786317 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 16674be53bd54f9395b650e19edd3cf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16674be53bd54f9395b650e19edd3cf4 already in progress: creating tablet
W20260811 06:16:52.790006 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f243c792a634abf83484aef820dbb48 already in progress: creating tablet
W20260811 06:16:52.790550 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e873e2f7b3d34988856b3be044de1ed7 already in progress: creating tablet
I20260811 06:16:52.791010 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 94d04b025b1b45009260ddd9f1b0aabb (table default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
W20260811 06:16:52.791463 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet dc6254bf781740019c3f71b26179f25d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6254bf781740019c3f71b26179f25d already in progress: creating tablet
I20260811 06:16:52.791923 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet cb854704951e4a399267766fb5be40e2 (table default.Table_f855f0704b4a4ffdb05fc1987726f090 [id=fb4d89cc1c0346e282b734a2c8a070b0]) successfully deleted
I20260811 06:16:52.792335 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1ff1ad74f2034ed9b24c9712bae14cd3 (table default.Table_0afd45a96d354605b528113aa162a7d4 [id=3dcac6ff3c0346e194219b87e4945063]) successfully deleted
I20260811 06:16:52.793129 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 5d0530ec053f47df800cf2abf549b068 (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
W20260811 06:16:52.793665 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6c62cbef937a46dfbc4dbf934e887139 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c62cbef937a46dfbc4dbf934e887139 already in progress: creating tablet
I20260811 06:16:52.794045 11368 ts_tablet_manager.cc:1918] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:52.794235 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 52543aa31a1749d1a0fd5e48cbe30889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52543aa31a1749d1a0fd5e48cbe30889 already in progress: creating tablet
W20260811 06:16:52.794454 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 217f60a1ca044af38f9ee9093e021c27 already in progress: creating tablet
W20260811 06:16:52.794633 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c5efe8eb16e84575abd18a5079aad2c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5efe8eb16e84575abd18a5079aad2c9 already in progress: creating tablet
I20260811 06:16:52.794476 11368 log.cc:1196] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/7368c0252cf84fe6831dc07eb173a7d6
I20260811 06:16:52.794821 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 5b681f10c3de4bd798b9d519f10da103 (table default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 [id=783d0e401b2a42b1adf7bbbaa13eed9c]) successfully deleted
I20260811 06:16:52.795384 11368 ts_tablet_manager.cc:1939] T 7368c0252cf84fe6831dc07eb173a7d6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:52.797540 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:16:52.799640 11371 raft_consensus.cc:2229] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.800079 11371 raft_consensus.cc:2258] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.800185 10564 leader_election.cc:302] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:52.801151 11371 ts_tablet_manager.cc:1905] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:52.805788 10564 raft_consensus.cc:2670] T 11c50f909aad4bb991bfdeae8eab8455 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.806545 10564 leader_election.cc:302] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:16:52.806767 10564 raft_consensus.cc:2670] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.807029 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:52.807051 10564 leader_election.cc:302] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.807422 10564 raft_consensus.cc:2670] T 94d04b025b1b45009260ddd9f1b0aabb P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260811 06:16:52.808017 10564 leader_election.cc:341] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.808159 10564 leader_election.cc:302] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.808317 10564 raft_consensus.cc:2670] T 5b681f10c3de4bd798b9d519f10da103 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.808836 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352]). Expected version 5 got 0
W20260811 06:16:52.808920 10564 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.809053 10564 leader_election.cc:302] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:52.809202 11371 ts_tablet_manager.cc:1918] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.809342 11371 log.cc:1196] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:52.809482 11762 raft_consensus.cc:2726] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:52.809820 11371 ts_tablet_manager.cc:1939] T cd7390a2221f4a1b9948c8a1353e4a49 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:52.810843 10564 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.812077 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 96) took 3319 ms. Trace:
I20260811 06:16:52.812201 11371 tablet_replica.cc:330] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:52.812491 10564 leader_election.cc:302] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.813136 10564 raft_consensus.cc:2670] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260811 06:16:52.814194 10564 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:52.815397 10564 leader_election.cc:302] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:52.815768 10564 raft_consensus.cc:2670] T 5d0530ec053f47df800cf2abf549b068 P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:16:52.820432 11365 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:16:52.821108 10310 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260811 06:16:52.821836 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet cd7390a2221f4a1b9948c8a1353e4a49 (table default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]) successfully deleted
I20260811 06:16:52.822324 11365 ts_tablet_manager.cc:1397] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.007s
W20260811 06:16:52.823035 10310 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 -> Peer a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327): Couldn't send request to peer a36d6d06a0cb4489b5014178b9973219. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.125:35327: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 06:16:52.823482 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7fbdda840466420f8d67a8cb5868ba03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fbdda840466420f8d67a8cb5868ba03 already in progress: creating tablet
I20260811 06:16:52.813925 11371 raft_consensus.cc:2229] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:52.824225 11371 raft_consensus.cc:2258] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:52.825549 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4d44dea35e94ed788b7e1e5a8a24d8e already in progress: creating tablet
I20260811 06:16:52.828102 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet cbab2b67ef434ebebe7fe947e9c4ff66 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c5fa9633057485b917f117819d79398) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:52.828414 11046 consensus_peers.cc:487] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee0f6ba0c08149f981fe27c5d40346cc. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.828513 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:52.827613 11370 rpcz_store.cc:276] 0811 06:16:49.493004 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.494092 (+ 1088us) service_pool.cc:227] Handling call
0811 06:16:52.280021 (+2785929us) ts_tablet_manager.cc:1145] Deleting tablet ff35295f6a4a4f53b8f6af0a0f3c4e29
0811 06:16:52.280034 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.649144 (+369110us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.767906 (+118762us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.811961 (+ 44055us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28969,"tablet-delete.queue_time_us":2780954}
W20260811 06:16:52.829133 10810 consensus_peers.cc:487] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc53fcee3ed5480f85804f29c94c13f8. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:52.830219 11370 tablet_replica.cc:330] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:52.831749 11371 ts_tablet_manager.cc:1905] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.834098 11370 raft_consensus.cc:2229] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:52.834581 11370 raft_consensus.cc:2258] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:52.834347 11365 raft_consensus.cc:348] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.839361 11365 raft_consensus.cc:374] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.840958 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:52.841073 11370 ts_tablet_manager.cc:1905] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.841920 11365 raft_consensus.cc:729] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.843447 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:52.849267 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 847df543db4244a6b2900fc16fea7c07 consensus state has no leader
I20260811 06:16:52.842935 11365 consensus_queue.cc:260] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.867853 11365 ts_tablet_manager.cc:1428] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260811 06:16:52.871773 11365 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:52.875825 11370 ts_tablet_manager.cc:1918] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:52.877745 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 99) took 3519 ms. Trace:
I20260811 06:16:52.877981 11368 rpcz_store.cc:276] 0811 06:16:49.358043 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.363933 (+ 5890us) service_pool.cc:227] Handling call
0811 06:16:52.630036 (+3266103us) ts_tablet_manager.cc:1145] Deleting tablet 7368c0252cf84fe6831dc07eb173a7d6
0811 06:16:52.630054 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.703810 (+ 73756us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.793812 (+ 90002us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.877334 (+ 83522us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3234800}
I20260811 06:16:52.878727 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 7368c0252cf84fe6831dc07eb173a7d6 (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]) successfully deleted
I20260811 06:16:52.879274 11368 tablet_replica.cc:330] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:52.879834 11368 raft_consensus.cc:2229] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:52.880405 11371 ts_tablet_manager.cc:1918] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:52.880693 11368 pending_rounds.cc:62] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:16:52.888468 11370 log.cc:1196] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c4b809805d1e43128b5b18f558002036
I20260811 06:16:52.888981 11371 log.cc:1196] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:52.889045 11370 ts_tablet_manager.cc:1939] T c4b809805d1e43128b5b18f558002036 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:52.889477 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 107) took 3362 ms. Trace:
I20260811 06:16:52.889592 11370 rpcz_store.cc:276] 0811 06:16:49.527142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.527211 (+ 69us) service_pool.cc:227] Handling call
0811 06:16:52.829316 (+3302105us) ts_tablet_manager.cc:1145] Deleting tablet c4b809805d1e43128b5b18f558002036
0811 06:16:52.829332 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:52.868675 (+ 39343us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.875685 (+ 7010us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:52.889418 (+ 13733us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3301725}
I20260811 06:16:52.890005 11370 tablet_replica.cc:330] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:52.892980 11371 ts_tablet_manager.cc:1939] T b1d6641dd44340889879d3b92018b3f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:52.896310 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet b1d6641dd44340889879d3b92018b3f0 (table default.Table_35412a7c2bd54e9d95217170b0e53051 [id=ccf560e77b2a45bd81fc1f5d3c03fe08]) successfully deleted
W20260811 06:16:52.899397 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a378a6f20c564eb685b655a762b638ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a378a6f20c564eb685b655a762b638ae already in progress: creating tablet
I20260811 06:16:52.903426 11816 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260811 06:16:52.909672 11370 raft_consensus.cc:2229] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:52.910177 11370 raft_consensus.cc:2258] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:52.910663 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f4f14a0add084048b92a501476ad6588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f14a0add084048b92a501476ad6588 already in progress: creating tablet
W20260811 06:16:52.911857 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ad5529d4844f61b0888624e7c8b3ce already in progress: creating tablet
I20260811 06:16:52.912830 11370 ts_tablet_manager.cc:1905] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:52.914646 11365 tablet_bootstrap.cc:654] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:52.915232 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc3091f8a8f9442da50b17d4752cedb0 already in progress: creating tablet
I20260811 06:16:52.918344 11362 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:52.918772 11362 ts_tablet_manager.cc:1397] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.151s user 0.006s sys 0.001s
I20260811 06:16:52.920287 11814 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260811 06:16:52.921280 11362 raft_consensus.cc:348] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.922921 11362 raft_consensus.cc:374] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.924227 11362 raft_consensus.cc:729] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.927826 11362 consensus_queue.cc:260] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:52.935467 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet c4b809805d1e43128b5b18f558002036 (table default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]) successfully deleted
W20260811 06:16:52.936836 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 117327us
I20260811 06:16:52.937184 11362 ts_tablet_manager.cc:1428] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260811 06:16:52.938362 11362 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:52.941795 11365 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:52.942003 11365 ts_tablet_manager.cc:1397] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.000s
I20260811 06:16:52.942839 11365 raft_consensus.cc:348] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.943130 11365 raft_consensus.cc:374] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.943195 11365 raft_consensus.cc:729] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.943708 11365 consensus_queue.cc:260] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.947393 11365 ts_tablet_manager.cc:1428] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:16:52.949360 11362 tablet_bootstrap.cc:654] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.951761 11365 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:52.937753 11361 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:52.958904 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 107bf6921c6e40f2a337dccc302c8856 consensus state has no leader
I20260811 06:16:52.963989 11365 tablet_bootstrap.cc:654] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:52.965355 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37e73b8798b2455baf642abc532a5d8c consensus state has no leader
W20260811 06:16:52.967270 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d0f4cb9da96451ab351e1ad1aff7530 consensus state has no leader
I20260811 06:16:52.971915 11361 ts_tablet_manager.cc:1397] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.731s user 0.002s sys 0.019s
I20260811 06:16:52.881083 11368 pending_rounds.cc:68] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7317213228024922112 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "a3e6bf8789594a91a1a35e6c750a0ddd" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_f5ff2bf414524d4dbcab4dbfcd8f4ff4" dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" new_extra_config { } }
W20260811 06:16:52.973526 11368 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:48778: Aborted: Op aborted
I20260811 06:16:52.973908 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:48778 (request call id 76) took 4136 ms. Trace:
I20260811 06:16:52.974097 11368 rpcz_store.cc:276] 0811 06:16:48.837088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:48.837415 (+ 327us) service_pool.cc:227] Handling call
0811 06:16:52.973845 (+4136430us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:49.862437 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0811 06:16:49.862570 (+ 133us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0811 06:16:50.748240 (+885670us) alter_schema_op.cc:65] Acquired schema lock
0811 06:16:50.748252 (+ 12us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0811 06:16:50.748302 (+ 50us) alter_schema_op.cc:126] START. Timestamp: 1786429010748272
0811 06:16:50.748304 (+ 2us) op_driver.cc:331] REPLICATION: starting
0811 06:16:50.765295 (+ 16991us) log.cc:842] Serialized 173 byte log entry
0811 06:16:50.773491 (+ 8196us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x6150000d3f24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f194745bd02 00007f194878e7f1 00007f194878d359 00007f19487951bb 00007f1948795038 00000000009edb7c 00007f193bf8f344 00007f193bf9291b 00007f193bf92798 00000000009edb7c
0811 06:16:52.973393 (+2199902us) op_driver.cc:444] REPLICATION: finished
0811 06:16:52.973471 (+ 78us) op_driver.cc:372] HandleFailure(Aborted: Op aborted)
0811 06:16:52.973479 (+ 8us) alter_schema_op.cc:169] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":1018576,"prepare.run_cpu_time_us":107171,"prepare.run_wall_time_us":911132,"raft.queue_time_us":1680,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":2225041,"spinlock_wait_cycles":38487296}]]}
W20260811 06:16:52.975458 10309 catalog_manager.cc:4920] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): alter failed for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]): Aborted: Op aborted
I20260811 06:16:52.976070 11368 raft_consensus.cc:2258] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:52.976361 11491 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:48778: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 06:16:52.976655 11491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:48778 (request call id 88) took 3976 ms. Trace:
I20260811 06:16:52.976855 11491 rpcz_store.cc:276] 0811 06:16:49.000034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.000111 (+ 77us) service_pool.cc:227] Handling call
0811 06:16:52.976616 (+3976505us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:50.773592 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0811 06:16:50.773751 (+ 159us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0811 06:16:52.975913 (+2202162us) alter_schema_op.cc:65] Acquired schema lock
0811 06:16:52.975924 (+ 11us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0811 06:16:52.975975 (+ 51us) alter_schema_op.cc:126] START. Timestamp: 1786429012975926
0811 06:16:52.975978 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:16:52.976289 (+ 311us) op_driver.cc:372] HandleFailure(Illegal state: RaftConsensus is not running: State = Stopped)
0811 06:16:52.976297 (+ 8us) alter_schema_op.cc:169] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":1751434,"spinlock_wait_cycles":559488}]]}
I20260811 06:16:52.985301 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1b01c15261dc476491265a825c5ddd3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.986249 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b01c15261dc476491265a825c5ddd3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.987759 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_44c05bf06b9b40f4bd44080f3207b882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.988379 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44c05bf06b9b40f4bd44080f3207b882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.989604 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_525aee396dc64b5c8c61da99ad866f4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.990293 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_525aee396dc64b5c8c61da99ad866f4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.991360 11365 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:52.991541 11365 ts_tablet_manager.cc:1397] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.005s
I20260811 06:16:52.992411 11365 raft_consensus.cc:348] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.992694 11365 raft_consensus.cc:374] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:52.992801 11365 raft_consensus.cc:729] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:52.993104 11365 consensus_queue.cc:260] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:52.993822 11365 ts_tablet_manager.cc:1428] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 06:16:52.994287 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_fbf17bb2af5b4d5d81bc6f00a757be78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:52.994541 11365 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:16:52.994915 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbf17bb2af5b4d5d81bc6f00a757be78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:52.996306 11365 tablet_bootstrap.cc:654] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:52.996727 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_7e17eee1017d48ceb5c1208f05e8cc53" } modify_external_catalogs: true
I20260811 06:16:52.997008 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_7e17eee1017d48ceb5c1208f05e8cc53" } modify_external_catalogs: true
I20260811 06:16:52.998325 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_23cb7d9fcea44b2d8c2b741486b7b3f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:52.999055 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23cb7d9fcea44b2d8c2b741486b7b3f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.000469 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a8b81d583a3d4a01b5d0e7d00d37ec95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.001065 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8b81d583a3d4a01b5d0e7d00d37ec95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.002393 11362 tablet_bootstrap.cc:492] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.003458 11362 ts_tablet_manager.cc:1397] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.021s
I20260811 06:16:53.008428 11365 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.008637 11365 ts_tablet_manager.cc:1397] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20260811 06:16:53.009477 11365 raft_consensus.cc:348] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.008667 11362 raft_consensus.cc:348] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.009817 11365 raft_consensus.cc:374] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.009951 11365 raft_consensus.cc:729] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.010066 11361 raft_consensus.cc:348] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.010048 11362 raft_consensus.cc:374] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.010227 11365 consensus_queue.cc:260] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.010831 11361 raft_consensus.cc:374] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.010905 11365 ts_tablet_manager.cc:1428] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:16:53.011375 11365 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.011036 11362 raft_consensus.cc:729] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.011765 11361 raft_consensus.cc:729] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.013309 11362 consensus_queue.cc:260] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.014421 11365 tablet_bootstrap.cc:654] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.016755 11362 ts_tablet_manager.cc:1428] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.012s user 0.001s sys 0.003s
I20260811 06:16:53.022396 11762 raft_consensus.cc:482] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.022524 11368 ts_tablet_manager.cc:1905] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.022598 11762 raft_consensus.cc:504] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.023269 11762 leader_election.cc:288] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.023617 11814 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.024253 11362 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.024542 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62cbef937a46dfbc4dbf934e887139" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:53.025161 10555 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.026340 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62cbef937a46dfbc4dbf934e887139" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:53.029803 10564 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.029973 10564 leader_election.cc:302] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.030489 11762 raft_consensus.cc:2726] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.031080 11816 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.033681 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (DEFAULT_TABLE table=default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.034250 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78d94d27431a4d5e93f1c1ce8c7b6752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.036268 11814 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.040452 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
W20260811 06:16:53.041749 10309 catalog_manager.cc:4914] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): alter failed for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]),no further retry: Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:53.042248 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352]). Expected version 5 got 0
I20260811 06:16:53.043910 10328 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]). Expected version 1 got 0
I20260811 06:16:53.045101 10322 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352]). Expected version 5 got 0
I20260811 06:16:53.045322 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (DEFAULT_TABLE table=default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.046025 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78d94d27431a4d5e93f1c1ce8c7b6752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.047176 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ace7c736f5c144488e5dead2e48b82cb" } modify_external_catalogs: true
I20260811 06:16:53.047462 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ace7c736f5c144488e5dead2e48b82cb" } modify_external_catalogs: true
I20260811 06:16:53.047638 11362 tablet_bootstrap.cc:654] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.052341 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (Sending initial creation of tablet) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.066687 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet b39dfcd1a66b4241bc6f5c38e930f048 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.067462 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet ae1e42440ff14857b297621ca6031835 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:53.070976 10328 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet e1ee53b81b8a441d8f9186bceb61129c consensus state has no leader
I20260811 06:16:53.074090 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 52953438e7c248b1a758ee219405d7da from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.074355 11365 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.074523 11365 ts_tablet_manager.cc:1397] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.013s
I20260811 06:16:53.075358 11365 raft_consensus.cc:348] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.075762 11365 raft_consensus.cc:374] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.075860 11365 raft_consensus.cc:729] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.076125 11365 consensus_queue.cc:260] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.076768 11365 ts_tablet_manager.cc:1428] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:16:53.077435 11365 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.081228 11368 ts_tablet_manager.cc:1918] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260811 06:16:53.082055 11368 log.cc:1196] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:53.082686 11365 tablet_bootstrap.cc:654] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.083997 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1668695b60f3456580d886578b815b54" } new_table_name: "default.Table_ee1aab676e354fb484ae487d4316b261" modify_external_catalogs: true
I20260811 06:16:53.085922 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet adc2d99019384c33840f16cbe98d336c from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.086481 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet ea4eb7f5db2e4e75818bfb228b64ed0d from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.086709 11368 ts_tablet_manager.cc:1939] T a3e6bf8789594a91a1a35e6c750a0ddd P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:53.086844 11362 tablet_bootstrap.cc:492] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.087327 11362 ts_tablet_manager.cc:1397] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.021s
I20260811 06:16:53.088629 11362 raft_consensus.cc:348] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.089015 11362 raft_consensus.cc:374] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.089128 11362 raft_consensus.cc:729] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.089248 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 100) took 3669 ms. Trace:
I20260811 06:16:53.089383 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_38255a43259b4c3a9e0385991f1730dd" } modify_external_catalogs: true
I20260811 06:16:53.089658 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_38255a43259b4c3a9e0385991f1730dd" } modify_external_catalogs: true
I20260811 06:16:53.091219 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f3920e2166f84954861eb83e3296fed4" } modify_external_catalogs: true
I20260811 06:16:53.091395 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f3920e2166f84954861eb83e3296fed4" } modify_external_catalogs: true
I20260811 06:16:53.091830 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1fb146978bd445a0b62f5c36e9ba593b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.092571 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fb146978bd445a0b62f5c36e9ba593b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.095738 11365 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.096645 11365 ts_tablet_manager.cc:1397] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260811 06:16:53.097507 11365 raft_consensus.cc:348] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.097860 11365 raft_consensus.cc:374] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.097956 11365 raft_consensus.cc:729] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.100172 11816 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.102110 11365 consensus_queue.cc:260] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.102713 11365 ts_tablet_manager.cc:1428] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260811 06:16:53.103047 11365 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.103170 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.103097 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet cd7390a2221f4a1b9948c8a1353e4a49 with delete_type TABLET_DATA_DELETED (replaced by tablet 58fdb5920003438d983987ff242f6dce) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.103129 11362 consensus_queue.cc:260] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.102989 11368 rpcz_store.cc:276] 0811 06:16:49.419353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.420978 (+ 1625us) service_pool.cc:227] Handling call
0811 06:16:52.879197 (+3458219us) ts_tablet_manager.cc:1145] Deleting tablet a3e6bf8789594a91a1a35e6c750a0ddd
0811 06:16:52.879213 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.059542 (+180329us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.076029 (+ 16487us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.089208 (+ 13179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3433698}
I20260811 06:16:53.103935 11362 ts_tablet_manager.cc:1428] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260811 06:16:53.104336 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:16:53.104630 11362 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.105979 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 108) took 3452 ms. Trace:
I20260811 06:16:53.106200 11368 rpcz_store.cc:276] 0811 06:16:49.655256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.655622 (+ 366us) service_pool.cc:227] Handling call
0811 06:16:53.104315 (+3448693us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:16:53.105771 (+ 1456us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.105923 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3427740}
W20260811 06:16:53.106763 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9c5fa9633057485b917f117819d79398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c5fa9633057485b917f117819d79398 already in progress: creating tablet
I20260811 06:16:53.107039 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 109) took 3443 ms. Trace:
I20260811 06:16:53.107154 11368 rpcz_store.cc:276] 0811 06:16:49.663466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.663528 (+ 62us) service_pool.cc:227] Handling call
0811 06:16:53.106876 (+3443348us) ts_tablet_manager.cc:1145] Deleting tablet 67f458dba9444bfa8841a84cdb798588
0811 06:16:53.106887 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.107001 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3412786}
W20260811 06:16:53.107607 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 67f458dba9444bfa8841a84cdb798588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f458dba9444bfa8841a84cdb798588 already in progress: creating tablet
I20260811 06:16:53.107748 11362 tablet_bootstrap.cc:654] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.108327 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 115) took 3234 ms. Trace:
I20260811 06:16:53.109489 11365 tablet_bootstrap.cc:654] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.109653 11368 rpcz_store.cc:276] 0811 06:16:49.873628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.873701 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:53.107588 (+3233887us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:16:53.107598 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.108285 (+ 687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3226032}
I20260811 06:16:53.110260 11368 tablet_replica.cc:330] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:16:53.110678 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516021603ee24b3f9bdffd1e30e5ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516021603ee24b3f9bdffd1e30e5ea9d already in progress: creating tablet
I20260811 06:16:53.110770 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (DEFAULT_TABLE table=default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.111385 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78d94d27431a4d5e93f1c1ce8c7b6752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.111440 11368 raft_consensus.cc:2229] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.111647 11368 raft_consensus.cc:2258] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.112248 11368 ts_tablet_manager.cc:1905] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.119482 11365 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.119664 11365 ts_tablet_manager.cc:1397] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20260811 06:16:53.120558 11365 raft_consensus.cc:348] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.120797 11365 raft_consensus.cc:374] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.120908 11365 raft_consensus.cc:729] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.121182 11365 consensus_queue.cc:260] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.125449 11362 tablet_bootstrap.cc:492] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.125696 11362 ts_tablet_manager.cc:1397] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.010s
I20260811 06:16:53.126819 11362 raft_consensus.cc:348] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.127364 11362 raft_consensus.cc:374] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.127605 11362 raft_consensus.cc:729] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.127995 11362 consensus_queue.cc:260] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.128528 11365 ts_tablet_manager.cc:1428] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:16:53.128896 11365 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.128921 11362 ts_tablet_manager.cc:1428] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:16:53.129256 11362 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.130648 11365 tablet_bootstrap.cc:654] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.133522 11362 tablet_bootstrap.cc:654] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.140614 11362 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.141460 11362 ts_tablet_manager.cc:1397] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260811 06:16:53.144579 11365 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.144824 11365 ts_tablet_manager.cc:1397] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260811 06:16:53.145552 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 532208d7a02d448e8dac702ffe6c2ffc
I20260811 06:16:53.146152 10331 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:37928 (request call id 315) took 1097 ms. Trace:
I20260811 06:16:53.146039 11365 raft_consensus.cc:348] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.146375 11365 raft_consensus.cc:374] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.146504 11365 raft_consensus.cc:729] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.146750 11365 consensus_queue.cc:260] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.147399 11365 ts_tablet_manager.cc:1428] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:16:53.146386 10331 rpcz_store.cc:276] 0811 06:16:52.049119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.061473 (+ 12354us) service_pool.cc:227] Handling call
0811 06:16:52.062380 (+ 907us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:16:52.062600 (+ 220us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:16:52.062661 (+ 61us) catalog_manager.cc:2761] Locking tablets
0811 06:16:53.029968 (+967307us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:16:53.145301 (+115333us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:16:53.145400 (+ 99us) catalog_manager.cc:2809] Committing in-memory state
0811 06:16:53.145445 (+ 45us) catalog_manager.cc:2813] Aborting table tasks
0811 06:16:53.146070 (+ 625us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:53.056891 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:16:53.057033 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:16:53.057041 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:16:53.057044 (+ 3us) tablet.cc:660] Decoding operations
0811 06:16:53.057207 (+ 163us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:16:53.057220 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:16:53.057224 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:16:53.057476 (+ 252us) tablet.cc:699] Row locks acquired
0811 06:16:53.057479 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:16:53.057529 (+ 50us) write_op.cc:270] Start()
0811 06:16:53.057574 (+ 45us) write_op.cc:276] Timestamp: P: 1786429013057505 usec, L: 0
0811 06:16:53.057578 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:16:53.057842 (+ 264us) log.cc:842] Serialized 728 byte log entry
0811 06:16:53.143792 (+ 85950us) op_driver.cc:444] REPLICATION: finished
0811 06:16:53.144433 (+ 641us) write_op.cc:301] APPLY: starting
0811 06:16:53.144451 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:16:53.144492 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0811 06:16:53.144661 (+ 169us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:16:53.144896 (+ 235us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:16:53.144930 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:16:53.144936 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:16:53.145043 (+ 107us) log.cc:842] Serialized 29 byte log entry
0811 06:16:53.145185 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:16:53.145204 (+ 19us) write_op.cc:454] Released schema lock
0811 06:16:53.145212 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":580,"num_ops":2,"prepare.queue_time_us":26150,"prepare.run_cpu_time_us":1100,"prepare.run_wall_time_us":1518,"raft.queue_time_us":1690,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":86186}]]}
I20260811 06:16:53.147766 11365 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.148733 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.149552 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_88a00b589612427496030c899de53854" } new_table_name: "default.Table_c7fdf6b388124805afa944307aead1d1" modify_external_catalogs: true
I20260811 06:16:53.150754 11365 tablet_bootstrap.cc:654] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.152446 11362 raft_consensus.cc:348] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.153563 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:16:53.154300 11362 raft_consensus.cc:374] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.154462 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.154492 11362 raft_consensus.cc:729] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.154325 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.154899 11362 consensus_queue.cc:260] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:53.155452 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 227bc4fd6cd84e5eb2043c52f95d606d already in progress: creating tablet
I20260811 06:16:53.155582 11362 ts_tablet_manager.cc:1428] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260811 06:16:53.156193 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.158645 11368 ts_tablet_manager.cc:1918] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.158880 11368 log.cc:1196] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/c4b809805d1e43128b5b18f558002036
I20260811 06:16:53.159125 11362 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.161603 11762 raft_consensus.cc:482] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.161859 11762 raft_consensus.cc:504] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.162209 11368 ts_tablet_manager.cc:1939] T c4b809805d1e43128b5b18f558002036 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:53.162822 11762 leader_election.cc:288] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.163286 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 110) took 3444 ms. Trace:
I20260811 06:16:53.165001 10333 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
I20260811 06:16:53.166285 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4118842221c9462f8bc4cad981c9d859" } new_table_name: "default.Table_aa71876da9624e69b0528199afa103d9" modify_external_catalogs: true
I20260811 06:16:53.113729 11361 consensus_queue.cc:260] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.164331 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.167642 11362 tablet_bootstrap.cc:654] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.169025 11361 ts_tablet_manager.cc:1428] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.197s user 0.003s sys 0.000s
I20260811 06:16:53.169109 10921 raft_consensus.cc:2454] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:53.169589 11361 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:53.169689 10555 leader_election.cc:302] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:53.170251 11762 raft_consensus.cc:2781] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:53.170374 11762 raft_consensus.cc:482] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:53.170450 11762 raft_consensus.cc:3037] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.173293 11762 raft_consensus.cc:504] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.175199 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:53.175415 10921 raft_consensus.cc:3037] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.177914 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet e7d44fa2df924751a4835821901b56de
I20260811 06:16:53.178503 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.178803 10921 raft_consensus.cc:2454] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
W20260811 06:16:53.179112 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.179255 10555 leader_election.cc:302] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:53.179685 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d44fa2df924751a4835821901b56de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.179965 11371 tablet_replica.cc:330] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.180209 11371 raft_consensus.cc:2229] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.178529 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_aa6b10390f404e3aba1f467371294eb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.180392 11371 raft_consensus.cc:2258] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:53.180657 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa6b10390f404e3aba1f467371294eb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.180655 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d44fa2df924751a4835821901b56de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.180713 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ae1e42440ff14857b297621ca6031835
I20260811 06:16:53.181123 10332 catalog_manager.cc:6565] ReplaceTablet: tablet ae1e42440ff14857b297621ca6031835 deleted and replaced by tablet 5465d7f48e1f42689626749ba0350c7d
I20260811 06:16:53.181394 11371 ts_tablet_manager.cc:1905] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.181433 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ca2a465c1d9f4cd795b051d2a16f84d9" } new_table_name: "default.Table_74b425e2198e46b0933c2694cd644a24" modify_external_catalogs: true
I20260811 06:16:53.182907 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ea4eb7f5db2e4e75818bfb228b64ed0d
I20260811 06:16:53.183059 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.183337 10330 catalog_manager.cc:6565] ReplaceTablet: tablet ea4eb7f5db2e4e75818bfb228b64ed0d deleted and replaced by tablet 0813b34919a14a2481857e9f87b217c8
I20260811 06:16:53.183686 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1f6ef045b41944bc8268edd5f3832542" } new_table_name: "default.Table_5ce77e1cba8d4f0a91463c158aa9c7b5" modify_external_catalogs: true
I20260811 06:16:53.183964 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.184036 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.185364 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.187129 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:16:53.187409 11766 raft_consensus.cc:482] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.187561 11766 raft_consensus.cc:504] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.187805 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.188113 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4485cb9a9e344ab5b4701e6fface0bba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.188303 11766 leader_election.cc:288] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.188546 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
W20260811 06:16:53.188725 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4485cb9a9e344ab5b4701e6fface0bba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.189857 11762 leader_election.cc:288] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.190268 11762 raft_consensus.cc:2781] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:53.193061 11762 raft_consensus.cc:686] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:53.193768 11762 consensus_queue.cc:237] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.197467 10337 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: default.Table_4227de75e23646f2a53a023b660c907f [id=8444a45079b34969a38481a4b00c1352] alter complete (version 5)
I20260811 06:16:53.192808 11371 ts_tablet_manager.cc:1918] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.198102 11371 log.cc:1196] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e7d44fa2df924751a4835821901b56de
I20260811 06:16:53.199021 11371 ts_tablet_manager.cc:1939] T e7d44fa2df924751a4835821901b56de P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:53.199389 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.199574 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.200106 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.199762 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.200528 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.201336 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e7d44fa2df924751a4835821901b56de (table default.Table_f3920e2166f84954861eb83e3296fed4 [id=5b9959e1b81d47a7a923c6d7dbbc3020]) successfully deleted
I20260811 06:16:53.201699 11371 tablet_replica.cc:330] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:16:53.202104 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ae1e42440ff14857b297621ca6031835 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1e42440ff14857b297621ca6031835 already in progress: creating tablet
W20260811 06:16:53.202378 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ea4eb7f5db2e4e75818bfb228b64ed0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea4eb7f5db2e4e75818bfb228b64ed0d already in progress: creating tablet
I20260811 06:16:53.171590 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.173943 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:53.202622 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e5b4cdeb464861ada487eeb1b901a6 already in progress: creating tablet
I20260811 06:16:53.174927 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:53.186115 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d44fa2df924751a4835821901b56de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.186548 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.186754 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.189213 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11c50f909aad4bb991bfdeae8eab8455" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.203473 11163 raft_consensus.cc:2379] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:16:53.190881 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.201004 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.204443 11368 rpcz_store.cc:276] 0811 06:16:49.718338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.719934 (+ 1596us) service_pool.cc:227] Handling call
0811 06:16:53.110194 (+3390260us) ts_tablet_manager.cc:1145] Deleting tablet c4b809805d1e43128b5b18f558002036
0811 06:16:53.110205 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.124469 (+ 14264us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.158475 (+ 34006us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.163214 (+ 4739us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3188575}
I20260811 06:16:53.205813 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet c4b809805d1e43128b5b18f558002036 (table default.Table_d7236b1d385f4f509212dc6da9c66d34 [id=858f58cd5e994adfa65dfcc0938ce7cd]) successfully deleted
I20260811 06:16:53.206110 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 116) took 3321 ms. Trace:
I20260811 06:16:53.206813 11361 tablet_bootstrap.cc:654] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.207749 11368 rpcz_store.cc:276] 0811 06:16:49.884411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.885548 (+ 1137us) service_pool.cc:227] Handling call
0811 06:16:53.205835 (+3320287us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:16:53.205850 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.205982 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3264349}
W20260811 06:16:53.208997 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 22cac1c339574b1fa26555b18811539b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cac1c339574b1fa26555b18811539b already in progress: creating tablet
I20260811 06:16:53.210141 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 133) took 3172 ms. Trace:
W20260811 06:16:53.203286 10564 leader_election.cc:341] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:53.212491 10564 leader_election.cc:341] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.211223 11371 raft_consensus.cc:2229] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.213056 11371 raft_consensus.cc:2258] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.211956 11368 rpcz_store.cc:276] 0811 06:16:50.037977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.327708 (+289731us) service_pool.cc:227] Handling call
0811 06:16:53.209946 (+2882238us) ts_tablet_manager.cc:1145] Deleting tablet 3025339a6c9e4e07bba4104006206bb8
0811 06:16:53.209962 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.210076 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2868599}
W20260811 06:16:53.215538 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3025339a6c9e4e07bba4104006206bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3025339a6c9e4e07bba4104006206bb8 already in progress: creating tablet
I20260811 06:16:53.216003 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 134) took 3166 ms. Trace:
I20260811 06:16:53.220894 11368 rpcz_store.cc:276] 0811 06:16:50.049643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.329366 (+279723us) service_pool.cc:227] Handling call
0811 06:16:53.215796 (+2886430us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:16:53.215810 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.215935 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2874117}
W20260811 06:16:53.223560 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 already in progress: creating tablet
I20260811 06:16:53.223815 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 139) took 3124 ms. Trace:
I20260811 06:16:53.223923 11368 rpcz_store.cc:276] 0811 06:16:50.098875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.410209 (+311334us) service_pool.cc:227] Handling call
0811 06:16:53.223603 (+2813394us) ts_tablet_manager.cc:1145] Deleting tablet c00b6bdfc8ac4b5db81de9f614fcf213
0811 06:16:53.223617 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.223752 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788106}
W20260811 06:16:53.224298 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c00b6bdfc8ac4b5db81de9f614fcf213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00b6bdfc8ac4b5db81de9f614fcf213 already in progress: creating tablet
I20260811 06:16:53.224989 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 140) took 3115 ms. Trace:
I20260811 06:16:53.225626 11368 rpcz_store.cc:276] 0811 06:16:50.109404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.435533 (+326129us) service_pool.cc:227] Handling call
0811 06:16:53.224835 (+2789302us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:16:53.224845 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.224940 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2788921}
I20260811 06:16:53.228471 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 138) took 3132 ms. Trace:
W20260811 06:16:53.228518 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39dfcd1a66b4241bc6f5c38e930f048 already in progress: creating tablet
I20260811 06:16:53.228972 11368 rpcz_store.cc:276] 0811 06:16:50.096000 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.394597 (+298597us) service_pool.cc:227] Handling call
0811 06:16:53.228295 (+2833698us) ts_tablet_manager.cc:1145] Deleting tablet f88af70bbada49309a0e7cc7c333d6f0
0811 06:16:53.228308 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.228406 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2785709}
W20260811 06:16:53.229589 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f88af70bbada49309a0e7cc7c333d6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f88af70bbada49309a0e7cc7c333d6f0 already in progress: creating tablet
I20260811 06:16:53.229780 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 147) took 2640 ms. Trace:
I20260811 06:16:53.232709 11368 rpcz_store.cc:276] 0811 06:16:50.589533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.591334 (+ 1801us) service_pool.cc:227] Handling call
0811 06:16:53.229605 (+2638271us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:16:53.229616 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.229706 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2624120}
W20260811 06:16:53.234097 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c42b5ef0fc84627908200331f53b1a3 already in progress: creating tablet
I20260811 06:16:53.234652 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 148) took 2644 ms. Trace:
I20260811 06:16:53.235047 11368 rpcz_store.cc:276] 0811 06:16:50.589764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.590243 (+ 479us) service_pool.cc:227] Handling call
0811 06:16:53.234138 (+2643895us) ts_tablet_manager.cc:1145] Deleting tablet a4a46cec25944310a838d8323b119883
0811 06:16:53.234151 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.234589 (+ 438us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2623573}
W20260811 06:16:53.235455 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a4a46cec25944310a838d8323b119883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a46cec25944310a838d8323b119883 already in progress: creating tablet
I20260811 06:16:53.236229 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 149) took 2646 ms. Trace:
I20260811 06:16:53.236737 11368 rpcz_store.cc:276] 0811 06:16:50.589921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.591613 (+ 1692us) service_pool.cc:227] Handling call
0811 06:16:53.236068 (+2644455us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:16:53.236080 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.236174 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2623788}
I20260811 06:16:53.237511 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 146) took 2648 ms. Trace:
W20260811 06:16:53.237645 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2bdb349406a46629e6c307e1ebfd9dc already in progress: creating tablet
I20260811 06:16:53.238018 11368 rpcz_store.cc:276] 0811 06:16:50.589273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.596246 (+ 6973us) service_pool.cc:227] Handling call
0811 06:16:53.237354 (+2641108us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:16:53.237364 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.237455 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2624645}
I20260811 06:16:53.238799 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 150) took 2533 ms. Trace:
W20260811 06:16:53.238821 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 285b85c854bf400295b288314947840e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 285b85c854bf400295b288314947840e already in progress: creating tablet
W20260811 06:16:53.239341 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6703e639ab2042e78fadc63bd18c7602 has no consensus state
I20260811 06:16:53.239504 11368 rpcz_store.cc:276] 0811 06:16:50.705153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.705285 (+ 132us) service_pool.cc:227] Handling call
0811 06:16:53.238629 (+2533344us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:16:53.238640 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.238746 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2532986}
I20260811 06:16:53.242234 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 162) took 2256 ms. Trace:
I20260811 06:16:53.242875 11368 rpcz_store.cc:276] 0811 06:16:50.985343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.985453 (+ 110us) service_pool.cc:227] Handling call
0811 06:16:53.242064 (+2256611us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:16:53.242076 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.242170 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2255125}
W20260811 06:16:53.243556 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 58fdb5920003438d983987ff242f6dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58fdb5920003438d983987ff242f6dce already in progress: creating tablet
I20260811 06:16:53.245008 11371 ts_tablet_manager.cc:1905] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.246205 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 161) took 2262 ms. Trace:
I20260811 06:16:53.246532 11368 rpcz_store.cc:276] 0811 06:16:50.983457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.983581 (+ 124us) service_pool.cc:227] Handling call
0811 06:16:53.243534 (+2259953us) ts_tablet_manager.cc:1145] Deleting tablet 7a00b0b51f574bfb843b65c0876ab4fc
0811 06:16:53.243544 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.243639 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2256099}
W20260811 06:16:53.247257 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7a00b0b51f574bfb843b65c0876ab4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a00b0b51f574bfb843b65c0876ab4fc already in progress: creating tablet
I20260811 06:16:53.249672 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 163) took 2260 ms. Trace:
I20260811 06:16:53.249990 11368 rpcz_store.cc:276] 0811 06:16:50.986610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.986656 (+ 46us) service_pool.cc:227] Handling call
0811 06:16:53.247207 (+2260551us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:16:53.247219 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.247315 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2259517}
I20260811 06:16:53.250852 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 160) took 2272 ms. Trace:
W20260811 06:16:53.251367 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52953438e7c248b1a758ee219405d7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52953438e7c248b1a758ee219405d7da already in progress: creating tablet
I20260811 06:16:53.251662 11368 rpcz_store.cc:276] 0811 06:16:50.978496 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.978611 (+ 115us) service_pool.cc:227] Handling call
0811 06:16:53.250677 (+2272066us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:16:53.250689 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.250803 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262861}
I20260811 06:16:53.253110 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 167) took 2218 ms. Trace:
I20260811 06:16:53.253804 11368 rpcz_store.cc:276] 0811 06:16:51.034918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.035064 (+ 146us) service_pool.cc:227] Handling call
0811 06:16:53.252933 (+2217869us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:16:53.252945 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.253054 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2207841}
W20260811 06:16:53.254733 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0bbf657cb27f4da9a4f595242864163a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bbf657cb27f4da9a4f595242864163a already in progress: creating tablet
I20260811 06:16:53.255290 11368 tablet_replica.cc:330] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:53.255759 11368 raft_consensus.cc:2229] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:16:53.256163 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 864c3bbf1e004579a4d0be809f83ca33 consensus state has no leader
I20260811 06:16:53.256609 11368 raft_consensus.cc:2258] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:53.256723 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ac8c5daeb3249e38d863ee94f1267b1 already in progress: creating tablet
I20260811 06:16:53.259774 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b681f10c3de4bd798b9d519f10da103 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:53.261287 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 82044.5us
I20260811 06:16:53.265941 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_03dde8ecdd2c42e8a59b48127464bff2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.266505 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03dde8ecdd2c42e8a59b48127464bff2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.268250 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2a7a2180fd1746db98808d9d4ea17647"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.268968 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a7a2180fd1746db98808d9d4ea17647 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.277644 11371 ts_tablet_manager.cc:1918] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.277949 11371 log.cc:1196] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a4a46cec25944310a838d8323b119883
I20260811 06:16:53.278576 11371 ts_tablet_manager.cc:1939] T a4a46cec25944310a838d8323b119883 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:53.278770 10810 leader_election.cc:341] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:53.279309 10810 leader_election.cc:302] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:53.279436 10309 catalog_manager.cc:4914] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): alter failed for tablet a3e6bf8789594a91a1a35e6c750a0ddd (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]),no further retry: Not found: Tablet not found: a3e6bf8789594a91a1a35e6c750a0ddd
I20260811 06:16:53.279682 11766 raft_consensus.cc:3037] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.280241 11368 ts_tablet_manager.cc:1905] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.280618 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6580760971534d17ba27adcc6f5cd336"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.282763 11766 raft_consensus.cc:2726] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:16:53.282989 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6580760971534d17ba27adcc6f5cd336 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.285895 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a4a46cec25944310a838d8323b119883 (table default.Table_21f0b9c149d7498e8ba846e4f3adb056 [id=cba6e77528e14ab3a7f179586ccde125]) successfully deleted
I20260811 06:16:53.286334 11371 tablet_replica.cc:330] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.287655 11371 raft_consensus.cc:2229] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.288573 11371 raft_consensus.cc:2258] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.290310 11368 ts_tablet_manager.cc:1918] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:53.290483 11368 log.cc:1196] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bc53fcee3ed5480f85804f29c94c13f8
I20260811 06:16:53.292554 11370 ts_tablet_manager.cc:1918] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.292712 11370 log.cc:1196] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ef8b262229dd4b26b862527d2e17cb27
I20260811 06:16:53.293159 11370 ts_tablet_manager.cc:1939] T ef8b262229dd4b26b862527d2e17cb27 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:53.294023 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 108) took 3666 ms. Trace:
I20260811 06:16:53.294160 11370 rpcz_store.cc:276] 0811 06:16:49.661309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.661500 (+ 191us) service_pool.cc:227] Handling call
0811 06:16:52.889915 (+3228415us) ts_tablet_manager.cc:1145] Deleting tablet ef8b262229dd4b26b862527d2e17cb27
0811 06:16:52.889925 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.223006 (+333081us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.292395 (+ 69389us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.293980 (+ 1585us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":505,"tablet-delete.queue_time_us":3224274}
I20260811 06:16:53.294730 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 109) took 3626 ms. Trace:
I20260811 06:16:53.294862 11370 rpcz_store.cc:276] 0811 06:16:49.667953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.668011 (+ 58us) service_pool.cc:227] Handling call
0811 06:16:53.294560 (+3626549us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:16:53.294572 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.294698 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3626087}
W20260811 06:16:53.295471 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9c5fa9633057485b917f117819d79398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c5fa9633057485b917f117819d79398 already in progress: creating tablet
I20260811 06:16:53.298254 11368 ts_tablet_manager.cc:1939] T bc53fcee3ed5480f85804f29c94c13f8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:53.298712 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 165) took 2264 ms. Trace:
I20260811 06:16:53.298857 11368 rpcz_store.cc:276] 0811 06:16:51.034658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.035097 (+ 439us) service_pool.cc:227] Handling call
0811 06:16:53.255194 (+2220097us) ts_tablet_manager.cc:1145] Deleting tablet bc53fcee3ed5480f85804f29c94c13f8
0811 06:16:53.255207 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.283450 (+ 28243us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.288064 (+ 4614us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.298667 (+ 10603us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204521}
I20260811 06:16:53.299427 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 166) took 2264 ms. Trace:
I20260811 06:16:53.299453 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]) successfully deleted
I20260811 06:16:53.299549 11368 rpcz_store.cc:276] 0811 06:16:51.034802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.035032 (+ 230us) service_pool.cc:227] Handling call
0811 06:16:53.299268 (+2264236us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:16:53.299279 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.299386 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2246613}
I20260811 06:16:53.300079 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 164) took 2265 ms. Trace:
I20260811 06:16:53.300204 11368 rpcz_store.cc:276] 0811 06:16:51.034410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.035123 (+ 713us) service_pool.cc:227] Handling call
0811 06:16:53.299919 (+2264796us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:16:53.299937 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.300043 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2226316}
I20260811 06:16:53.300580 11368 tablet_replica.cc:330] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:16:53.300602 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6119212ae4be4204852a5d9437dcee72 already in progress: creating tablet
I20260811 06:16:53.300813 11368 raft_consensus.cc:2229] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.301013 11368 raft_consensus.cc:2258] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.302515 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_432d41d1b12145e39802023ebd08d467"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.303120 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_34897d99ed2841d195d7833a0bcdd2c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.303715 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34897d99ed2841d195d7833a0bcdd2c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.303128 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_432d41d1b12145e39802023ebd08d467 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.312148 11368 ts_tablet_manager.cc:1905] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.316187 11814 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260811 06:16:53.318342 11362 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.318529 11362 ts_tablet_manager.cc:1397] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.160s user 0.011s sys 0.038s
I20260811 06:16:53.318518 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 110) took 3648 ms. Trace:
I20260811 06:16:53.318773 11370 rpcz_store.cc:276] 0811 06:16:49.669891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.670223 (+ 332us) service_pool.cc:227] Handling call
0811 06:16:53.295101 (+3624878us) ts_tablet_manager.cc:1145] Deleting tablet 67f458dba9444bfa8841a84cdb798588
0811 06:16:53.295109 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.318404 (+ 23295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3624354}
I20260811 06:16:53.319334 11370 tablet_replica.cc:330] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:53.319450 11362 raft_consensus.cc:348] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.319701 11362 raft_consensus.cc:374] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.319741 11370 raft_consensus.cc:2229] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:53.319890 11362 raft_consensus.cc:729] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
W20260811 06:16:53.320225 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40c31ffb11484783bca9263c947f37da consensus state has no leader
I20260811 06:16:53.320701 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e218ef3357a64431b19357d9e21e69bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.321403 11362 consensus_queue.cc:260] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:53.321574 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e218ef3357a64431b19357d9e21e69bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.323040 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45ebef95922f4e7f93533b54c07b7cec consensus state has no leader
I20260811 06:16:53.323740 11370 raft_consensus.cc:2258] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.325074 11442 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.125:35327
I20260811 06:16:53.326408 11370 ts_tablet_manager.cc:1905] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.327095 10333 catalog_manager.cc:5495] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:16:53.327548 10333 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
I20260811 06:16:53.328027 11442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-1/data/info.pb
W20260811 06:16:53.328477 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 67f458dba9444bfa8841a84cdb798588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67f458dba9444bfa8841a84cdb798588 already in progress: creating tablet
I20260811 06:16:53.331243 11362 ts_tablet_manager.cc:1428] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.000s sys 0.005s
I20260811 06:16:53.331796 11362 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.330291 11845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.125:35327 every 8 connection(s)
I20260811 06:16:53.335310 11362 tablet_bootstrap.cc:654] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.336238 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 (DEFAULT_TABLE table=default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.336668 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 11442
I20260811 06:16:53.336817 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152f7db9fc6241c8abfdafd3adc30d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.337116 10855 tablet_service.cc:1467] Processing CreateTablet for tablet da30a4db5b334cf88b01648c336a7ade (DEFAULT_TABLE table=default.Table_03a56dbcc387459a9a6ae4fdfb454c6a [id=32c58f06cf094acdac22d9ca6fe36811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.337499 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da30a4db5b334cf88b01648c336a7ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.338079 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 2e1460fe55fb48f890f31e1cc86d1d23 (DEFAULT_TABLE table=default.Table_d483af5774d842edb46c928a435727d5 [id=ced4cf520c4f4b848b51d365ebca8a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.339686 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 (DEFAULT_TABLE table=default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.339921 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 3410afec34ae469d9a07cc9d16cf082c (DEFAULT_TABLE table=default.Table_1e89b093b0db4f3e8d0d549e42069605 [id=dc58cc194d2c4782b6a2b5d80caf698a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.340202 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152f7db9fc6241c8abfdafd3adc30d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.340610 10871 tablet_service.cc:1467] Processing CreateTablet for tablet e4171d257dd6453a9159c59ae713b2e0 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.341113 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 19f45416a7ae45b3a8b26dd98b672f36 (DEFAULT_TABLE table=default.Table_d0335bdbd99c4dcda7ebedcb066eff67 [id=bea424ee56274c99aba8c2defe26bc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.341944 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e1460fe55fb48f890f31e1cc86d1d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.342576 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4171d257dd6453a9159c59ae713b2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.344709 10618 tablet_service.cc:1467] Processing CreateTablet for tablet da30a4db5b334cf88b01648c336a7ade (DEFAULT_TABLE table=default.Table_03a56dbcc387459a9a6ae4fdfb454c6a [id=32c58f06cf094acdac22d9ca6fe36811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.345654 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 2e1460fe55fb48f890f31e1cc86d1d23 (DEFAULT_TABLE table=default.Table_d483af5774d842edb46c928a435727d5 [id=ced4cf520c4f4b848b51d365ebca8a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.347267 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.347584 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f45416a7ae45b3a8b26dd98b672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.349793 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3410afec34ae469d9a07cc9d16cf082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.355294 11119 tablet_service.cc:1467] Processing CreateTablet for tablet e4171d257dd6453a9159c59ae713b2e0 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.356654 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8f4b4732c67448209df33512a2495a25" } modify_external_catalogs: true
I20260811 06:16:53.357092 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8f4b4732c67448209df33512a2495a25" } modify_external_catalogs: true
I20260811 06:16:53.358843 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 19f45416a7ae45b3a8b26dd98b672f36 (DEFAULT_TABLE table=default.Table_d0335bdbd99c4dcda7ebedcb066eff67 [id=bea424ee56274c99aba8c2defe26bc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.359771 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 2e1460fe55fb48f890f31e1cc86d1d23 (DEFAULT_TABLE table=default.Table_d483af5774d842edb46c928a435727d5 [id=ced4cf520c4f4b848b51d365ebca8a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.360162 11115 tablet_service.cc:1467] Processing CreateTablet for tablet da30a4db5b334cf88b01648c336a7ade (DEFAULT_TABLE table=default.Table_03a56dbcc387459a9a6ae4fdfb454c6a [id=32c58f06cf094acdac22d9ca6fe36811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.360800 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4171d257dd6453a9159c59ae713b2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.364886 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_16798efef90c476e88ece60ceda20557" } modify_external_catalogs: true
I20260811 06:16:53.365119 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_16798efef90c476e88ece60ceda20557" } modify_external_catalogs: true
I20260811 06:16:53.367112 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da30a4db5b334cf88b01648c336a7ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.369737 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet ab32f96671984766a54b5ee904c465f7 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.372833 10627 tablet_service.cc:1467] Processing CreateTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d (DEFAULT_TABLE table=default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.376339 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 19e7d97649c94ef3a73a0ea9acc57ab2 (DEFAULT_TABLE table=default.Table_6972e78580ee49178a1c6ce6f017dc52 [id=696d50b178d4478d81d03a34a5ede1b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.377643 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 6703e639ab2042e78fadc63bd18c7602 (DEFAULT_TABLE table=default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.386941 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dcc767edfa7645179a1784037ed2909d" } new_table_name: "default.Table_1d79ed1149e94fccb8e01b4aa32c53f8" modify_external_catalogs: true
I20260811 06:16:53.388062 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c" } modify_external_catalogs: true
I20260811 06:16:53.388299 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c" } modify_external_catalogs: true
I20260811 06:16:53.391053 11365 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.391134 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 (DEFAULT_TABLE table=default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.391299 11365 ts_tablet_manager.cc:1397] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.244s user 0.011s sys 0.043s
I20260811 06:16:53.391670 10615 tablet_service.cc:1467] Processing CreateTablet for tablet e4171d257dd6453a9159c59ae713b2e0 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.391999 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da30a4db5b334cf88b01648c336a7ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.392149 11365 raft_consensus.cc:348] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.392390 11365 raft_consensus.cc:374] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.392495 11365 raft_consensus.cc:729] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.392788 11365 consensus_queue.cc:260] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.391021 11371 ts_tablet_manager.cc:1905] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.394227 11365 ts_tablet_manager.cc:1428] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:16:53.394959 11365 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.394961 10619 tablet_service.cc:1467] Processing CreateTablet for tablet 19f45416a7ae45b3a8b26dd98b672f36 (DEFAULT_TABLE table=default.Table_d0335bdbd99c4dcda7ebedcb066eff67 [id=bea424ee56274c99aba8c2defe26bc3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.395638 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 916b91088d7d4024a02214c958c0825b (DEFAULT_TABLE table=default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.396291 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 3410afec34ae469d9a07cc9d16cf082c (DEFAULT_TABLE table=default.Table_1e89b093b0db4f3e8d0d549e42069605 [id=dc58cc194d2c4782b6a2b5d80caf698a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.396520 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4171d257dd6453a9159c59ae713b2e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.423226 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e1460fe55fb48f890f31e1cc86d1d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.425576 10886 tablet_service.cc:1467] Processing CreateTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d (DEFAULT_TABLE table=default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.426956 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 916b91088d7d4024a02214c958c0825b (DEFAULT_TABLE table=default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.432498 11874 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:16:53.440294 11874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Bootstrap starting.
W20260811 06:16:53.442409 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ae1e42440ff14857b297621ca6031835 (table default.Table_8f4b4732c67448209df33512a2495a25 [id=23ec4328fe004a8ab2e8cff534a30e0b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet ae1e42440ff14857b297621ca6031835 consensus state has no leader
I20260811 06:16:53.455235 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f45416a7ae45b3a8b26dd98b672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.457315 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 3410afec34ae469d9a07cc9d16cf082c (DEFAULT_TABLE table=default.Table_1e89b093b0db4f3e8d0d549e42069605 [id=dc58cc194d2c4782b6a2b5d80caf698a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.458425 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f45416a7ae45b3a8b26dd98b672f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.460615 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 916b91088d7d4024a02214c958c0825b (DEFAULT_TABLE table=default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.461542 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 19e7d97649c94ef3a73a0ea9acc57ab2 (DEFAULT_TABLE table=default.Table_6972e78580ee49178a1c6ce6f017dc52 [id=696d50b178d4478d81d03a34a5ede1b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.464749 11127 tablet_service.cc:1467] Processing CreateTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d (DEFAULT_TABLE table=default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.469592 11370 ts_tablet_manager.cc:1918] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.486186 11874 log.cc:824] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Log is configured to *not* fsync() on all Append() calls
I20260811 06:16:53.517180 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3aeade8d5c694298954b38d3d3ed01bb" } modify_external_catalogs: true
I20260811 06:16:53.517642 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3aeade8d5c694298954b38d3d3ed01bb" } modify_external_catalogs: true
I20260811 06:16:53.519567 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6703e639ab2042e78fadc63bd18c7602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.521570 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.522352 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.524467 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_23cb7d9fcea44b2d8c2b741486b7b3f4" } new_table_name: "default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff" modify_external_catalogs: true
I20260811 06:16:53.525655 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18f96539b76422ab3ae65bdfe2cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.521155 11855 raft_consensus.cc:482] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.529068 11762 raft_consensus.cc:482] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.529999 11762 raft_consensus.cc:504] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.530812 11762 leader_election.cc:288] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.532626 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 6703e639ab2042e78fadc63bd18c7602 (DEFAULT_TABLE table=default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.533803 11365 tablet_bootstrap.cc:654] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.533742 11799 raft_consensus.cc:482] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.533919 11799 raft_consensus.cc:504] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.535303 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152f7db9fc6241c8abfdafd3adc30d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.535621 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916b91088d7d4024a02214c958c0825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.535511 11799 leader_election.cc:288] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.536993 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e7d97649c94ef3a73a0ea9acc57ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.542526 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916b91088d7d4024a02214c958c0825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.540315 11855 raft_consensus.cc:504] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.545703 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916b91088d7d4024a02214c958c0825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.547984 11873 raft_consensus.cc:482] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.548070 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 6703e639ab2042e78fadc63bd18c7602 (DEFAULT_TABLE table=default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.548645 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18f96539b76422ab3ae65bdfe2cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.549556 11370 log.cc:1196] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:53.549503 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.549358 11361 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:53.550604 11046 leader_election.cc:341] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:53.550777 11362 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.551133 11362 ts_tablet_manager.cc:1397] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.219s user 0.009s sys 0.021s
I20260811 06:16:53.551126 11361 ts_tablet_manager.cc:1397] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.382s user 0.003s sys 0.003s
I20260811 06:16:53.551939 11370 ts_tablet_manager.cc:1939] T 57144ad37b874c91a89a25665a85eeb2 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:53.552263 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3410afec34ae469d9a07cc9d16cf082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.552356 11362 raft_consensus.cc:348] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.552688 11362 raft_consensus.cc:374] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.552778 11362 raft_consensus.cc:729] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.553056 11362 consensus_queue.cc:260] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.550297 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 19e7d97649c94ef3a73a0ea9acc57ab2 (DEFAULT_TABLE table=default.Table_6972e78580ee49178a1c6ce6f017dc52 [id=696d50b178d4478d81d03a34a5ede1b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:53.548265 11873 raft_consensus.cc:504] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.559512 11762 raft_consensus.cc:482] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.559805 11762 raft_consensus.cc:504] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.560144 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6703e639ab2042e78fadc63bd18c7602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.560755 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e1460fe55fb48f890f31e1cc86d1d23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:53.561692 10564 leader_election.cc:341] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.562510 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6703e639ab2042e78fadc63bd18c7602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.563777 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efe8eb16e84575abd18a5079aad2c9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.564603 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e7d97649c94ef3a73a0ea9acc57ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.566128 11872 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260811 06:16:53.567072 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 111) took 3890 ms. Trace:
W20260811 06:16:53.569171 10564 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.569437 11855 leader_election.cc:288] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.571259 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88af70bbada49309a0e7cc7c333d6f0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.572182 11368 ts_tablet_manager.cc:1918] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.572522 11362 ts_tablet_manager.cc:1428] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:53.574057 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e18f96539b76422ab3ae65bdfe2cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.578449 11873 leader_election.cc:288] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.579571 11762 leader_election.cc:288] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.580768 11370 rpcz_store.cc:276] 0811 06:16:49.670851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.672162 (+ 1311us) service_pool.cc:227] Handling call
0811 06:16:53.319164 (+3647002us) ts_tablet_manager.cc:1145] Deleting tablet 57144ad37b874c91a89a25665a85eeb2
0811 06:16:53.319178 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.421032 (+101854us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.469445 (+ 48413us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.561386 (+ 91941us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3646528}
I20260811 06:16:53.581492 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 57144ad37b874c91a89a25665a85eeb2 (table default.Table_ceb4c433db0b4d098442695e2441817e [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
W20260811 06:16:53.584712 10810 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1ff1ad74f2034ed9b24c9712bae14cd3
W20260811 06:16:53.586195 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 273111us
I20260811 06:16:53.586897 11362 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.587716 11816 tablet.cc:1722] T 714247a11705421b9c012d99bdbf3d04 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260811 06:16:53.587792 10564 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.588397 11368 log.cc:1196] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ef8b262229dd4b26b862527d2e17cb27
I20260811 06:16:53.586413 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 117) took 3622 ms. Trace:
I20260811 06:16:53.589979 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff1ad74f2034ed9b24c9712bae14cd3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.594457 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.596633 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88af70bbada49309a0e7cc7c333d6f0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.598097 11370 rpcz_store.cc:276] 0811 06:16:49.960303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.960636 (+ 333us) service_pool.cc:227] Handling call
0811 06:16:53.581450 (+3620814us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:16:53.581472 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.582518 (+ 1046us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3620253}
W20260811 06:16:53.598977 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 22cac1c339574b1fa26555b18811539b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cac1c339574b1fa26555b18811539b already in progress: creating tablet
I20260811 06:16:53.600955 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 116) took 3638 ms. Trace:
I20260811 06:16:53.601199 11370 rpcz_store.cc:276] 0811 06:16:49.960148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:49.997354 (+ 37206us) service_pool.cc:227] Handling call
0811 06:16:53.598822 (+3601468us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:16:53.598836 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.599028 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3514117}
W20260811 06:16:53.601841 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516021603ee24b3f9bdffd1e30e5ea9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516021603ee24b3f9bdffd1e30e5ea9d already in progress: creating tablet
I20260811 06:16:53.602510 11370 tablet_replica.cc:330] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:53.602766 11370 raft_consensus.cc:2229] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:16:53.606331 11046 consensus_peers.cc:487] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94d04b025b1b45009260ddd9f1b0aabb. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:53.607125 11370 raft_consensus.cc:2258] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.607939 11370 ts_tablet_manager.cc:1905] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.611094 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efe8eb16e84575abd18a5079aad2c9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.611449 10747 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:53.614650 11874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=1 applied=19 ignored=0} inserts{seen=23 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 06:16:53.616494 11874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Bootstrap complete.
I20260811 06:16:53.618001 11368 ts_tablet_manager.cc:1939] T ef8b262229dd4b26b862527d2e17cb27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:53.625324 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b681f10c3de4bd798b9d519f10da103" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.625703 10925 raft_consensus.cc:2454] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:53.633811 11047 leader_election.cc:302] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:53.634310 11799 raft_consensus.cc:2781] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:53.634497 11799 raft_consensus.cc:482] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:53.634621 11799 raft_consensus.cc:3037] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:53.636266 10813 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.636686 10813 leader_election.cc:302] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.639518 11362 tablet_bootstrap.cc:654] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.640172 11799 raft_consensus.cc:504] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.641656 11799 leader_election.cc:288] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.642294 11868 raft_consensus.cc:2726] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.642547 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e7d97649c94ef3a73a0ea9acc57ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.643023 10921 raft_consensus.cc:3037] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.644994 11238 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:53.656170 10925 raft_consensus.cc:3037] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.656177 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b681f10c3de4bd798b9d519f10da103" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:53.656765 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3410afec34ae469d9a07cc9d16cf082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:53.660948 11361 raft_consensus.cc:348] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.661458 11361 raft_consensus.cc:374] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.661545 10915 raft_consensus.cc:3037] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.665418 11762 raft_consensus.cc:482] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.665894 11874 raft_consensus.cc:348] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:53.674432 11874 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36d6d06a0cb4489b5014178b9973219, State: Initialized, Role: FOLLOWER
W20260811 06:16:53.675429 11046 leader_election.cc:341] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:53.676549 11361 raft_consensus.cc:729] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.678020 11874 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
W20260811 06:16:53.679970 10555 leader_election.cc:341] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.680115 10324 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5465d7f48e1f42689626749ba0350c7d
I20260811 06:16:53.682020 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet d668bcfbeff54181ba3b4407b1eb5704
I20260811 06:16:53.682235 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3c3274039b55474a90dfb2f66912aff6" } new_table_name: "default.Table_bbd56f7550904a7dab2b0faa4f932eee" modify_external_catalogs: true
I20260811 06:16:53.682853 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.683566 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.684309 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 78d94d27431a4d5e93f1c1ce8c7b6752
I20260811 06:16:53.685392 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ab32f96671984766a54b5ee904c465f7
I20260811 06:16:53.685491 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6a9b87183c994b7d9e7879d511ebfb97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.685899 10321 catalog_manager.cc:6565] ReplaceTablet: tablet ab32f96671984766a54b5ee904c465f7 deleted and replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628
I20260811 06:16:53.686230 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a8fee33e3e334393a747f831b0ceb733" } new_table_name: "default.Table_cdfe7577fb6c436cb05499d6ea396a51" modify_external_catalogs: true
W20260811 06:16:53.687798 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd6584701c23406e83122bd2493b7972 consensus state has no leader
I20260811 06:16:53.688226 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_95a321ec44e440debe3917e0853e2b65" } new_table_name: "default.Table_1243732da50e4052abb053fb7274c580" modify_external_catalogs: true
I20260811 06:16:53.678383 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 169) took 2589 ms. Trace:
I20260811 06:16:53.691205 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 0dab2b8209e5401c84a187882ef21e08
I20260811 06:16:53.691742 10318 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:37928 (request call id 327) took 1149 ms. Trace:
I20260811 06:16:53.691890 10318 rpcz_store.cc:276] 0811 06:16:52.541943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.062347 (+520404us) service_pool.cc:227] Handling call
0811 06:16:53.089318 (+ 26971us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x615000033024. stack: 00007fc305ebf66e 00007fc305ebf430 00007fc304f465ed 00000000008ea064 00000000008ea02d 00007fc3145dc27d 00007fc3145dc373 00007fc3113fe361 00007fc318d7166a 00007fc318efa2e6 00007fc3101ed126 00007fc3101ece55 00007fc30c9fb9be 00007fc30c9fa79e 00007fc30ca00b25 00007fc30ca0154f
0811 06:16:53.089798 (+ 480us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:16:53.089949 (+ 151us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:16:53.090008 (+ 59us) catalog_manager.cc:2761] Locking tablets
0811 06:16:53.326060 (+236052us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:16:53.679745 (+353685us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:16:53.679858 (+ 113us) catalog_manager.cc:2809] Committing in-memory state
0811 06:16:53.679907 (+ 49us) catalog_manager.cc:2813] Aborting table tasks
0811 06:16:53.691637 (+ 11730us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:53.377976 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:16:53.378073 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:16:53.378079 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:16:53.378082 (+ 3us) tablet.cc:660] Decoding operations
0811 06:16:53.378191 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:16:53.378201 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:16:53.378206 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:16:53.378303 (+ 97us) tablet.cc:699] Row locks acquired
0811 06:16:53.378305 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:16:53.378339 (+ 34us) write_op.cc:270] Start()
0811 06:16:53.378371 (+ 32us) write_op.cc:276] Timestamp: P: 1786429013378289 usec, L: 0
0811 06:16:53.378375 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:16:53.378555 (+ 180us) log.cc:842] Serialized 728 byte log entry
0811 06:16:53.677371 (+298816us) op_driver.cc:444] REPLICATION: finished
0811 06:16:53.677764 (+ 393us) write_op.cc:301] APPLY: starting
0811 06:16:53.677787 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:16:53.677839 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:16:53.677920 (+ 81us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:16:53.678002 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:16:53.678042 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:16:53.678049 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:16:53.678144 (+ 95us) log.cc:842] Serialized 29 byte log entry
0811 06:16:53.678220 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:16:53.678245 (+ 25us) write_op.cc:454] Released schema lock
0811 06:16:53.678253 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:16:53.678310 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:16:53.678313 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11214,"spinlock_wait_cycles":61425024,"child_traces":[["op",{"apply.queue_time_us":297,"apply.run_cpu_time_us":606,"apply.run_wall_time_us":607,"num_ops":2,"prepare.queue_time_us":51296,"prepare.run_cpu_time_us":656,"prepare.run_wall_time_us":656,"replication_time_us":298960,"spinlock_wait_cycles":21888}]]}
I20260811 06:16:53.693805 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4e402e7edac3451e992194b471d8a664"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.694432 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e402e7edac3451e992194b471d8a664 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.686244 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a9b87183c994b7d9e7879d511ebfb97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.702896 11368 rpcz_store.cc:276] 0811 06:16:51.052940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.053241 (+ 301us) service_pool.cc:227] Handling call
0811 06:16:53.300513 (+2247272us) ts_tablet_manager.cc:1145] Deleting tablet ef8b262229dd4b26b862527d2e17cb27
0811 06:16:53.300523 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.316294 (+ 15771us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.570716 (+254422us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.642473 (+ 71757us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2224107}
I20260811 06:16:53.700057 10555 leader_election.cc:302] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.706344 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.706547 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.707901 11361 consensus_queue.cc:260] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.712636 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.713730 11855 raft_consensus.cc:2726] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.707738 11762 raft_consensus.cc:504] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:53.717118 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 72560.2us
W20260811 06:16:53.717514 10555 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.718655 10555 leader_election.cc:302] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:53.719161 10555 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.722118 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 187) took 2324 ms. Trace:
I20260811 06:16:53.722218 10555 leader_election.cc:302] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.726054 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.726502 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.727124 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a00b0b51f574bfb843b65c0876ab4fc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.728552 11855 raft_consensus.cc:2726] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.731738 10865 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.731950 11368 rpcz_store.cc:276] 0811 06:16:51.382168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.384163 (+ 1995us) service_pool.cc:227] Handling call
0811 06:16:53.706392 (+2322229us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:16:53.706405 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.706665 (+ 260us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2295343}
I20260811 06:16:53.733165 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.733558 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.733814 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:53.734463 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3250276181a24e58a2db92376b7520e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3250276181a24e58a2db92376b7520e7 already in progress: creating tablet
I20260811 06:16:53.735242 11365 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:16:53.735435 10564 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.735728 11762 leader_election.cc:288] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.736366 11855 raft_consensus.cc:2726] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.737545 11004 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:53.737625 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 189) took 2334 ms. Trace:
I20260811 06:16:53.737789 11368 rpcz_store.cc:276] 0811 06:16:51.400363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.400447 (+ 84us) service_pool.cc:227] Handling call
0811 06:16:53.732244 (+2331797us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:16:53.732257 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.735219 (+ 2962us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2318194}
I20260811 06:16:53.738255 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.738442 11365 ts_tablet_manager.cc:1397] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.341s user 0.027s sys 0.028s
W20260811 06:16:53.739231 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 16674be53bd54f9395b650e19edd3cf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16674be53bd54f9395b650e19edd3cf4 already in progress: creating tablet
I20260811 06:16:53.739773 11368 tablet_replica.cc:330] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:53.738835 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.742897 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.743279 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.743851 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.749043 11365 raft_consensus.cc:348] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.749504 11365 raft_consensus.cc:374] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.749611 11365 raft_consensus.cc:729] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.749833 11766 raft_consensus.cc:482] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.750229 11365 consensus_queue.cc:260] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.757450 10915 raft_consensus.cc:2454] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:53.759130 11368 raft_consensus.cc:2229] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.759248 11766 raft_consensus.cc:504] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.760259 11368 raft_consensus.cc:2258] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.761049 11368 ts_tablet_manager.cc:1905] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.762702 11362 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.762887 11362 ts_tablet_manager.cc:1397] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.186s user 0.027s sys 0.020s
I20260811 06:16:53.764721 11872 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260811 06:16:53.766834 11365 ts_tablet_manager.cc:1428] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260811 06:16:53.768270 11365 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.772480 11868 raft_consensus.cc:482] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8dcf15ece3a4389932aa672079442b6)
I20260811 06:16:53.772544 11362 raft_consensus.cc:348] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.774426 11868 raft_consensus.cc:504] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.775463 11766 leader_election.cc:288] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.776345 11362 raft_consensus.cc:374] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.777535 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.778075 11362 raft_consensus.cc:729] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.777447 11868 leader_election.cc:288] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.778417 11362 consensus_queue.cc:260] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.781582 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.781608 11361 ts_tablet_manager.cc:1428] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.166s user 0.000s sys 0.004s
I20260811 06:16:53.782011 11799 raft_consensus.cc:482] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.782377 11361 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:53.782254 11799 raft_consensus.cc:504] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.782629 11801 consensus_queue.cc:1035] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260811 06:16:53.783291 11799 leader_election.cc:288] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:53.783896 11047 leader_election.cc:302] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:53.785271 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.787106 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd7390a2221f4a1b9948c8a1353e4a49" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:53.787400 11155 raft_consensus.cc:2454] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:53.787905 11799 raft_consensus.cc:2781] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:53.788164 11799 raft_consensus.cc:686] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:53.788537 11799 consensus_queue.cc:237] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:53.792717 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fb02f61b67147f793b3a2f063d8c56c consensus state has no leader
I20260811 06:16:53.794056 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_45c213dc71dc4248a883fce2b58fc984"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.798322 11365 tablet_bootstrap.cc:654] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.798978 11371 ts_tablet_manager.cc:1918] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:16:53.799250 11046 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cb854704951e4a399267766fb5be40e2
I20260811 06:16:53.799597 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 2875318863584e659e2b76ad2a72ca45
W20260811 06:16:53.799815 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45c213dc71dc4248a883fce2b58fc984 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.800168 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 754b5fec454d44608b62ddec7d58bfac has no consensus state
W20260811 06:16:53.801730 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c706bf0455341a0a953d937f9778b5f consensus state has no leader
I20260811 06:16:53.801823 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.802039 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c706bf0455341a0a953d937f9778b5f from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.802743 11361 tablet_bootstrap.cc:654] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.805473 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_fb7d4dc0af6a49798b4435a064babc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.805910 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_a8722fababeb4520abf519495d15cb6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.806337 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb7d4dc0af6a49798b4435a064babc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.806944 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8722fababeb4520abf519495d15cb6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.807415 10332 master_service.cc:946] ReplaceTablet: received request to replace tablet 864c3bbf1e004579a4d0be809f83ca33 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.809160 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c42b5ef0fc84627908200331f53b1a3 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.811774 11371 log.cc:1196] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/fe5eea681072477ab52a822d721629cf
I20260811 06:16:53.812734 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b054c9a152034800800171e9f8d77579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:53.813123 11371 ts_tablet_manager.cc:1939] T fe5eea681072477ab52a822d721629cf P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:53.813401 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b054c9a152034800800171e9f8d77579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:53.814081 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1981dc26be24ec5afaa3c0bb5c46c8c consensus state has no leader
I20260811 06:16:53.815227 11371 tablet_replica.cc:330] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.816493 10333 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: default.Table_ee1aab676e354fb484ae487d4316b261 [id=a66e3380ba3d46ca93a6f98468b36cc3] alter complete (version 5)
I20260811 06:16:53.816365 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_39662cb2c2484aff9fdaff055087b0ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.817003 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39662cb2c2484aff9fdaff055087b0ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.817341 11371 raft_consensus.cc:2229] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.822731 11371 raft_consensus.cc:2258] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.824555 11371 ts_tablet_manager.cc:1905] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.831470 10813 leader_election.cc:302] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:53.831604 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.831992 11766 raft_consensus.cc:2781] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:53.832120 11766 raft_consensus.cc:482] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:53.832286 11766 raft_consensus.cc:3037] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.832454 11362 ts_tablet_manager.cc:1428] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.035s user 0.004s sys 0.000s
W20260811 06:16:53.832820 11047 consensus_peers.cc:487] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:53.834527 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb854704951e4a399267766fb5be40e2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:53.835646 11047 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.835919 11047 leader_election.cc:302] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:53.836443 11702 raft_consensus.cc:2726] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.836576 11362 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.837646 11868 raft_consensus.cc:482] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:53.837754 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.837925 11868 raft_consensus.cc:504] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.839993 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d6641dd44340889879d3b92018b3f0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:53.840843 10813 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.842228 10333 master_service.cc:946] ReplaceTablet: received request to replace tablet 22cac1c339574b1fa26555b18811539b from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.842942 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f17b738cb4a84bcfbda964f7e432d1d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:53.843869 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f17b738cb4a84bcfbda964f7e432d1d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:53.844971 11370 ts_tablet_manager.cc:1918] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.845283 11370 log.cc:1196] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/4ccb7050ea9f4cc2a1b924814a204de5
I20260811 06:16:53.844944 10321 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]). Expected version 1 got 0
I20260811 06:16:53.846011 11370 ts_tablet_manager.cc:1939] T 4ccb7050ea9f4cc2a1b924814a204de5 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:53.846494 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 127) took 3723 ms. Trace:
I20260811 06:16:53.846685 11370 rpcz_store.cc:276] 0811 06:16:50.124928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.130139 (+ 5211us) service_pool.cc:227] Handling call
0811 06:16:53.601766 (+3471627us) ts_tablet_manager.cc:1145] Deleting tablet 4ccb7050ea9f4cc2a1b924814a204de5
0811 06:16:53.601792 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.674102 (+ 72310us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.844699 (+170597us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.846454 (+ 1755us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3434623}
I20260811 06:16:53.847568 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet fe5eea681072477ab52a822d721629cf (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
I20260811 06:16:53.850580 11365 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:53.850910 11365 ts_tablet_manager.cc:1397] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.004s
I20260811 06:16:53.852046 10273 master_runner.cc:186] Error getting master registration for 127.9.203.125:35327: OK, instance_id { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" instance_seqno: 1786429012056030 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 06:16:53.852473 10273 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 06:16:53.857537 10564 consensus_peers.cc:487] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:53.858639 11365 raft_consensus.cc:348] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.859190 11365 raft_consensus.cc:374] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.859607 11365 raft_consensus.cc:729] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.860143 11365 consensus_queue.cc:260] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.861116 11365 ts_tablet_manager.cc:1428] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260811 06:16:53.861455 11891 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:53.862171 11891 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:53.864679 11371 ts_tablet_manager.cc:1918] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.864761 11874 sys_catalog.cc:564] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 06:16:53.864897 11371 log.cc:1196] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6c62cbef937a46dfbc4dbf934e887139
I20260811 06:16:53.865581 11371 ts_tablet_manager.cc:1939] T 6c62cbef937a46dfbc4dbf934e887139 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:53.865633 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 4ccb7050ea9f4cc2a1b924814a204de5 (table default.Table_586d663235904c22bb85aeb30236801f [id=6e7fa977ab2a4b8e963cb21ebab03568]) successfully deleted
I20260811 06:16:53.866722 11371 tablet_replica.cc:330] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.867180 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 136) took 3677 ms. Trace:
I20260811 06:16:53.867377 11370 rpcz_store.cc:276] 0811 06:16:50.189286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.189367 (+ 81us) service_pool.cc:227] Handling call
0811 06:16:53.863410 (+3674043us) ts_tablet_manager.cc:1145] Deleting tablet 3025339a6c9e4e07bba4104006206bb8
0811 06:16:53.866949 (+ 3539us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.867117 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3667939}
I20260811 06:16:53.868105 11361 tablet_bootstrap.cc:492] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:53.868355 11361 ts_tablet_manager.cc:1397] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.006s
I20260811 06:16:53.869616 11361 raft_consensus.cc:348] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.870003 11361 raft_consensus.cc:374] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.870019 10333 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]). Expected version 1 got 0
I20260811 06:16:53.870115 11361 raft_consensus.cc:729] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.870411 11361 consensus_queue.cc:260] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.870991 11361 ts_tablet_manager.cc:1428] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 06:16:53.872879 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3025339a6c9e4e07bba4104006206bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3025339a6c9e4e07bba4104006206bb8 already in progress: creating tablet
I20260811 06:16:53.873946 11371 raft_consensus.cc:2229] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.874346 11371 raft_consensus.cc:2258] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.874395 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 137) took 3679 ms. Trace:
I20260811 06:16:53.874749 11370 rpcz_store.cc:276] 0811 06:16:50.194815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.194883 (+ 68us) service_pool.cc:227] Handling call
0811 06:16:53.867670 (+3672787us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:16:53.873066 (+ 5396us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.874321 (+ 1255us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3671928}
I20260811 06:16:53.875056 11361 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:53.875422 11370 tablet_replica.cc:330] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:53.875751 11370 raft_consensus.cc:2229] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:53.876183 11370 pending_rounds.cc:62] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:53.876406 11370 pending_rounds.cc:68] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213227925897216 op_type: NO_OP noop_request { }
I20260811 06:16:53.876669 11370 raft_consensus.cc:2866] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:53.877128 11370 raft_consensus.cc:2258] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:53.877804 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 already in progress: creating tablet
I20260811 06:16:53.878197 11370 ts_tablet_manager.cc:1905] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.879175 11868 leader_election.cc:288] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:53.879232 11894 log.cc:924] Time spent T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260811 06:16:53.879467 11362 tablet_bootstrap.cc:654] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:53.880648 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 161466us
I20260811 06:16:53.881621 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a00b0b51f574bfb843b65c0876ab4fc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:53.882428 11371 ts_tablet_manager.cc:1905] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.883869 10925 raft_consensus.cc:1261] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Refusing update from remote peer 24d29113b2454d9c93e23db3e3dac801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 06:16:53.885603 11361 tablet_bootstrap.cc:654] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.888031 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b4eb7864cc742929ac1756949b6bec5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:53.890100 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.892096 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ff1ad74f2034ed9b24c9712bae14cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.892545 11872 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.893096 11872 tablet.cc:1717] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Skipping requested alter to schema version 5, tablet already version 5
I20260811 06:16:53.893939 11371 ts_tablet_manager.cc:1918] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.894212 11371 log.cc:1196] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/67f458dba9444bfa8841a84cdb798588
I20260811 06:16:53.894670 11371 ts_tablet_manager.cc:1939] T 67f458dba9444bfa8841a84cdb798588 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:53.897197 11371 tablet_replica.cc:330] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.897964 11371 raft_consensus.cc:2229] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.898265 11371 raft_consensus.cc:2258] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.898934 11371 ts_tablet_manager.cc:1905] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.901108 11766 raft_consensus.cc:504] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.906204 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd7390a2221f4a1b9948c8a1353e4a49" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:53.906526 11155 raft_consensus.cc:3037] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:53.909621 11361 tablet_bootstrap.cc:492] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:53.909629 11155 raft_consensus.cc:2454] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:53.911201 11361 ts_tablet_manager.cc:1397] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.000s
I20260811 06:16:53.913928 11766 leader_election.cc:288] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:53.913983 10813 leader_election.cc:302] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:53.914474 11766 raft_consensus.cc:2781] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:53.914955 11368 ts_tablet_manager.cc:1918] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.912343 11361 raft_consensus.cc:348] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.915860 11368 log.cc:1196] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/94d04b025b1b45009260ddd9f1b0aabb
I20260811 06:16:53.916829 11361 raft_consensus.cc:374] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.916967 11361 raft_consensus.cc:729] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.917289 11361 consensus_queue.cc:260] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.917584 11362 tablet_bootstrap.cc:492] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.917955 11361 ts_tablet_manager.cc:1428] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260811 06:16:53.920207 11361 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:53.924522 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet b1d6641dd44340889879d3b92018b3f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:53.928706 10555 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:53.929028 10555 leader_election.cc:302] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.930006 11895 raft_consensus.cc:2726] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.931280 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6c62cbef937a46dfbc4dbf934e887139 (table default.Table_6b45271419ea4e4a9b82a7aff6a113f7 [id=28510dda062b4164a5672202cb2f268c]) successfully deleted
I20260811 06:16:53.929484 11365 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:53.932135 11895 consensus_queue.cc:1035] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:53.934322 11766 raft_consensus.cc:686] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:53.934711 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 67f458dba9444bfa8841a84cdb798588 (table default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]) successfully deleted
I20260811 06:16:53.934711 11766 consensus_queue.cc:237] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.936049 11368 ts_tablet_manager.cc:1939] T 94d04b025b1b45009260ddd9f1b0aabb P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:53.936090 11362 ts_tablet_manager.cc:1397] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.003s
W20260811 06:16:53.936136 10810 leader_election.cc:341] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:53.936515 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 190) took 2533 ms. Trace:
I20260811 06:16:53.936582 10810 leader_election.cc:302] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.936652 11368 rpcz_store.cc:276] 0811 06:16:51.403345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.403433 (+ 88us) service_pool.cc:227] Handling call
0811 06:16:53.738085 (+2334652us) ts_tablet_manager.cc:1145] Deleting tablet 94d04b025b1b45009260ddd9f1b0aabb
0811 06:16:53.738096 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.759361 (+ 21265us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x615000097024. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f194748504d 00007f19487295ec 00007f194b0b82e6 00007f194b0ea404 00007f194b0cb870 00007f194b0cb5fd 00000000009edb7c 00007f193bf8f344 00007f193bf9291b 00007f193bf92798
0811 06:16:53.899897 (+140536us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.904004 (+ 4107us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.936463 (+ 32459us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":43881856,"tablet-delete.queue_time_us":2323055}
W20260811 06:16:53.937003 10810 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:53.937150 10810 leader_election.cc:302] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:53.937216 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 188) took 2547 ms. Trace:
I20260811 06:16:53.937352 11368 rpcz_store.cc:276] 0811 06:16:51.389848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.390095 (+ 247us) service_pool.cc:227] Handling call
0811 06:16:53.936967 (+2546872us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:16:53.936984 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.937160 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2520104}
W20260811 06:16:53.938014 10810 leader_election.cc:341] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:53.937953 11362 raft_consensus.cc:348] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.938397 11868 raft_consensus.cc:2726] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:53.938414 11362 raft_consensus.cc:374] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.938562 11362 raft_consensus.cc:729] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.932947 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c4379e29a9da4cd2a3822f42fdc76315" } modify_external_catalogs: true
I20260811 06:16:53.939005 11871 raft_consensus.cc:2726] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:16:53.939041 11362 consensus_queue.cc:260] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:53.937198 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 94d04b025b1b45009260ddd9f1b0aabb (table default.Table_4145b5bbd2854fdfbbddcfa34e984604 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
I20260811 06:16:53.939249 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 191) took 2520 ms. Trace:
W20260811 06:16:53.939568 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f243c792a634abf83484aef820dbb48 already in progress: creating tablet
I20260811 06:16:53.939617 11362 ts_tablet_manager.cc:1428] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:16:53.939597 11368 rpcz_store.cc:276] 0811 06:16:51.418056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.418158 (+ 102us) service_pool.cc:227] Handling call
0811 06:16:53.937656 (+2519498us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:16:53.937666 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.938758 (+ 1092us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515319}
I20260811 06:16:53.939105 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c4379e29a9da4cd2a3822f42fdc76315" } modify_external_catalogs: true
I20260811 06:16:53.939954 11362 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:53.940160 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 192) took 2517 ms. Trace:
I20260811 06:16:53.940303 11368 rpcz_store.cc:276] 0811 06:16:51.423072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.423274 (+ 202us) service_pool.cc:227] Handling call
0811 06:16:53.939984 (+2516710us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:16:53.939996 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.940099 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515911}
I20260811 06:16:53.940848 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 206) took 2143 ms. Trace:
I20260811 06:16:53.941030 11368 rpcz_store.cc:276] 0811 06:16:51.797796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.797856 (+ 60us) service_pool.cc:227] Handling call
0811 06:16:53.940630 (+2142774us) ts_tablet_manager.cc:1145] Deleting tablet 6c62cbef937a46dfbc4dbf934e887139
0811 06:16:53.940641 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.940743 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141352}
W20260811 06:16:53.941316 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e873e2f7b3d34988856b3be044de1ed7 already in progress: creating tablet
W20260811 06:16:53.941582 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dc6254bf781740019c3f71b26179f25d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6254bf781740019c3f71b26179f25d already in progress: creating tablet
I20260811 06:16:53.941638 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 207) took 2137 ms. Trace:
I20260811 06:16:53.941831 11368 rpcz_store.cc:276] 0811 06:16:51.803687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.803742 (+ 55us) service_pool.cc:227] Handling call
0811 06:16:53.941441 (+2137699us) ts_tablet_manager.cc:1145] Deleting tablet d4d44dea35e94ed788b7e1e5a8a24d8e
0811 06:16:53.941451 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.941584 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137328}
W20260811 06:16:53.941890 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6c62cbef937a46dfbc4dbf934e887139 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c62cbef937a46dfbc4dbf934e887139 already in progress: creating tablet
I20260811 06:16:53.942284 11362 tablet_bootstrap.cc:654] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.942333 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 208) took 2137 ms. Trace:
W20260811 06:16:53.942664 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4d44dea35e94ed788b7e1e5a8a24d8e already in progress: creating tablet
I20260811 06:16:53.942546 11368 rpcz_store.cc:276] 0811 06:16:51.805246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.805535 (+ 289us) service_pool.cc:227] Handling call
0811 06:16:53.942166 (+2136631us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:16:53.942176 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.942271 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2132363}
I20260811 06:16:53.943099 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 209) took 2137 ms. Trace:
I20260811 06:16:53.943321 11368 rpcz_store.cc:276] 0811 06:16:51.809326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.809392 (+ 66us) service_pool.cc:227] Handling call
0811 06:16:53.942931 (+2133539us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:16:53.942941 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.943044 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2132185}
I20260811 06:16:53.943929 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 210) took 2101 ms. Trace:
W20260811 06:16:53.943996 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 217f60a1ca044af38f9ee9093e021c27 already in progress: creating tablet
I20260811 06:16:53.944132 11368 rpcz_store.cc:276] 0811 06:16:51.842367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.842515 (+ 148us) service_pool.cc:227] Handling call
0811 06:16:53.943738 (+2101223us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:16:53.943748 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.943884 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2097420}
W20260811 06:16:53.944281 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c5efe8eb16e84575abd18a5079aad2c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5efe8eb16e84575abd18a5079aad2c9 already in progress: creating tablet
I20260811 06:16:53.944555 11368 tablet_replica.cc:330] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:16:53.944572 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7fbdda840466420f8d67a8cb5868ba03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fbdda840466420f8d67a8cb5868ba03 already in progress: creating tablet
I20260811 06:16:53.944809 11368 raft_consensus.cc:2229] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.945079 11368 raft_consensus.cc:2258] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.945859 11368 ts_tablet_manager.cc:1905] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:53.946218 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532208d7a02d448e8dac702ffe6c2ffc already in progress: creating tablet
I20260811 06:16:53.947921 11370 ts_tablet_manager.cc:1918] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:53.949369 11365 tablet_bootstrap.cc:654] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.952965 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ecbfc78f213d4d2f9efe02b95e85e6ef" } modify_external_catalogs: true
I20260811 06:16:53.953183 10337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f87e6f04862c4ce69e2d6650e87e0618" } modify_external_catalogs: true
I20260811 06:16:53.953231 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ecbfc78f213d4d2f9efe02b95e85e6ef" } modify_external_catalogs: true
I20260811 06:16:53.953410 10337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f87e6f04862c4ce69e2d6650e87e0618" } modify_external_catalogs: true
I20260811 06:16:53.954111 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_03dde8ecdd2c42e8a59b48127464bff2" } modify_external_catalogs: true
I20260811 06:16:53.954316 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_03dde8ecdd2c42e8a59b48127464bff2" } modify_external_catalogs: true
I20260811 06:16:53.955199 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a8b81d583a3d4a01b5d0e7d00d37ec95" } new_table_name: "default.Table_d27b07ecce6448f09fb6ec0051be431c" modify_external_catalogs: true
I20260811 06:16:53.957804 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 864c3bbf1e004579a4d0be809f83ca33
I20260811 06:16:53.958276 10332 catalog_manager.cc:6565] ReplaceTablet: tablet 864c3bbf1e004579a4d0be809f83ca33 deleted and replaced by tablet b246b0e53af34c089f4fd67174396f44
I20260811 06:16:53.959137 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6c706bf0455341a0a953d937f9778b5f
I20260811 06:16:53.959585 10328 catalog_manager.cc:6565] ReplaceTablet: tablet 6c706bf0455341a0a953d937f9778b5f deleted and replaced by tablet a25b6d0d733c44398a233b595caad8a0
I20260811 06:16:53.960685 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.961027 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.969947 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.970304 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.957412 11371 ts_tablet_manager.cc:1918] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:53.970857 11371 log.cc:1196] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f88af70bbada49309a0e7cc7c333d6f0
I20260811 06:16:53.970857 11370 log.cc:1196] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ee0f6ba0c08149f981fe27c5d40346cc
I20260811 06:16:53.971458 11371 ts_tablet_manager.cc:1939] T f88af70bbada49309a0e7cc7c333d6f0 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:53.971464 11370 ts_tablet_manager.cc:1939] T ee0f6ba0c08149f981fe27c5d40346cc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:53.972332 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 128) took 3822 ms. Trace:
I20260811 06:16:53.959170 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.961694 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.959161 11361 tablet_bootstrap.cc:654] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:53.972748 11370 rpcz_store.cc:276] 0811 06:16:50.149773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.197546 (+ 47773us) service_pool.cc:227] Handling call
0811 06:16:53.875319 (+3677773us) ts_tablet_manager.cc:1145] Deleting tablet ee0f6ba0c08149f981fe27c5d40346cc
0811 06:16:53.875340 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.895282 (+ 19942us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.947726 (+ 52444us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:53.972292 (+ 24566us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515796}
I20260811 06:16:53.973409 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ee0f6ba0c08149f981fe27c5d40346cc (table default.Table_830bbd5a95fc4f45addf2c57b787c2d9 [id=257d5c1ee6aa4f1c8060822ef0fae341]) successfully deleted
I20260811 06:16:53.973549 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 143) took 3616 ms. Trace:
I20260811 06:16:53.973989 11371 tablet_replica.cc:330] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:53.974058 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f88af70bbada49309a0e7cc7c333d6f0 (table default.Table_5158afff0daf485d8ebd8e03934c96b9 [id=d69efd0f2d58483fa432041de974afee]) successfully deleted
I20260811 06:16:53.973750 11370 rpcz_store.cc:276] 0811 06:16:50.356620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.356791 (+ 171us) service_pool.cc:227] Handling call
0811 06:16:53.973340 (+3616549us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:16:53.973352 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.973492 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3599106}
I20260811 06:16:53.975430 11371 raft_consensus.cc:2229] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:53.975459 11362 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:53.975647 11362 ts_tablet_manager.cc:1397] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.002s
I20260811 06:16:53.975898 11371 raft_consensus.cc:2258] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.976732 11362 raft_consensus.cc:348] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.977109 11362 raft_consensus.cc:374] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:53.977303 11362 raft_consensus.cc:729] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:53.978406 11371 ts_tablet_manager.cc:1905] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:53.981340 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 916b91088d7d4024a02214c958c0825b
I20260811 06:16:53.982180 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.990015 10330 master_service.cc:946] ReplaceTablet: received request to replace tablet 4ccb7050ea9f4cc2a1b924814a204de5 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:53.990571 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:53.990818 10321 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
I20260811 06:16:53.992003 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet cb854704951e4a399267766fb5be40e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:53.988027 11362 consensus_queue.cc:260] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:53.982762 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:53.994797 11370 tablet_replica.cc:330] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:16:53.994776 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b39dfcd1a66b4241bc6f5c38e930f048 already in progress: creating tablet
I20260811 06:16:53.995244 11370 raft_consensus.cc:2229] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:53.995733 11370 raft_consensus.cc:2258] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:53.998953 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 847df543db4244a6b2900fc16fea7c07
I20260811 06:16:53.999782 10318 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 7ff8ab79af1a4842ad76afd7fd266869
I20260811 06:16:53.999979 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:54.000206 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91f079882c3c46318f70190d5293868e has no consensus state
I20260811 06:16:54.007376 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.008090 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.011610 11362 ts_tablet_manager.cc:1428] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260811 06:16:54.012068 11362 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:54.014420 11912 tablet.cc:1722] T e1ee53b81b8a441d8f9186bceb61129c P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:16:54.016758 11004 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:54.017198 11362 tablet_bootstrap.cc:654] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.028200 11362 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:54.028476 11362 ts_tablet_manager.cc:1397] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260811 06:16:54.029323 11762 raft_consensus.cc:482] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.029456 11362 raft_consensus.cc:348] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.029565 11762 raft_consensus.cc:504] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.029801 11362 raft_consensus.cc:374] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.029906 11362 raft_consensus.cc:729] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.030349 11762 leader_election.cc:288] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.030232 11362 consensus_queue.cc:260] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.030941 11361 tablet_bootstrap.cc:492] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:54.031569 11362 ts_tablet_manager.cc:1428] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 06:16:54.032013 11362 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:54.032115 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:54.031267 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.031204 11361 ts_tablet_manager.cc:1397] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.111s user 0.001s sys 0.005s
W20260811 06:16:54.033469 10555 leader_election.cc:341] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:54.034123 10564 leader_election.cc:341] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.034317 10564 leader_election.cc:302] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.034454 11361 raft_consensus.cc:348] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.034729 11361 raft_consensus.cc:374] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.034830 11361 raft_consensus.cc:729] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.034940 11362 tablet_bootstrap.cc:654] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.035214 11762 raft_consensus.cc:2726] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.036742 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5ce77e1cba8d4f0a91463c158aa9c7b5" } new_table_name: "default.Table_2dd734f7b4474e44acfdf0e5151b6b21" modify_external_catalogs: true
I20260811 06:16:54.038339 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6f3b141d76224d23b743c380e462b237" } new_table_name: "default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc" modify_external_catalogs: true
I20260811 06:16:54.038859 11361 consensus_queue.cc:260] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.039644 11361 ts_tablet_manager.cc:1428] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 06:16:54.040020 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ce573f2b138b48c9bdf6217511e00ed9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.040627 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce573f2b138b48c9bdf6217511e00ed9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.043088 11935 tablet.cc:1722] T e1ee53b81b8a441d8f9186bceb61129c P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:16:54.045348 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_71a49e0ffd5f4420a30d39b21a9487af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.045975 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71a49e0ffd5f4420a30d39b21a9487af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.047715 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.048357 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.049758 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1b01c15261dc476491265a825c5ddd3f" } new_table_name: "default.Table_1fd91288bb3747f69cb7219edb4271cb" modify_external_catalogs: true
I20260811 06:16:54.053810 10747 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:16:54.054678 10333 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_ceb4c433db0b4d098442695e2441817e [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 2 got 0
I20260811 06:16:54.055413 11370 ts_tablet_manager.cc:1905] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.056521 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2e55d5e0244c299d837aed98f94aad (DEFAULT_TABLE table=default.Table_432d41d1b12145e39802023ebd08d467 [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.056905 10333 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]). Expected version 1 got 0
I20260811 06:16:54.056999 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2e55d5e0244c299d837aed98f94aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.060947 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4ea49146e0734f28907e8531d1e8a5e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.061453 10616 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ac72e2e3450a9f777316742653bc (DEFAULT_TABLE table=default.Table_6580760971534d17ba27adcc6f5cd336 [id=5c3567ca43b14ae78bd7df4dc89d4733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.061468 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 55b38127e97f400f879afc94c0672906 (DEFAULT_TABLE table=default.Table_2a7a2180fd1746db98808d9d4ea17647 [id=a7bbd23c07d24c52b33a8082168cbf87]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.062115 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ea49146e0734f28907e8531d1e8a5e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.062259 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ac72e2e3450a9f777316742653bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.042302 11361 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:54.066598 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.057650 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2a7a2180fd1746db98808d9d4ea17647" } new_table_name: "default.Table_021b3433e8a447318649cd83bcc5a326" modify_external_catalogs: true
I20260811 06:16:54.070830 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b38127e97f400f879afc94c0672906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.071516 11371 ts_tablet_manager.cc:1918] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:54.071921 10859 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ac72e2e3450a9f777316742653bc (DEFAULT_TABLE table=default.Table_6580760971534d17ba27adcc6f5cd336 [id=5c3567ca43b14ae78bd7df4dc89d4733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.072508 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ac72e2e3450a9f777316742653bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.073705 11371 log.cc:1196] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:54.077975 11371 ts_tablet_manager.cc:1939] T c00b6bdfc8ac4b5db81de9f614fcf213 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:54.081271 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2e55d5e0244c299d837aed98f94aad (DEFAULT_TABLE table=default.Table_432d41d1b12145e39802023ebd08d467 [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.084407 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22feadfa433d46cc9f5dc052b3421e56 consensus state has no leader
I20260811 06:16:54.084990 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.085472 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 585f92fc5b3d41bd97df525380fcab9f (DEFAULT_TABLE table=default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.086290 11361 tablet_bootstrap.cc:654] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.087502 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef (DEFAULT_TABLE table=default.Table_fbf17bb2af5b4d5d81bc6f00a757be78 [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.088764 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 67e2683156f8466b8d63b298c9da15c1 (DEFAULT_TABLE table=default.Table_525aee396dc64b5c8c61da99ad866f4a [id=53bd4127d81e4fb092a5943858c8ee51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.089135 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 681736b44af04718b800d503ca645c1a
I20260811 06:16:54.090103 10321 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659] alter complete (version 3)
I20260811 06:16:54.090160 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_fb7d4dc0af6a49798b4435a064babc27" } modify_external_catalogs: true
I20260811 06:16:54.090409 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_fb7d4dc0af6a49798b4435a064babc27" } modify_external_catalogs: true
W20260811 06:16:54.091251 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 035eee1d37c94471a7cd697fb0fbb951 consensus state has no leader
I20260811 06:16:54.091300 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 585f92fc5b3d41bd97df525380fcab9f (DEFAULT_TABLE table=default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.091831 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c00b6bdfc8ac4b5db81de9f614fcf213 (table default.Table_c94c766b75e749a7bf08f8b110567bf6 [id=93e85671b313459588f530b2d88ef20e]) successfully deleted
I20260811 06:16:54.092258 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 91f079882c3c46318f70190d5293868e (DEFAULT_TABLE table=default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.092530 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45ebef95922f4e7f93533b54c07b7cec consensus state has no leader
I20260811 06:16:54.093374 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef (DEFAULT_TABLE table=default.Table_fbf17bb2af5b4d5d81bc6f00a757be78 [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.096621 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.097327 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef97b47809940f4bfee89cc0515edcf (DEFAULT_TABLE table=default.Table_1fb146978bd445a0b62f5c36e9ba593b [id=71a6e6e546cd44e3af189cbf486e121f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.097981 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 91f079882c3c46318f70190d5293868e (DEFAULT_TABLE table=default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.098434 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef (DEFAULT_TABLE table=default.Table_fbf17bb2af5b4d5d81bc6f00a757be78 [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.098765 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.099022 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2e55d5e0244c299d837aed98f94aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.099047 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 55b38127e97f400f879afc94c0672906 (DEFAULT_TABLE table=default.Table_2a7a2180fd1746db98808d9d4ea17647 [id=a7bbd23c07d24c52b33a8082168cbf87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.101065 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 585f92fc5b3d41bd97df525380fcab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.101378 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 847df543db4244a6b2900fc16fea7c07 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:54.102234 10619 tablet_service.cc:1467] Processing CreateTablet for tablet 91f079882c3c46318f70190d5293868e (DEFAULT_TABLE table=default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.103032 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef97b47809940f4bfee89cc0515edcf (DEFAULT_TABLE table=default.Table_1fb146978bd445a0b62f5c36e9ba593b [id=71a6e6e546cd44e3af189cbf486e121f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.103663 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0ae9a1d3b74c3985637439819b63ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.104684 11371 tablet_replica.cc:330] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:54.105731 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f079882c3c46318f70190d5293868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.107018 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e2683156f8466b8d63b298c9da15c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.110011 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef97b47809940f4bfee89cc0515edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.111536 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b38127e97f400f879afc94c0672906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.113147 11371 raft_consensus.cc:2229] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.114210 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f079882c3c46318f70190d5293868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.114475 11371 raft_consensus.cc:2258] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.115751 11371 ts_tablet_manager.cc:1905] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.118172 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 585f92fc5b3d41bd97df525380fcab9f (DEFAULT_TABLE table=default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.120832 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55b38127e97f400f879afc94c0672906 consensus state has no leader
I20260811 06:16:54.122999 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.123556 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef97b47809940f4bfee89cc0515edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.133647 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 585f92fc5b3d41bd97df525380fcab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.134087 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 0813b34919a14a2481857e9f87b217c8 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.134624 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0ae9a1d3b74c3985637439819b63ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.136443 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 0813b34919a14a2481857e9f87b217c8 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.137261 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0813b34919a14a2481857e9f87b217c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.139065 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 7716cda181d444a99d69cbc9ade3269e (DEFAULT_TABLE table=default.Table_4485cb9a9e344ab5b4701e6fface0bba [id=832a83a4d4ba4f26a9437c48bb0c7c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.139128 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 7716cda181d444a99d69cbc9ade3269e (DEFAULT_TABLE table=default.Table_4485cb9a9e344ab5b4701e6fface0bba [id=832a83a4d4ba4f26a9437c48bb0c7c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.140231 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 0813b34919a14a2481857e9f87b217c8 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.140430 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 7716cda181d444a99d69cbc9ade3269e (DEFAULT_TABLE table=default.Table_4485cb9a9e344ab5b4701e6fface0bba [id=832a83a4d4ba4f26a9437c48bb0c7c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.140926 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7716cda181d444a99d69cbc9ade3269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.143148 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 17d90d3d23454c5bbeba1bb900b68c73 (DEFAULT_TABLE table=default.Table_aa6b10390f404e3aba1f467371294eb8 [id=31d35606d6554b798cc3890eae2547ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.146144 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 17d90d3d23454c5bbeba1bb900b68c73 (DEFAULT_TABLE table=default.Table_aa6b10390f404e3aba1f467371294eb8 [id=31d35606d6554b798cc3890eae2547ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.147421 10632 tablet_service.cc:1467] Processing CreateTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 (DEFAULT_TABLE table=default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.150887 10886 tablet_service.cc:1467] Processing CreateTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 (DEFAULT_TABLE table=default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.153985 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 (DEFAULT_TABLE table=default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.154712 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d90d3d23454c5bbeba1bb900b68c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.154770 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 (DEFAULT_TABLE table=default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.155274 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 035eee1d37c94471a7cd697fb0fbb951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.155907 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 1349b0ea48b848398d4bdda528358c30 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.157938 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c3e243e72f4cffb3318246ab428bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.161965 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 1349b0ea48b848398d4bdda528358c30 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.163856 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 67e2683156f8466b8d63b298c9da15c1 (DEFAULT_TABLE table=default.Table_525aee396dc64b5c8c61da99ad866f4a [id=53bd4127d81e4fb092a5943858c8ee51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.170780 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0fd9c63926f444c889cc20db4e5185a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.171522 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fd9c63926f444c889cc20db4e5185a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.173098 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c0c8c3cafad748299fdc39d29c90a58f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.173635 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0c8c3cafad748299fdc39d29c90a58f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.174882 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1eecfa20d58747f69101093c3f4c9443"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.175506 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eecfa20d58747f69101093c3f4c9443 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.176923 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1349b0ea48b848398d4bdda528358c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.177498 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_98dfdc335a9a4099a9eecb03b173c8af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.178074 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98dfdc335a9a4099a9eecb03b173c8af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.179517 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_71704b455f8b486386183aea5444d3ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.180023 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71704b455f8b486386183aea5444d3ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.184885 11368 ts_tablet_manager.cc:1918] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:54.193156 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_12c813de7c074af4a5f244b7b9c3d9aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.193849 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12c813de7c074af4a5f244b7b9c3d9aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.193967 11107 tablet_service.cc:1467] Processing CreateTablet for tablet cd53ac72e2e3450a9f777316742653bc (DEFAULT_TABLE table=default.Table_6580760971534d17ba27adcc6f5cd336 [id=5c3567ca43b14ae78bd7df4dc89d4733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.194702 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 1a2e55d5e0244c299d837aed98f94aad (DEFAULT_TABLE table=default.Table_432d41d1b12145e39802023ebd08d467 [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.194969 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 55b38127e97f400f879afc94c0672906 (DEFAULT_TABLE table=default.Table_2a7a2180fd1746db98808d9d4ea17647 [id=a7bbd23c07d24c52b33a8082168cbf87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.196127 11799 raft_consensus.cc:482] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.196071 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9acf8fc7ef294818b6d7ef52993c33ff" } modify_external_catalogs: true
I20260811 06:16:54.196166 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e2683156f8466b8d63b298c9da15c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.196326 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9acf8fc7ef294818b6d7ef52993c33ff" } modify_external_catalogs: true
I20260811 06:16:54.196288 11799 raft_consensus.cc:504] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.197909 11799 leader_election.cc:288] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:54.198256 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 67e2683156f8466b8d63b298c9da15c1 (DEFAULT_TABLE table=default.Table_525aee396dc64b5c8c61da99ad866f4a [id=53bd4127d81e4fb092a5943858c8ee51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.198701 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 17d90d3d23454c5bbeba1bb900b68c73 (DEFAULT_TABLE table=default.Table_aa6b10390f404e3aba1f467371294eb8 [id=31d35606d6554b798cc3890eae2547ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.201972 11362 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:54.202987 11368 log.cc:1196] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/4ccb7050ea9f4cc2a1b924814a204de5
I20260811 06:16:54.203092 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 754b5fec454d44608b62ddec7d58bfac (DEFAULT_TABLE table=default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.205513 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.205780 11109 tablet_service.cc:1467] Processing CreateTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 (DEFAULT_TABLE table=default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.206398 11362 ts_tablet_manager.cc:1397] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.170s user 0.003s sys 0.007s
I20260811 06:16:54.206665 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 585f92fc5b3d41bd97df525380fcab9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.207471 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d90d3d23454c5bbeba1bb900b68c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.208678 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b0ae9a1d3b74c3985637439819b63ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.208631 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 (DEFAULT_TABLE table=default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.208691 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff1ad74f2034ed9b24c9712bae14cd3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:54.208971 10925 raft_consensus.cc:2454] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:54.209857 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 035eee1d37c94471a7cd697fb0fbb951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.209988 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 1349b0ea48b848398d4bdda528358c30 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.211361 11766 raft_consensus.cc:482] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.211537 11766 raft_consensus.cc:504] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.213762 11362 raft_consensus.cc:348] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.213846 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef97b47809940f4bfee89cc0515edcf (DEFAULT_TABLE table=default.Table_1fb146978bd445a0b62f5c36e9ba593b [id=71a6e6e546cd44e3af189cbf486e121f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.214046 11362 raft_consensus.cc:374] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.213940 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 754b5fec454d44608b62ddec7d58bfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.215483 11362 raft_consensus.cc:729] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.215807 11362 consensus_queue.cc:260] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.216610 11370 ts_tablet_manager.cc:1918] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:54.218542 11370 log.cc:1196] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/cbab2b67ef434ebebe7fe947e9c4ff66
I20260811 06:16:54.219605 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 754b5fec454d44608b62ddec7d58bfac (DEFAULT_TABLE table=default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.220005 11370 ts_tablet_manager.cc:1939] T cbab2b67ef434ebebe7fe947e9c4ff66 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:54.221045 11047 leader_election.cc:302] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:54.221704 11799 raft_consensus.cc:2781] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:54.223652 11799 raft_consensus.cc:482] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:54.223826 11799 raft_consensus.cc:3037] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:54.227322 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb" } modify_external_catalogs: true
I20260811 06:16:54.227607 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb" } modify_external_catalogs: true
I20260811 06:16:54.221983 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efe8eb16e84575abd18a5079aad2c9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.228474 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_889fe834de014fd8add63e0a4fec5334" } modify_external_catalogs: true
I20260811 06:16:54.228790 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_889fe834de014fd8add63e0a4fec5334" } modify_external_catalogs: true
W20260811 06:16:54.228834 10813 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.231019 11799 raft_consensus.cc:504] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.232120 11766 leader_election.cc:288] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.236941 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c3e243e72f4cffb3318246ab428bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.237404 11799 leader_election.cc:288] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:54.246129 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 144) took 3861 ms. Trace:
I20260811 06:16:54.255033 11370 rpcz_store.cc:276] 0811 06:16:50.359532 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.359613 (+ 81us) service_pool.cc:227] Handling call
0811 06:16:53.994720 (+3635107us) ts_tablet_manager.cc:1145] Deleting tablet cbab2b67ef434ebebe7fe947e9c4ff66
0811 06:16:53.994735 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.096301 (+101566us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.216461 (+120160us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.220880 (+ 4419us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":949,"tablet-delete.queue_time_us":3612145}
I20260811 06:16:54.256161 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet cbab2b67ef434ebebe7fe947e9c4ff66 (table default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]) successfully deleted
I20260811 06:16:54.257368 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0813b34919a14a2481857e9f87b217c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.257987 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e2683156f8466b8d63b298c9da15c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.258843 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 754b5fec454d44608b62ddec7d58bfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.259100 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef97b47809940f4bfee89cc0515edcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.259443 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd53ac72e2e3450a9f777316742653bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.259673 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ff1ad74f2034ed9b24c9712bae14cd3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:54.259970 10925 raft_consensus.cc:3037] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:54.259980 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 141) took 3900 ms. Trace:
I20260811 06:16:54.260264 11370 rpcz_store.cc:276] 0811 06:16:50.356333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.356791 (+ 458us) service_pool.cc:227] Handling call
0811 06:16:54.256780 (+3899989us) ts_tablet_manager.cc:1145] Deleting tablet f88af70bbada49309a0e7cc7c333d6f0
0811 06:16:54.256832 (+ 52us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.257129 (+ 297us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":971,"tablet-delete.queue_time_us":3874151}
I20260811 06:16:54.261137 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 142) took 3904 ms. Trace:
I20260811 06:16:54.261313 11370 rpcz_store.cc:276] 0811 06:16:50.356504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.356766 (+ 262us) service_pool.cc:227] Handling call
0811 06:16:54.260870 (+3904104us) ts_tablet_manager.cc:1145] Deleting tablet c00b6bdfc8ac4b5db81de9f614fcf213
0811 06:16:54.260882 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.261054 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":862,"tablet-delete.queue_time_us":3878050}
I20260811 06:16:54.261842 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 149) took 3605 ms. Trace:
I20260811 06:16:54.261919 11368 ts_tablet_manager.cc:1939] T 4ccb7050ea9f4cc2a1b924814a204de5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.262035 11370 rpcz_store.cc:276] 0811 06:16:50.656637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.656717 (+ 80us) service_pool.cc:227] Handling call
0811 06:16:54.261628 (+3604911us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:16:54.261639 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.261757 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3603972}
I20260811 06:16:54.262326 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 211) took 2416 ms. Trace:
I20260811 06:16:54.262450 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 150) took 3603 ms. Trace:
I20260811 06:16:54.262463 11368 rpcz_store.cc:276] 0811 06:16:51.845765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.846369 (+ 604us) service_pool.cc:227] Handling call
0811 06:16:53.944468 (+2098099us) ts_tablet_manager.cc:1145] Deleting tablet 4ccb7050ea9f4cc2a1b924814a204de5
0811 06:16:53.944479 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:53.991359 (+ 46880us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.164497 (+173138us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.262264 (+ 97767us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2097888}
I20260811 06:16:54.262616 11370 rpcz_store.cc:276] 0811 06:16:50.658916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.658992 (+ 76us) service_pool.cc:227] Handling call
0811 06:16:54.262276 (+3603284us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:16:54.262285 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.262374 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3601225}
I20260811 06:16:54.262959 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 4ccb7050ea9f4cc2a1b924814a204de5 (table default.Table_586d663235904c22bb85aeb30236801f [id=6e7fa977ab2a4b8e963cb21ebab03568]) successfully deleted
I20260811 06:16:54.263077 10925 raft_consensus.cc:2454] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:54.263273 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 151) took 3601 ms. Trace:
I20260811 06:16:54.263479 11370 rpcz_store.cc:276] 0811 06:16:50.661786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.661868 (+ 82us) service_pool.cc:227] Handling call
0811 06:16:54.263078 (+3601210us) ts_tablet_manager.cc:1145] Deleting tablet a4a46cec25944310a838d8323b119883
0811 06:16:54.263087 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.263185 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3544803}
I20260811 06:16:54.264086 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 152) took 3550 ms. Trace:
I20260811 06:16:54.264323 11370 rpcz_store.cc:276] 0811 06:16:50.713388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.713450 (+ 62us) service_pool.cc:227] Handling call
0811 06:16:54.263757 (+3550307us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:16:54.263766 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.263873 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3542366}
I20260811 06:16:54.264843 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 153) took 3545 ms. Trace:
I20260811 06:16:54.265033 11370 rpcz_store.cc:276] 0811 06:16:50.718879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:50.718927 (+ 48us) service_pool.cc:227] Handling call
0811 06:16:54.264611 (+3545684us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:16:54.264621 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.264741 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516859}
W20260811 06:16:54.265551 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f88af70bbada49309a0e7cc7c333d6f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f88af70bbada49309a0e7cc7c333d6f0 already in progress: creating tablet
I20260811 06:16:54.265931 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 165) took 3246 ms. Trace:
W20260811 06:16:54.265913 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c00b6bdfc8ac4b5db81de9f614fcf213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c00b6bdfc8ac4b5db81de9f614fcf213 already in progress: creating tablet
W20260811 06:16:54.266152 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 285b85c854bf400295b288314947840e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 285b85c854bf400295b288314947840e already in progress: creating tablet
I20260811 06:16:54.266148 11370 rpcz_store.cc:276] 0811 06:16:51.019881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.020303 (+ 422us) service_pool.cc:227] Handling call
0811 06:16:54.265745 (+3245442us) ts_tablet_manager.cc:1145] Deleting tablet 7a00b0b51f574bfb843b65c0876ab4fc
0811 06:16:54.265757 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.265845 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3243428}
W20260811 06:16:54.266537 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c42b5ef0fc84627908200331f53b1a3 already in progress: creating tablet
W20260811 06:16:54.266850 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a4a46cec25944310a838d8323b119883 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a46cec25944310a838d8323b119883 already in progress: creating tablet
I20260811 06:16:54.266897 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 166) took 3246 ms. Trace:
I20260811 06:16:54.267103 11370 rpcz_store.cc:276] 0811 06:16:51.020062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.020881 (+ 819us) service_pool.cc:227] Handling call
0811 06:16:54.266560 (+3245679us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:16:54.266570 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.266714 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3243938}
W20260811 06:16:54.267354 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2bdb349406a46629e6c307e1ebfd9dc already in progress: creating tablet
W20260811 06:16:54.267752 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7a00b0b51f574bfb843b65c0876ab4fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a00b0b51f574bfb843b65c0876ab4fc already in progress: creating tablet
I20260811 06:16:54.267817 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 164) took 3248 ms. Trace:
W20260811 06:16:54.268066 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 58fdb5920003438d983987ff242f6dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58fdb5920003438d983987ff242f6dce already in progress: creating tablet
I20260811 06:16:54.269150 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7716cda181d444a99d69cbc9ade3269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.270112 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1349b0ea48b848398d4bdda528358c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.272832 11362 ts_tablet_manager.cc:1428] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20260811 06:16:54.267948 11370 rpcz_store.cc:276] 0811 06:16:51.019128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.019358 (+ 230us) service_pool.cc:227] Handling call
0811 06:16:54.267562 (+3248204us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:16:54.267572 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.267683 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21945,"tablet-delete.queue_time_us":3242219}
I20260811 06:16:54.277168 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 167) took 3256 ms. Trace:
I20260811 06:16:54.277376 11370 rpcz_store.cc:276] 0811 06:16:51.020245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.020913 (+ 668us) service_pool.cc:227] Handling call
0811 06:16:54.276564 (+3255651us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:16:54.276576 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.276702 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11957,"tablet-delete.queue_time_us":3241053}
I20260811 06:16:54.279078 11370 tablet_replica.cc:330] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:16:54.279606 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0bbf657cb27f4da9a4f595242864163a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bbf657cb27f4da9a4f595242864163a already in progress: creating tablet
W20260811 06:16:54.279980 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 52953438e7c248b1a758ee219405d7da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52953438e7c248b1a758ee219405d7da already in progress: creating tablet
I20260811 06:16:54.280362 11362 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:54.281436 11370 raft_consensus.cc:2229] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.281770 11047 leader_election.cc:302] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:54.283177 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 212) took 2415 ms. Trace:
I20260811 06:16:54.287024 11368 rpcz_store.cc:276] 0811 06:16:51.854814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.856581 (+ 1767us) service_pool.cc:227] Handling call
0811 06:16:54.262740 (+2406159us) ts_tablet_manager.cc:1145] Deleting tablet 52543aa31a1749d1a0fd5e48cbe30889
0811 06:16:54.262751 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.270188 (+ 7437us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2398602}
W20260811 06:16:54.287834 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52543aa31a1749d1a0fd5e48cbe30889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52543aa31a1749d1a0fd5e48cbe30889 already in progress: creating tablet
I20260811 06:16:54.288393 11368 tablet_replica.cc:330] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.289397 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7716cda181d444a99d69cbc9ade3269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.293366 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 754b5fec454d44608b62ddec7d58bfac (DEFAULT_TABLE table=default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.295549 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efe8eb16e84575abd18a5079aad2c9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:54.296257 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 754b5fec454d44608b62ddec7d58bfac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:54.297284 10810 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:54.298509 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0813b34919a14a2481857e9f87b217c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.299599 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5c3e243e72f4cffb3318246ab428bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.300089 10810 leader_election.cc:302] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.300612 11766 raft_consensus.cc:2726] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.300817 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d90d3d23454c5bbeba1bb900b68c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.300901 11368 raft_consensus.cc:2229] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.302369 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 035eee1d37c94471a7cd697fb0fbb951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.302919 11368 raft_consensus.cc:2258] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.303630 11368 ts_tablet_manager.cc:1905] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.308151 11362 tablet_bootstrap.cc:654] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.326435 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1349b0ea48b848398d4bdda528358c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.327343 11766 raft_consensus.cc:482] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.327564 11766 raft_consensus.cc:504] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.332082 11766 leader_election.cc:288] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.332808 11368 ts_tablet_manager.cc:1918] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:54.332978 11368 log.cc:1196] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/57144ad37b874c91a89a25665a85eeb2
I20260811 06:16:54.334358 11368 ts_tablet_manager.cc:1939] T 57144ad37b874c91a89a25665a85eeb2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.335217 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 213) took 2453 ms. Trace:
I20260811 06:16:54.335404 11368 rpcz_store.cc:276] 0811 06:16:51.882238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.882434 (+ 196us) service_pool.cc:227] Handling call
0811 06:16:54.287396 (+2404962us) ts_tablet_manager.cc:1145] Deleting tablet 57144ad37b874c91a89a25665a85eeb2
0811 06:16:54.287408 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.326867 (+ 39459us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.332662 (+ 5795us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.335157 (+ 2495us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2389891}
I20260811 06:16:54.335930 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 57144ad37b874c91a89a25665a85eeb2 (table default.Table_ceb4c433db0b4d098442695e2441817e [id=7aa63339f43e4b59ab6af32afc629ccd]) successfully deleted
I20260811 06:16:54.336145 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 231) took 2185 ms. Trace:
I20260811 06:16:54.336321 11368 rpcz_store.cc:276] 0811 06:16:52.150499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.153805 (+ 3306us) service_pool.cc:227] Handling call
0811 06:16:54.335909 (+2182104us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:16:54.335923 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.336086 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2159265}
W20260811 06:16:54.336794 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f4f14a0add084048b92a501476ad6588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f14a0add084048b92a501476ad6588 already in progress: creating tablet
I20260811 06:16:54.336884 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 230) took 2186 ms. Trace:
I20260811 06:16:54.337033 11368 rpcz_store.cc:276] 0811 06:16:52.150361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.153871 (+ 3510us) service_pool.cc:227] Handling call
0811 06:16:54.336710 (+2182839us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:16:54.336720 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.336824 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2039673}
I20260811 06:16:54.337339 11766 raft_consensus.cc:482] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:54.337527 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a378a6f20c564eb685b655a762b638ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a378a6f20c564eb685b655a762b638ae already in progress: creating tablet
I20260811 06:16:54.337651 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 232) took 2186 ms. Trace:
I20260811 06:16:54.337571 11766 raft_consensus.cc:504] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.337828 11368 rpcz_store.cc:276] 0811 06:16:52.150665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.176677 (+ 26012us) service_pool.cc:227] Handling call
0811 06:16:54.337478 (+2160801us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:16:54.337488 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.337594 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2020780}
W20260811 06:16:54.338204 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ad5529d4844f61b0888624e7c8b3ce already in progress: creating tablet
I20260811 06:16:54.338241 11368 tablet_replica.cc:330] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.338585 11368 raft_consensus.cc:2229] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.338805 11368 raft_consensus.cc:2258] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.339830 11368 ts_tablet_manager.cc:1905] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:54.340227 10810 leader_election.cc:341] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e7d44fa2df924751a4835821901b56de
I20260811 06:16:54.340530 11766 leader_election.cc:288] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.348500 11365 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:54.348745 11365 ts_tablet_manager.cc:1397] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.419s user 0.001s sys 0.006s
I20260811 06:16:54.349764 11365 raft_consensus.cc:348] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.350121 11365 raft_consensus.cc:374] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.350230 11365 raft_consensus.cc:729] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.350533 11365 consensus_queue.cc:260] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.351244 11365 ts_tablet_manager.cc:1428] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:16:54.333227 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:54.356665 11368 ts_tablet_manager.cc:1918] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:54.356866 11368 log.cc:1196] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/cbab2b67ef434ebebe7fe947e9c4ff66
I20260811 06:16:54.357375 11368 ts_tablet_manager.cc:1939] T cbab2b67ef434ebebe7fe947e9c4ff66 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.357797 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 234) took 1547 ms. Trace:
I20260811 06:16:54.357921 11368 rpcz_store.cc:276] 0811 06:16:52.810419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.811945 (+ 1526us) service_pool.cc:227] Handling call
0811 06:16:54.338146 (+1526201us) ts_tablet_manager.cc:1145] Deleting tablet cbab2b67ef434ebebe7fe947e9c4ff66
0811 06:16:54.338156 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.346809 (+ 8653us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.356540 (+ 9731us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.357741 (+ 1201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1509876}
I20260811 06:16:54.358405 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet cbab2b67ef434ebebe7fe947e9c4ff66 (table default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]) successfully deleted
I20260811 06:16:54.360464 10331 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet aacc98a3f6da441bb2e059595eb24025
I20260811 06:16:54.361773 11370 raft_consensus.cc:2258] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.362335 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4145b5bbd2854fdfbbddcfa34e984604" } new_table_name: "default.Table_0363307b6205431e911d6f5a556b6bd2" modify_external_catalogs: true
I20260811 06:16:54.362547 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 233) took 1552 ms. Trace:
I20260811 06:16:54.362746 11368 rpcz_store.cc:276] 0811 06:16:52.810294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.811893 (+ 1599us) service_pool.cc:227] Handling call
0811 06:16:54.362302 (+1550409us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:16:54.362314 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.362458 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533604}
W20260811 06:16:54.364043 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc3091f8a8f9442da50b17d4752cedb0 already in progress: creating tablet
I20260811 06:16:54.364570 11368 tablet_replica.cc:330] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.365284 11368 raft_consensus.cc:2229] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.366178 11368 raft_consensus.cc:2258] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.367535 11368 ts_tablet_manager.cc:1905] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.369442 11799 raft_consensus.cc:2781] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 06:16:54.370050 11046 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1ff1ad74f2034ed9b24c9712bae14cd3
W20260811 06:16:54.370424 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 83424.6us
I20260811 06:16:54.371472 11365 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:54.373329 10662 raft_consensus.cc:2454] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:54.374374 10810 leader_election.cc:302] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:54.374871 11766 raft_consensus.cc:2781] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:54.375006 11766 raft_consensus.cc:482] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:54.375126 11766 raft_consensus.cc:3037] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:54.379168 11766 raft_consensus.cc:504] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.382370 11368 ts_tablet_manager.cc:1918] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:54.382552 11368 log.cc:1196] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:54.383088 11368 ts_tablet_manager.cc:1939] T 11c50f909aad4bb991bfdeae8eab8455 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.386979 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 238) took 1332 ms. Trace:
I20260811 06:16:54.387130 11368 rpcz_store.cc:276] 0811 06:16:53.051460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.052023 (+ 563us) service_pool.cc:227] Handling call
0811 06:16:54.364345 (+1312322us) ts_tablet_manager.cc:1145] Deleting tablet 11c50f909aad4bb991bfdeae8eab8455
0811 06:16:54.364358 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.373977 (+ 9619us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.382197 (+ 8220us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.383444 (+ 1247us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1311766}
I20260811 06:16:54.387778 11368 tablet_replica.cc:330] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.387785 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 11c50f909aad4bb991bfdeae8eab8455 (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
I20260811 06:16:54.388036 11368 raft_consensus.cc:2229] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.388257 11368 raft_consensus.cc:2258] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.388943 11368 ts_tablet_manager.cc:1905] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.387447 11855 raft_consensus.cc:482] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.391192 11871 raft_consensus.cc:482] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.393566 11871 raft_consensus.cc:504] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.394743 11871 leader_election.cc:288] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.395481 11362 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:54.395655 11362 ts_tablet_manager.cc:1397] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.122s user 0.005s sys 0.001s
I20260811 06:16:54.396603 11362 raft_consensus.cc:348] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.396869 11362 raft_consensus.cc:374] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.396973 11362 raft_consensus.cc:729] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.397253 11362 consensus_queue.cc:260] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.398546 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e218ef3357a64431b19357d9e21e69bf" } modify_external_catalogs: true
I20260811 06:16:54.398864 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e218ef3357a64431b19357d9e21e69bf" } modify_external_catalogs: true
I20260811 06:16:54.399155 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ce573f2b138b48c9bdf6217511e00ed9" } new_table_name: "default.Table_5ea88bec6b2e46018539d76056f3eaa9" modify_external_catalogs: true
I20260811 06:16:54.399987 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_fbf17bb2af5b4d5d81bc6f00a757be78" } new_table_name: "default.Table_83f26821254345f388647eb918ca0a2b" modify_external_catalogs: true
I20260811 06:16:54.400759 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_758d6f5ff0e345eda92df12368807340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.401331 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_758d6f5ff0e345eda92df12368807340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.401641 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4564bda35a5f4fdc9338a844c1d39733" } new_table_name: "default.Table_a84138d5e3c74165a9b2e3ea799b1356" modify_external_catalogs: true
I20260811 06:16:54.402809 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_31f21072ad3b4938a8597fe126b2e970"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.403296 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31f21072ad3b4938a8597fe126b2e970 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.404422 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:16:54.405068 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4530e0ff64ae41b8a453e4be20673822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.405572 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4530e0ff64ae41b8a453e4be20673822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.414534 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.416879 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.417496 11362 ts_tablet_manager.cc:1428] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
W20260811 06:16:54.427568 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fcf7c7a470144c0a084aebc2032d896 consensus state has no leader
I20260811 06:16:54.432652 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.433882 11766 leader_election.cc:288] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:54.434155 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fb45a26ce7e4d8c8bf75940a6070752 has no consensus state
I20260811 06:16:54.434239 11362 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:54.434588 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.434645 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ccb9de8c002144dda1c7faff8b803de8" } new_table_name: "default.Table_3564f87a2e944d778e6e043901d156b5" modify_external_catalogs: true
I20260811 06:16:54.434661 11766 raft_consensus.cc:482] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:54.435307 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.436827 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 11c50f909aad4bb991bfdeae8eab8455 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:54.435905 11766 raft_consensus.cc:504] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:54.440111 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 844e735c671440c5bfe1035068c7334e consensus state has no leader
W20260811 06:16:54.440590 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b0ae9a1d3b74c3985637439819b63ef consensus state has no leader
I20260811 06:16:54.442173 11871 raft_consensus.cc:482] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.442361 11871 raft_consensus.cc:504] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.442971 11855 raft_consensus.cc:504] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.443158 11871 leader_election.cc:288] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.444705 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet cdb93dcd940a47e78c5458041c768e36
I20260811 06:16:54.447613 11368 ts_tablet_manager.cc:1918] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:54.448827 11368 log.cc:1196] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/1ff1ad74f2034ed9b24c9712bae14cd3
I20260811 06:16:54.449513 10321 master_service.cc:946] ReplaceTablet: received request to replace tablet 9ac8c5daeb3249e38d863ee94f1267b1 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:54.450047 10311 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 22feadfa433d46cc9f5dc052b3421e56 consensus state has no leader
I20260811 06:16:54.451107 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb93dcd940a47e78c5458041c768e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.453001 11368 ts_tablet_manager.cc:1939] T 1ff1ad74f2034ed9b24c9712bae14cd3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.455106 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 239) took 1353 ms. Trace:
I20260811 06:16:54.456039 11855 leader_election.cc:288] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.456136 11365 tablet_bootstrap.cc:654] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.455653 11368 rpcz_store.cc:276] 0811 06:16:53.101882 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.102231 (+ 349us) service_pool.cc:227] Handling call
0811 06:16:54.387700 (+1285469us) ts_tablet_manager.cc:1145] Deleting tablet 1ff1ad74f2034ed9b24c9712bae14cd3
0811 06:16:54.387711 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.399014 (+ 11303us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.446676 (+ 47662us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.454801 (+ 8125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1284365}
I20260811 06:16:54.457232 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 1ff1ad74f2034ed9b24c9712bae14cd3 (table default.Table_0afd45a96d354605b528113aa162a7d4 [id=3dcac6ff3c0346e194219b87e4945063]) successfully deleted
I20260811 06:16:54.457410 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516021603ee24b3f9bdffd1e30e5ea9d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:54.457772 11368 tablet_replica.cc:330] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.458788 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:54.458352 11766 leader_election.cc:288] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.458971 11368 raft_consensus.cc:2229] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:54.460162 10662 raft_consensus.cc:3037] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:54.460212 11368 pending_rounds.cc:62] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:16:54.460613 11368 pending_rounds.cc:68] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213241079517184 op_type: NO_OP noop_request { }
I20260811 06:16:54.461459 11368 raft_consensus.cc:2866] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:54.463311 11368 raft_consensus.cc:2258] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:54.464305 10555 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.464500 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:54.466071 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eca9ef015de946548a39e661d0ce3fa9 consensus state has no leader
I20260811 06:16:54.467557 11368 ts_tablet_manager.cc:1905] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.475733 11362 tablet_bootstrap.cc:654] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.478241 10318 master_service.cc:946] ReplaceTablet: received request to replace tablet 864c3bbf1e004579a4d0be809f83ca33 from {username='slave'} at 127.0.0.1:37928
W20260811 06:16:54.478564 10810 leader_election.cc:341] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:54.479838 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:54.370796 11046 leader_election.cc:341] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1ff1ad74f2034ed9b24c9712bae14cd3
I20260811 06:16:54.371145 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d44fa2df924751a4835821901b56de" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.486691 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb93dcd940a47e78c5458041c768e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.488896 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:54.489363 10337 catalog_manager.cc:6565] ReplaceTablet: tablet 11c50f909aad4bb991bfdeae8eab8455 deleted and replaced by tablet 4e410cb11efc4813aabae68cb177a722
I20260811 06:16:54.491019 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b38127e97f400f879afc94c0672906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.371081 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.489671 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e410cb11efc4813aabae68cb177a722) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.504679 10662 raft_consensus.cc:2454] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:54.507542 11370 ts_tablet_manager.cc:1905] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.505475 11155 raft_consensus.cc:2454] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:16:54.508306 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 113767us
W20260811 06:16:54.508373 10810 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:54.508767 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a2e55d5e0244c299d837aed98f94aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.510381 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c00b6bdfc8ac4b5db81de9f614fcf213" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:54.511196 10810 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cb854704951e4a399267766fb5be40e2
I20260811 06:16:54.512290 10810 leader_election.cc:302] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:54.514076 11365 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:54.514329 11365 ts_tablet_manager.cc:1397] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.163s user 0.000s sys 0.005s
I20260811 06:16:54.515651 11365 raft_consensus.cc:348] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.515941 11365 raft_consensus.cc:374] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.515921 11766 raft_consensus.cc:2781] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:54.516058 11365 raft_consensus.cc:729] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.516167 11766 raft_consensus.cc:686] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:54.518143 11766 consensus_queue.cc:237] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.519685 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e410cb11efc4813aabae68cb177a722) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.521874 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb93dcd940a47e78c5458041c768e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.521989 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (DEFAULT_TABLE table=default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.523471 10813 leader_election.cc:341] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.523701 10813 leader_election.cc:302] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:54.524528 10813 leader_election.cc:341] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.524762 10813 leader_election.cc:302] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.525380 11871 raft_consensus.cc:2726] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.525740 11871 raft_consensus.cc:2726] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.525704 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 8741294bc33e454a9c4ef1717ccef80f (DEFAULT_TABLE table=default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.527092 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 05867781f7954fb280cc83b2a13d0d61 (DEFAULT_TABLE table=default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.527112 10618 tablet_service.cc:1467] Processing CreateTablet for tablet a183d0915a5a48c2a26994d47f6fe266 (DEFAULT_TABLE table=default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.531195 11365 consensus_queue.cc:260] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.533028 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb45a26ce7e4d8c8bf75940a6070752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.533363 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8741294bc33e454a9c4ef1717ccef80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.538812 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91f079882c3c46318f70190d5293868e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.539250 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a183d0915a5a48c2a26994d47f6fe266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.539839 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05867781f7954fb280cc83b2a13d0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.539915 11365 ts_tablet_manager.cc:1428] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260811 06:16:54.541263 10615 tablet_service.cc:1467] Processing CreateTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b (DEFAULT_TABLE table=default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.542652 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0530ec053f47df800cf2abf549b068" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.543241 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (DEFAULT_TABLE table=default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.543804 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb45a26ce7e4d8c8bf75940a6070752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.546080 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 11c50f909aad4bb991bfdeae8eab8455 with delete_type TABLET_DATA_DELETED (replaced by tablet 4e410cb11efc4813aabae68cb177a722) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.546629 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 8741294bc33e454a9c4ef1717ccef80f (DEFAULT_TABLE table=default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.546702 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (DEFAULT_TABLE table=default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.547082 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8741294bc33e454a9c4ef1717ccef80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.548261 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 8741294bc33e454a9c4ef1717ccef80f (DEFAULT_TABLE table=default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.549870 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb854704951e4a399267766fb5be40e2" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.550163 11153 raft_consensus.cc:2454] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:54.557502 11117 tablet_service.cc:1467] Processing CreateTablet for tablet a183d0915a5a48c2a26994d47f6fe266 (DEFAULT_TABLE table=default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.561421 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 05867781f7954fb280cc83b2a13d0d61 (DEFAULT_TABLE table=default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.557910 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e180cc2c38aa4a78897e264276e4c766" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:54.564474 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516021603ee24b3f9bdffd1e30e5ea9d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:54.564924 11163 raft_consensus.cc:3037] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:54.566504 10564 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.566713 11365 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:54.567163 10564 leader_election.cc:302] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.567627 11855 raft_consensus.cc:2726] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.568205 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.569918 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05867781f7954fb280cc83b2a13d0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.570115 11947 raft_consensus.cc:482] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.572770 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1118c96cff4ea387f3d0ee94bef79b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:54.580943 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 56504.9us
W20260811 06:16:54.581329 10813 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.581607 10813 leader_election.cc:302] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.583812 11365 tablet_bootstrap.cc:654] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:54.587124 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 370d971f8ef14131afc5b54dbdbaae98 (DEFAULT_TABLE table=default.Table_45c213dc71dc4248a883fce2b58fc984 [id=313d481f9dff4c88b5611606ebf4faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.548720 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 05867781f7954fb280cc83b2a13d0d61 (DEFAULT_TABLE table=default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.588006 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 370d971f8ef14131afc5b54dbdbaae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.588224 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fb45a26ce7e4d8c8bf75940a6070752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.588285 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 5753a44d13f943c695497573b56eec6c (DEFAULT_TABLE table=default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 [id=bfdd1158b74746a9a4da2ac0e8bfc177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.591192 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05867781f7954fb280cc83b2a13d0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.591563 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8741294bc33e454a9c4ef1717ccef80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.592890 11368 ts_tablet_manager.cc:1918] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:54.593500 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5753a44d13f943c695497573b56eec6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.593448 10854 tablet_service.cc:1467] Processing CreateTablet for tablet a183d0915a5a48c2a26994d47f6fe266 (DEFAULT_TABLE table=default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.596323 10855 tablet_service.cc:1467] Processing CreateTablet for tablet a25b6d0d733c44398a233b595caad8a0 (DEFAULT_TABLE table=default.Table_1243732da50e4052abb053fb7274c580 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.596755 10337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8931139cf95f4c04a45dd28370231a46" } modify_external_catalogs: true
I20260811 06:16:54.597626 10337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8931139cf95f4c04a45dd28370231a46" } modify_external_catalogs: true
I20260811 06:16:54.597669 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.598222 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b (DEFAULT_TABLE table=default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.598783 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 370d971f8ef14131afc5b54dbdbaae98 (DEFAULT_TABLE table=default.Table_45c213dc71dc4248a883fce2b58fc984 [id=313d481f9dff4c88b5611606ebf4faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.599341 10864 tablet_service.cc:1467] Processing CreateTablet for tablet b246b0e53af34c089f4fd67174396f44 (DEFAULT_TABLE table=default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.599699 10886 tablet_service.cc:1467] Processing CreateTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b (DEFAULT_TABLE table=default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.600208 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet 2875318863584e659e2b76ad2a72ca45 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:54.602742 11098 tablet_service.cc:1467] Processing CreateTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b (DEFAULT_TABLE table=default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.570446 11947 raft_consensus.cc:504] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.605415 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:16:54.605576 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a183d0915a5a48c2a26994d47f6fe266
I20260811 06:16:54.604914 11799 raft_consensus.cc:686] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:54.616127 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_04500ce2ab80444b9cafeaa864c9e65c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.616341 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6dc46c22336b4c2f83418c51c5ecc919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.616853 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04500ce2ab80444b9cafeaa864c9e65c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:54.616971 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dc46c22336b4c2f83418c51c5ecc919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.621822 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.621971 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2688b67c9243454f9fe9823b4e9c1318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.622531 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.623323 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_317717a9da1a41028e46bcebb073c694"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.623741 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_cdfe7577fb6c436cb05499d6ea396a51" } modify_external_catalogs: true
W20260811 06:16:54.623984 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_317717a9da1a41028e46bcebb073c694 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.624092 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_cdfe7577fb6c436cb05499d6ea396a51" } modify_external_catalogs: true
W20260811 06:16:54.622539 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2688b67c9243454f9fe9823b4e9c1318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.629076 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.629786 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.630509 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet f12c8618198f4413b2727d04f850a10f
I20260811 06:16:54.633658 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2d00d7a0119d41f1b1d393a5e9b884cd" } new_table_name: "default.Table_ab403baad4e64a04ae0d8a43983b7a9f" modify_external_catalogs: true
I20260811 06:16:54.637501 10608 tablet_service.cc:1467] Processing CreateTablet for tablet a25b6d0d733c44398a233b595caad8a0 (DEFAULT_TABLE table=default.Table_1243732da50e4052abb053fb7274c580 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.637831 11368 log.cc:1196] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:54.639540 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1118c96cff4ea387f3d0ee94bef79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.640578 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 369a031402a24a6a91f0c7ba8a5f288a (DEFAULT_TABLE table=default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd [id=2c17310139a841fab9f7e4aaed39cc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.643522 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 00c91236a8304bf2a03e85a5864aa669 (DEFAULT_TABLE table=default.Table_6a9b87183c994b7d9e7879d511ebfb97 [id=58cc3c5fbc6e41a6acbad99baee36cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.643851 11766 raft_consensus.cc:2726] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:16:54.644053 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 57638.1us
I20260811 06:16:54.637538 10606 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (DEFAULT_TABLE table=default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.644824 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b (DEFAULT_TABLE table=default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.650259 11102 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (DEFAULT_TABLE table=default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.650285 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 370d971f8ef14131afc5b54dbdbaae98 (DEFAULT_TABLE table=default.Table_45c213dc71dc4248a883fce2b58fc984 [id=313d481f9dff4c88b5611606ebf4faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.650686 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c37fb719a3e14506afcc1723b90ae323"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.651428 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c37fb719a3e14506afcc1723b90ae323 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.652328 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:16:54.653170 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_758d6f5ff0e345eda92df12368807340" } new_table_name: "default.Table_89a519352be540d6a2b30a854b9ecacd" modify_external_catalogs: true
I20260811 06:16:54.653448 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a183d0915a5a48c2a26994d47f6fe266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.653590 11096 tablet_service.cc:1467] Processing CreateTablet for tablet b246b0e53af34c089f4fd67174396f44 (DEFAULT_TABLE table=default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.654289 11105 tablet_service.cc:1467] Processing CreateTablet for tablet a25b6d0d733c44398a233b595caad8a0 (DEFAULT_TABLE table=default.Table_1243732da50e4052abb053fb7274c580 [id=f745406e98324e04bd0bdcb4baad9364]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.660600 10602 tablet_service.cc:1467] Processing CreateTablet for tablet b246b0e53af34c089f4fd67174396f44 (DEFAULT_TABLE table=default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.662858 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ae64cada77924676bd6d9731a89a7a6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.663512 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae64cada77924676bd6d9731a89a7a6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.668790 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_432d41d1b12145e39802023ebd08d467" } new_table_name: "default.Table_b959e7d44eb64358964a8534448dc4ec" modify_external_catalogs: true
I20260811 06:16:54.668923 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 5753a44d13f943c695497573b56eec6c (DEFAULT_TABLE table=default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 [id=bfdd1158b74746a9a4da2ac0e8bfc177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.669795 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.671298 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ceb4c433db0b4d098442695e2441817e" } new_table_name: "default.Table_9097f9641b7b4a29bb9c6dc0d3346561" modify_external_catalogs: true
I20260811 06:16:54.672730 11947 leader_election.cc:288] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:54.673939 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.674350 11799 consensus_queue.cc:237] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.675935 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b4c6d82b1d1c4c71b873fba5c3190393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.676658 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (DEFAULT_TABLE table=default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.677067 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c997501cefd4e6b9e5824e5403dd39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.677100 11361 tablet_bootstrap.cc:492] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:54.677351 11361 ts_tablet_manager.cc:1397] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.635s user 0.090s sys 0.067s
I20260811 06:16:54.678325 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.671403 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b (DEFAULT_TABLE table=default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.678611 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b246b0e53af34c089f4fd67174396f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.678927 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25b6d0d733c44398a233b595caad8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.679333 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485e465a43c14fc8ad3a70c6e3ee7628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.679428 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 369a031402a24a6a91f0c7ba8a5f288a (DEFAULT_TABLE table=default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd [id=2c17310139a841fab9f7e4aaed39cc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.680284 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 00c91236a8304bf2a03e85a5864aa669 (DEFAULT_TABLE table=default.Table_6a9b87183c994b7d9e7879d511ebfb97 [id=58cc3c5fbc6e41a6acbad99baee36cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.682159 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.685801 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.689258 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369a031402a24a6a91f0c7ba8a5f288a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.691013 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 00c91236a8304bf2a03e85a5864aa669 (DEFAULT_TABLE table=default.Table_6a9b87183c994b7d9e7879d511ebfb97 [id=58cc3c5fbc6e41a6acbad99baee36cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.695932 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c91236a8304bf2a03e85a5864aa669. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:54.697327 11046 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: b1d6641dd44340889879d3b92018b3f0
W20260811 06:16:54.698233 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.699374 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.699697 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a183d0915a5a48c2a26994d47f6fe266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.640597 10858 tablet_service.cc:1467] Processing CreateTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (DEFAULT_TABLE table=default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.701439 11362 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:54.703465 10813 leader_election.cc:302] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:54.681097 11371 ts_tablet_manager.cc:1918] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:54.707572 11766 raft_consensus.cc:2781] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:54.707712 11766 raft_consensus.cc:482] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:54.707917 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dd5a9f221bf94e10a6b32d763d44281b" } modify_external_catalogs: true
I20260811 06:16:54.708269 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_dd5a9f221bf94e10a6b32d763d44281b" } modify_external_catalogs: true
I20260811 06:16:54.709882 11766 raft_consensus.cc:3037] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:54.708230 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 5753a44d13f943c695497573b56eec6c (DEFAULT_TABLE table=default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 [id=bfdd1158b74746a9a4da2ac0e8bfc177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.714193 11362 ts_tablet_manager.cc:1397] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.269s user 0.011s sys 0.008s
I20260811 06:16:54.716418 11371 log.cc:1196] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:16:54.719146 11948 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
W20260811 06:16:54.720008 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 59547.4us
I20260811 06:16:54.719579 11891 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fb239be50c4171bdbc75e064555197. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:54.720264 11891 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:54.719739 11948 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:54.722250 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.727193 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.728603 11948 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:54.732246 11368 ts_tablet_manager.cc:1939] T cd7390a2221f4a1b9948c8a1353e4a49 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:54.736217 10609 tablet_service.cc:1467] Processing CreateTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (DEFAULT_TABLE table=default.Table_4e402e7edac3451e992194b471d8a664 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.742959 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.743343 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.746737 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369a031402a24a6a91f0c7ba8a5f288a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.747159 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:54.747398 10879 tablet_service.cc:1467] Processing CreateTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (DEFAULT_TABLE table=default.Table_4e402e7edac3451e992194b471d8a664 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.749440 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c997501cefd4e6b9e5824e5403dd39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.750926 11371 ts_tablet_manager.cc:1939] T c5efe8eb16e84575abd18a5079aad2c9 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:54.752048 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 260) took 1022 ms. Trace:
I20260811 06:16:54.752477 11371 rpcz_store.cc:276] 0811 06:16:53.729186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.729304 (+ 118us) service_pool.cc:227] Handling call
0811 06:16:54.078978 (+349674us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:16:54.078988 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.528168 (+449180us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.661993 (+133825us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.751896 (+ 89903us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":345052}
I20260811 06:16:54.753583 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 262) took 1016 ms. Trace:
I20260811 06:16:54.753878 11371 rpcz_store.cc:276] 0811 06:16:53.737083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.737227 (+ 144us) service_pool.cc:227] Handling call
0811 06:16:54.753275 (+1016048us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:16:54.753290 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.753458 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014823}
I20260811 06:16:54.755218 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 265) took 1017 ms. Trace:
I20260811 06:16:54.755596 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.757979 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 12971f852ea943b78d967f7672680cad (DEFAULT_TABLE table=default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.758597 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12971f852ea943b78d967f7672680cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.759016 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc0ec3b040cd4a54a7919a15f8eb5da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.752998 11766 raft_consensus.cc:504] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.762229 10882 tablet_service.cc:1467] Processing CreateTablet for tablet 12971f852ea943b78d967f7672680cad (DEFAULT_TABLE table=default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.768636 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 (DEFAULT_TABLE table=default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.768671 11720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52476 (request call id 0) took 1232 ms. Trace:
I20260811 06:16:54.769297 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5bb21784e34ad7addf144e0b10a444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.756037 11371 rpcz_store.cc:276] 0811 06:16:53.737993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.738189 (+ 196us) service_pool.cc:227] Handling call
0811 06:16:54.754660 (+1016471us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:16:54.754714 (+ 54us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.755082 (+ 368us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1013302}
I20260811 06:16:54.774375 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b246b0e53af34c089f4fd67174396f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.775038 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c5efe8eb16e84575abd18a5079aad2c9 (table default.Table_59bc917bf1c440c6a607b0727ef3a8ff [id=4a189ec6459341a6b50dc5c1d28bd101]) successfully deleted
I20260811 06:16:54.775352 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 264) took 1037 ms. Trace:
I20260811 06:16:54.775656 11371 rpcz_store.cc:276] 0811 06:16:53.737752 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.738643 (+ 891us) service_pool.cc:227] Handling call
0811 06:16:54.774806 (+1036163us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:16:54.774849 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.775123 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031763}
W20260811 06:16:54.775648 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d668bcfbeff54181ba3b4407b1eb5704 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d668bcfbeff54181ba3b4407b1eb5704 already in progress: creating tablet
W20260811 06:16:54.776325 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dab2b8209e5401c84a187882ef21e08 already in progress: creating tablet
I20260811 06:16:54.776799 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 263) took 1039 ms. Trace:
I20260811 06:16:54.777086 11371 rpcz_store.cc:276] 0811 06:16:53.737294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.737418 (+ 124us) service_pool.cc:227] Handling call
0811 06:16:54.776360 (+1038942us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:16:54.776373 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.776631 (+ 258us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1032348}
I20260811 06:16:54.784790 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 240) took 1630 ms. Trace:
I20260811 06:16:54.785027 11368 rpcz_store.cc:276] 0811 06:16:53.102380 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.102795 (+ 415us) service_pool.cc:227] Handling call
0811 06:16:54.457191 (+1354396us) ts_tablet_manager.cc:1145] Deleting tablet cd7390a2221f4a1b9948c8a1353e4a49
0811 06:16:54.457306 (+ 115us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.515722 (+ 58416us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.592757 (+ 77035us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:54.733161 (+140404us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1353559}
I20260811 06:16:54.785774 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet cd7390a2221f4a1b9948c8a1353e4a49 (table default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]) successfully deleted
W20260811 06:16:54.791355 10810 leader_election.cc:341] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cb854704951e4a399267766fb5be40e2
I20260811 06:16:54.791473 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 (DEFAULT_TABLE table=default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.790647 11362 raft_consensus.cc:348] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.794386 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25b6d0d733c44398a233b595caad8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.794782 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12971f852ea943b78d967f7672680cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.794919 11362 raft_consensus.cc:374] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.795070 11855 raft_consensus.cc:482] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.795320 11855 raft_consensus.cc:504] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.795781 11362 raft_consensus.cc:729] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.796176 11855 leader_election.cc:288] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.808890 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1118c96cff4ea387f3d0ee94bef79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.809325 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5bb21784e34ad7addf144e0b10a444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.810137 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16674be53bd54f9395b650e19edd3cf4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:54.811882 11766 leader_election.cc:288] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:54.817854 10555 leader_election.cc:341] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.818879 11361 raft_consensus.cc:348] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.819236 11361 raft_consensus.cc:374] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.818920 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.831138 11361 raft_consensus.cc:729] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.833361 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 241) took 1642 ms. Trace:
I20260811 06:16:54.833590 11368 rpcz_store.cc:276] 0811 06:16:53.148248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.148634 (+ 386us) service_pool.cc:227] Handling call
0811 06:16:54.786135 (+1637501us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:16:54.786150 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.791122 (+ 4972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1637258}
I20260811 06:16:54.833112 11965 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:16:54.812594 11362 consensus_queue.cc:260] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.839521 11365 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:54.839870 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 242) took 1680 ms. Trace:
I20260811 06:16:54.840058 11368 rpcz_store.cc:276] 0811 06:16:53.154159 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.154213 (+ 54us) service_pool.cc:227] Handling call
0811 06:16:54.834061 (+1679848us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:16:54.834074 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.834211 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678807}
I20260811 06:16:54.838014 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 369a031402a24a6a91f0c7ba8a5f288a (DEFAULT_TABLE table=default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd [id=2c17310139a841fab9f7e4aaed39cc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.841046 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485e465a43c14fc8ad3a70c6e3ee7628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.841105 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.841102 11365 ts_tablet_manager.cc:1397] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.280s user 0.003s sys 0.019s
I20260811 06:16:54.837953 11361 consensus_queue.cc:260] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:54.845252 11368 tablet_replica.cc:330] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:54.845541 11368 raft_consensus.cc:2229] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.848590 11371 tablet_replica.cc:330] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:54.848861 11371 raft_consensus.cc:2229] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:54.851656 11371 raft_consensus.cc:2258] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.850494 11365 raft_consensus.cc:348] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.854131 11365 raft_consensus.cc:374] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:54.854888 11362 ts_tablet_manager.cc:1428] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.127s user 0.004s sys 0.000s
I20260811 06:16:54.855298 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.855409 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5753a44d13f943c695497573b56eec6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.857168 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c91236a8304bf2a03e85a5864aa669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.857573 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.858557 11365 raft_consensus.cc:729] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:54.862283 11371 ts_tablet_manager.cc:1905] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.863297 11115 tablet_service.cc:1467] Processing CreateTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (DEFAULT_TABLE table=default.Table_4e402e7edac3451e992194b471d8a664 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.863747 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:54.864367 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 (DEFAULT_TABLE table=default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:54.864470 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 370d971f8ef14131afc5b54dbdbaae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.867529 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 370d971f8ef14131afc5b54dbdbaae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.868341 11368 raft_consensus.cc:2258] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:54.869125 11362 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:54.869483 11361 ts_tablet_manager.cc:1428] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.168s user 0.000s sys 0.004s
I20260811 06:16:54.874629 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc0ec3b040cd4a54a7919a15f8eb5da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.868158 11365 consensus_queue.cc:260] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.873757 11368 ts_tablet_manager.cc:1905] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:54.875939 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369a031402a24a6a91f0c7ba8a5f288a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.876751 11361 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:54.878357 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16674be53bd54f9395b650e19edd3cf4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:54.882121 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532208d7a02d448e8dac702ffe6c2ffc already in progress: creating tablet
W20260811 06:16:54.882403 10309 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 47761.6us
W20260811 06:16:54.882863 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 227bc4fd6cd84e5eb2043c52f95d606d already in progress: creating tablet
W20260811 06:16:54.882025 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ab32f96671984766a54b5ee904c465f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab32f96671984766a54b5ee904c465f7 already in progress: creating tablet
I20260811 06:16:54.891233 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 12971f852ea943b78d967f7672680cad (DEFAULT_TABLE table=default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:54.890597 10307 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 71812.3us
W20260811 06:16:54.896832 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
W20260811 06:16:54.897568 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2875318863584e659e2b76ad2a72ca45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2875318863584e659e2b76ad2a72ca45 already in progress: creating tablet
I20260811 06:16:54.898093 11163 raft_consensus.cc:2454] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:16:54.900437 11945 log.cc:924] Time spent T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
W20260811 06:16:54.899183 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6c706bf0455341a0a953d937f9778b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c706bf0455341a0a953d937f9778b5f already in progress: creating tablet
I20260811 06:16:54.917801 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b5bb21784e34ad7addf144e0b10a444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.919160 11684 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" instance_seqno: 1786429007072051) as {username='slave'} at 127.9.203.67:39037; Asking this server to re-register.
I20260811 06:16:54.924459 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5753a44d13f943c695497573b56eec6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.924700 11238 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:54.933643 11683 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" instance_seqno: 1786429006216023) as {username='slave'} at 127.9.203.66:34991; Asking this server to re-register.
I20260811 06:16:54.936451 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12971f852ea943b78d967f7672680cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.942849 11683 ts_manager.cc:194] Registered new tserver with Master: f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.945938 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb854704951e4a399267766fb5be40e2" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:54.946328 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc0ec3b040cd4a54a7919a15f8eb5da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:54.947544 11163 raft_consensus.cc:3037] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:54.924021 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 864c3bbf1e004579a4d0be809f83ca33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 864c3bbf1e004579a4d0be809f83ca33 already in progress: creating tablet
I20260811 06:16:54.930316 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d6641dd44340889879d3b92018b3f0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:54.950592 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
W20260811 06:16:54.951107 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 847df543db4244a6b2900fc16fea7c07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 847df543db4244a6b2900fc16fea7c07 already in progress: creating tablet
W20260811 06:16:54.955484 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5322caea49aa4b648b74c7692d6e0372 consensus state has no leader
I20260811 06:16:54.956703 10337 catalog_manager.cc:5495] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
W20260811 06:16:54.956984 10564 leader_election.cc:341] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:54.957219 10337 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]). Expected version 1 got 0
I20260811 06:16:54.959421 10564 leader_election.cc:302] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:54.949406 11365 ts_tablet_manager.cc:1428] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.034s user 0.004s sys 0.001s
W20260811 06:16:54.959860 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 80023.4us
I20260811 06:16:54.961544 11365 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:54.961644 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c3e1b3f8f6d84555b87c499a26cbc29c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.962409 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3e1b3f8f6d84555b87c499a26cbc29c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.964519 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_42136fc7f8704bc18984cc34a3514702" } new_table_name: "default.Table_ca0f53aec50841d4bf0e1f115ac50628" modify_external_catalogs: true
I20260811 06:16:54.967741 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_24b24206598e4f27a32cabb7ed03ed3e" } modify_external_catalogs: true
I20260811 06:16:54.967926 11855 raft_consensus.cc:2726] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:54.967996 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_24b24206598e4f27a32cabb7ed03ed3e" } modify_external_catalogs: true
I20260811 06:16:54.968464 11855 raft_consensus.cc:482] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:54.968648 11855 raft_consensus.cc:504] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:54.969838 11855 leader_election.cc:288] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:54.970909 11365 tablet_bootstrap.cc:654] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:54.987468 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10bb259b9721485db9c968763434f67e has no consensus state
I20260811 06:16:54.988629 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8041eb9d4b2f475ca05f2a96278befd8" } modify_external_catalogs: true
I20260811 06:16:54.988903 10330 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
I20260811 06:16:54.989305 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8041eb9d4b2f475ca05f2a96278befd8" } modify_external_catalogs: true
W20260811 06:16:54.990083 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a2e55d5e0244c299d837aed98f94aad consensus state has no leader
I20260811 06:16:54.990583 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_36da3a35575f40f6874a2055c8fc7faf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:54.991127 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 4 candidate_status { last_received { term: 3 index: 351 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
W20260811 06:16:54.991255 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36da3a35575f40f6874a2055c8fc7faf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:54.992796 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0391df1c64954f66a3987aba9257ca4b consensus state has no leader
I20260811 06:16:54.993413 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3d5b15230b7540f29a0085d1018944fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:54.993986 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d5b15230b7540f29a0085d1018944fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:54.995900 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 97b348d30dc44fa383a27d9097c2e598
I20260811 06:16:54.996317 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:54.999625 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 4 candidate_status { last_received { term: 3 index: 351 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
I20260811 06:16:55.002327 11588 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a36d6d06a0cb4489b5014178b9973219; no voters: 29fb239be50c4171bdbc75e064555197, 9ff4bfd7a38d4d999137c09f50fe4c57
I20260811 06:16:55.002781 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5b5d84668c4a4af0af5832368bb75e15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.003369 11948 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 06:16:55.000768 10915 raft_consensus.cc:2454] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:55.003705 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a8722fababeb4520abf519495d15cb6c" } modify_external_catalogs: true
I20260811 06:16:55.008312 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4f975881a087493596aaab9db2522ada"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.008703 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a8722fababeb4520abf519495d15cb6c" } modify_external_catalogs: true
W20260811 06:16:55.008908 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f975881a087493596aaab9db2522ada in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.009259 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b5d84668c4a4af0af5832368bb75e15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.010655 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 consensus state has no leader
I20260811 06:16:55.011209 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bb432c883f1b4eae996f883c77495069" } modify_external_catalogs: true
I20260811 06:16:55.011520 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bb432c883f1b4eae996f883c77495069" } modify_external_catalogs: true
I20260811 06:16:55.017560 11004 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:55.018446 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet b0d203f652b24b4897e62fc8c03d32df
I20260811 06:16:55.029445 11683 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" instance_seqno: 1786429005277287) as {username='slave'} at 127.9.203.65:43241; Asking this server to re-register.
I20260811 06:16:55.030933 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.031425 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c91236a8304bf2a03e85a5864aa669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.039570 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:55.043310 11047 consensus_peers.cc:487] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:55.043690 11047 leader_election.cc:302] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:55.046062 11961 raft_consensus.cc:2781] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:55.046240 11961 raft_consensus.cc:482] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:55.047677 11961 raft_consensus.cc:3037] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.048064 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25b6d0d733c44398a233b595caad8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.057435 11961 raft_consensus.cc:504] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.060708 11163 raft_consensus.cc:2454] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:55.061411 10747 heartbeater.cc:464] Registering TS with master...
I20260811 06:16:55.062665 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.063386 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.051220 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3025339a6c9e4e07bba4104006206bb8" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:55.066273 11961 leader_election.cc:288] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:55.068432 10555 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:55.069139 11371 ts_tablet_manager.cc:1918] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.069329 11371 log.cc:1196] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:16:55.069955 11371 ts_tablet_manager.cc:1939] T 7a00b0b51f574bfb843b65c0876ab4fc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:55.072378 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c997501cefd4e6b9e5824e5403dd39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.074172 11683 ts_manager.cc:194] Registered new tserver with Master: 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.071947 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.075582 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 275) took 1014 ms. Trace:
I20260811 06:16:55.075678 11371 rpcz_store.cc:276] 0811 06:16:54.061593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.061776 (+ 183us) service_pool.cc:227] Handling call
0811 06:16:54.848517 (+786741us) ts_tablet_manager.cc:1145] Deleting tablet 7a00b0b51f574bfb843b65c0876ab4fc
0811 06:16:54.848529 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:54.999063 (+150534us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.068970 (+ 69907us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.073048 (+ 4078us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x618000004d18. stack: 00007fa64ff3a66e 00007fa64ff3a430 00007fa64efc15ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa64ff300fd 00007fa64ff3116e 00007fa662e89cfd 00007fa662e07883 00007fa65f0a9752 00007fa65f0db404 00007fa65f0bc870 00007fa65f0bc5fd 00000000009edb7c 00007fa64ff80344
0811 06:16:55.075523 (+ 2475us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5494528,"tablet-delete.queue_time_us":781708}
I20260811 06:16:55.075999 11684 ts_manager.cc:194] Registered new tserver with Master: 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:55.076159 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7a00b0b51f574bfb843b65c0876ab4fc (table default.Table_1d79ed1149e94fccb8e01b4aa32c53f8 [id=f1e28a412606439d97b23c7a273d94e3]) successfully deleted
I20260811 06:16:55.076534 11371 tablet_replica.cc:330] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:55.076748 11371 raft_consensus.cc:2229] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.076943 11361 tablet_bootstrap.cc:654] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.076963 11371 raft_consensus.cc:2258] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.077735 11371 ts_tablet_manager.cc:1905] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.078074 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1d6641dd44340889879d3b92018b3f0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:55.078394 10925 raft_consensus.cc:3037] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.084550 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.088835 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet fe5eea681072477ab52a822d721629cf from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:55.089332 10813 leader_election.cc:302] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:55.089787 11766 raft_consensus.cc:2781] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:55.090963 11766 raft_consensus.cc:686] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:55.091318 11766 consensus_queue.cc:237] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.094380 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.096967 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3025339a6c9e4e07bba4104006206bb8" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:55.098575 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485e465a43c14fc8ad3a70c6e3ee7628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.102362 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b246b0e53af34c089f4fd67174396f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.110018 10322 master_service.cc:946] ReplaceTablet: received request to replace tablet b0d203f652b24b4897e62fc8c03d32df from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:54.769110 11720 rpcz_store.cc:276] 0811 06:16:53.536227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.536289 (+ 62us) service_pool.cc:227] Handling call
0811 06:16:53.894025 (+357736us) raft_consensus.cc:1457] Updating replica for 332 ops
0811 06:16:53.912709 (+ 18684us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 06:16:53.912720 (+ 11us) raft_consensus.cc:1525] Triggering prepare for 332 ops
0811 06:16:53.913558 (+ 838us) write_op.cc:270] Start()
0811 06:16:53.913659 (+ 101us) write_op.cc:276] Timestamp: P: 1786429007291746 usec, L: 0
0811 06:16:54.069855 (+156196us) write_op.cc:270] Start()
0811 06:16:54.069896 (+ 41us) write_op.cc:276] Timestamp: P: 1786429007323466 usec, L: 0
0811 06:16:54.070200 (+ 304us) write_op.cc:270] Start()
0811 06:16:54.070422 (+ 222us) write_op.cc:276] Timestamp: P: 1786429007324971 usec, L: 0
0811 06:16:54.070666 (+ 244us) write_op.cc:270] Start()
0811 06:16:54.070691 (+ 25us) write_op.cc:276] Timestamp: P: 1786429007325827 usec, L: 0
0811 06:16:54.070884 (+ 193us) write_op.cc:270] Start()
0811 06:16:54.070909 (+ 25us) write_op.cc:276] Timestamp: P: 1786429007329282 usec, L: 0
0811 06:16:54.071069 (+ 160us) write_op.cc:270] Start()
0811 06:16:54.071089 (+ 20us) write_op.cc:276] Timestamp: P: 1786429007332761 usec, L: 0
0811 06:16:54.071206 (+ 117us) write_op.cc:270] Start()
0811 06:16:54.071287 (+ 81us) write_op.cc:276] Timestamp: P: 1786429007333337 usec, L: 0
0811 06:16:54.071458 (+ 171us) write_op.cc:270] Start()
0811 06:16:54.071502 (+ 44us) write_op.cc:276] Timestamp: P: 1786429007461040 usec, L: 0
0811 06:16:54.071694 (+ 192us) write_op.cc:270] Start()
0811 06:16:54.071719 (+ 25us) write_op.cc:276] Timestamp: P: 1786429007471945 usec, L: 0
0811 06:16:54.087087 (+ 15368us) write_op.cc:270] Start()
0811 06:16:54.087458 (+ 371us) write_op.cc:276] Timestamp: P: 1786429007472685 usec, L: 0
0811 06:16:54.097237 (+ 9779us) write_op.cc:270] Start()
0811 06:16:54.097391 (+ 154us) write_op.cc:276] Timestamp: P: 1786429007473427 usec, L: 0
0811 06:16:54.098683 (+ 1292us) write_op.cc:270] Start()
0811 06:16:54.098834 (+ 151us) write_op.cc:276] Timestamp: P: 1786429007473956 usec, L: 0
0811 06:16:54.100618 (+ 1784us) write_op.cc:270] Start()
0811 06:16:54.100769 (+ 151us) write_op.cc:276] Timestamp: P: 1786429007479613 usec, L: 0
0811 06:16:54.104277 (+ 3508us) write_op.cc:270] Start()
0811 06:16:54.104396 (+ 119us) write_op.cc:276] Timestamp: P: 1786429007480258 usec, L: 0
0811 06:16:54.104964 (+ 568us) write_op.cc:270] Start()
0811 06:16:54.105041 (+ 77us) write_op.cc:276] Timestamp: P: 1786429007491011 usec, L: 0
0811 06:16:54.105596 (+ 555us) write_op.cc:270] Start()
0811 06:16:54.105757 (+ 161us) write_op.cc:276] Timestamp: P: 1786429007497229 usec, L: 0
0811 06:16:54.106748 (+ 991us) write_op.cc:270] Start()
0811 06:16:54.113312 (+ 6564us) write_op.cc:276] Timestamp: P: 1786429007498544 usec, L: 0
0811 06:16:54.117654 (+ 4342us) write_op.cc:270] Start()
0811 06:16:54.142187 (+ 24533us) write_op.cc:276] Timestamp: P: 1786429007505346 usec, L: 0
0811 06:16:54.165110 (+ 22923us) write_op.cc:270] Start()
0811 06:16:54.165350 (+ 240us) write_op.cc:276] Timestamp: P: 1786429007506068 usec, L: 0
0811 06:16:54.166186 (+ 836us) write_op.cc:270] Start()
0811 06:16:54.166313 (+ 127us) write_op.cc:276] Timestamp: P: 1786429007513079 usec, L: 0
0811 06:16:54.167236 (+ 923us) write_op.cc:270] Start()
0811 06:16:54.167359 (+ 123us) write_op.cc:276] Timestamp: P: 1786429007530812 usec, L: 0
0811 06:16:54.167886 (+ 527us) write_op.cc:270] Start()
0811 06:16:54.168025 (+ 139us) write_op.cc:276] Timestamp: P: 1786429007532767 usec, L: 0
0811 06:16:54.170910 (+ 2885us) write_op.cc:270] Start()
0811 06:16:54.170941 (+ 31us) write_op.cc:276] Timestamp: P: 1786429007541078 usec, L: 0
0811 06:16:54.171656 (+ 715us) write_op.cc:270] Start()
0811 06:16:54.171779 (+ 123us) write_op.cc:276] Timestamp: P: 1786429007543191 usec, L: 0
0811 06:16:54.172613 (+ 834us) write_op.cc:270] Start()
0811 06:16:54.174285 (+ 1672us) write_op.cc:276] Timestamp: P: 1786429007544085 usec, L: 0
0811 06:16:54.175058 (+ 773us) write_op.cc:270] Start()
0811 06:16:54.175180 (+ 122us) write_op.cc:276] Timestamp: P: 1786429007558375 usec, L: 0
0811 06:16:54.175797 (+ 617us) write_op.cc:270] Start()
0811 06:16:54.175862 (+ 65us) write_op.cc:276] Timestamp: P: 1786429007562059 usec, L: 0
0811 06:16:54.176133 (+ 271us) write_op.cc:270] Start()
0811 06:16:54.176189 (+ 56us) write_op.cc:276] Timestamp: P: 1786429007562844 usec, L: 0
0811 06:16:54.176467 (+ 278us) write_op.cc:270] Start()
0811 06:16:54.176523 (+ 56us) write_op.cc:276] Timestamp: P: 1786429007566400 usec, L: 0
0811 06:16:54.177988 (+ 1465us) write_op.cc:270] Start()
0811 06:16:54.178021 (+ 33us) write_op.cc:276] Timestamp: P: 1786429007592793 usec, L: 0
0811 06:16:54.178418 (+ 397us) write_op.cc:270] Start()
0811 06:16:54.178447 (+ 29us) write_op.cc:276] Timestamp: P: 1786429007596934 usec, L: 0
0811 06:16:54.178833 (+ 386us) write_op.cc:270] Start()
0811 06:16:54.178886 (+ 53us) write_op.cc:276] Timestamp: P: 1786429007613338 usec, L: 0
0811 06:16:54.179291 (+ 405us) write_op.cc:270] Start()
0811 06:16:54.179320 (+ 29us) write_op.cc:276] Timestamp: P: 1786429007690713 usec, L: 0
0811 06:16:54.179593 (+ 273us) write_op.cc:270] Start()
0811 06:16:54.179645 (+ 52us) write_op.cc:276] Timestamp: P: 1786429007709349 usec, L: 0
0811 06:16:54.180283 (+ 638us) write_op.cc:270] Start()
0811 06:16:54.180313 (+ 30us) write_op.cc:276] Timestamp: P: 1786429007709947 usec, L: 0
0811 06:16:54.180639 (+ 326us) write_op.cc:270] Start()
0811 06:16:54.180694 (+ 55us) write_op.cc:276] Timestamp: P: 1786429007710731 usec, L: 0
0811 06:16:54.181047 (+ 353us) write_op.cc:270] Start()
0811 06:16:54.181117 (+ 70us) write_op.cc:276] Timestamp: P: 1786429007711282 usec, L: 0
0811 06:16:54.181427 (+ 310us) write_op.cc:270] Start()
0811 06:16:54.181453 (+ 26us) write_op.cc:276] Timestamp: P: 1786429007723882 usec, L: 0
0811 06:16:54.194461 (+ 13008us) write_op.cc:270] Start()
0811 06:16:54.194614 (+ 153us) write_op.cc:276] Timestamp: P: 1786429007738914 usec, L: 0
0811 06:16:54.203440 (+ 8826us) write_op.cc:270] Start()
0811 06:16:54.207752 (+ 4312us) write_op.cc:276] Timestamp: P: 1786429007765576 usec, L: 0
0811 06:16:54.214699 (+ 6947us) write_op.cc:270] Start()
0811 06:16:54.214817 (+ 118us) write_op.cc:276] Timestamp: P: 1786429007769893 usec, L: 0
0811 06:16:54.216740 (+ 1923us) write_op.cc:270] Start()
0811 06:16:54.216816 (+ 76us) write_op.cc:276] Timestamp: P: 1786429007771032 usec, L: 0
0811 06:16:54.220606 (+ 3790us) write_op.cc:270] Start()
0811 06:16:54.220643 (+ 37us) write_op.cc:276] Timestamp: P: 1786429007772135 usec, L: 0
0811 06:16:54.220790 (+ 147us) write_op.cc:270] Start()
0811 06:16:54.220819 (+ 29us) write_op.cc:276] Timestamp: P: 1786429007773168 usec, L: 0
0811 06:16:54.221084 (+ 265us) write_op.cc:270] Start()
0811 06:16:54.221108 (+ 24us) write_op.cc:276] Timestamp: P: 1786429007777788 usec, L: 0
0811 06:16:54.221227 (+ 119us) write_op.cc:270] Start()
0811 06:16:54.221247 (+ 20us) write_op.cc:276] Timestamp: P: 1786429007778943 usec, L: 0
0811 06:16:54.221351 (+ 104us) write_op.cc:270] Start()
0811 06:16:54.221370 (+ 19us) write_op.cc:276] Timestamp: P: 1786429007779916 usec, L: 0
0811 06:16:54.221498 (+ 128us) write_op.cc:270] Start()
0811 06:16:54.221519 (+ 21us) write_op.cc:276] Timestamp: P: 1786429007791291 usec, L: 0
0811 06:16:54.221632 (+ 113us) write_op.cc:270] Start()
0811 06:16:54.221650 (+ 18us) write_op.cc:276] Timestamp: P: 1786429007797034 usec, L: 0
0811 06:16:54.221836 (+ 186us) write_op.cc:270] Start()
0811 06:16:54.221860 (+ 24us) write_op.cc:276] Timestamp: P: 1786429007802670 usec, L: 0
0811 06:16:54.222179 (+ 319us) write_op.cc:270] Start()
0811 06:16:54.222203 (+ 24us) write_op.cc:276] Timestamp: P: 1786429007810341 usec, L: 0
0811 06:16:54.222352 (+ 149us) write_op.cc:270] Start()
0811 06:16:54.222374 (+ 22us) write_op.cc:276] Timestamp: P: 1786429007858273 usec, L: 0
0811 06:16:54.222510 (+ 136us) write_op.cc:270] Start()
0811 06:16:54.222529 (+ 19us) write_op.cc:276] Timestamp: P: 1786429007868132 usec, L: 0
0811 06:16:54.227111 (+ 4582us) write_op.cc:270] Start()
0811 06:16:54.227141 (+ 30us) write_op.cc:276] Timestamp: P: 1786429007869429 usec, L: 0
0811 06:16:54.227364 (+ 223us) write_op.cc:270] Start()
0811 06:16:54.227389 (+ 25us) write_op.cc:276] Timestamp: P: 1786429007873313 usec, L: 0
0811 06:16:54.227560 (+ 171us) write_op.cc:270] Start()
0811 06:16:54.227585 (+ 25us) write_op.cc:276] Timestamp: P: 1786429007874158 usec, L: 0
0811 06:16:54.227714 (+ 129us) write_op.cc:270] Start()
0811 06:16:54.227733 (+ 19us) write_op.cc:276] Timestamp: P: 1786429007876811 usec, L: 0
0811 06:16:54.227895 (+ 162us) write_op.cc:270] Start()
0811 06:16:54.227916 (+ 21us) write_op.cc:276] Timestamp: P: 1786429007933298 usec, L: 0
0811 06:16:54.228070 (+ 154us) write_op.cc:270] Start()
0811 06:16:54.228094 (+ 24us) write_op.cc:276] Timestamp: P: 1786429007991836 usec, L: 0
0811 06:16:54.228216 (+ 122us) write_op.cc:270] Start()
0811 06:16:54.228289 (+ 73us) write_op.cc:276] Timestamp: P: 1786429008002676 usec, L: 0
0811 06:16:54.263344 (+ 35055us) write_op.cc:270] Start()
0811 06:16:54.265033 (+ 1689us) write_op.cc:276] Timestamp: P: 1786429008003406 usec, L: 0
0811 06:16:54.265424 (+ 391us) write_op.cc:270] Start()
0811 06:16:54.265458 (+ 34us) write_op.cc:276] Timestamp: P: 1786429008004156 usec, L: 0
0811 06:16:54.265677 (+ 219us) write_op.cc:270] Start()
0811 06:16:54.265700 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008004865 usec, L: 0
0811 06:16:54.266452 (+ 752us) write_op.cc:270] Start()
0811 06:16:54.266510 (+ 58us) write_op.cc:276] Timestamp: P: 1786429008025481 usec, L: 0
0811 06:16:54.266845 (+ 335us) write_op.cc:270] Start()
0811 06:16:54.266888 (+ 43us) write_op.cc:276] Timestamp: P: 1786429008041496 usec, L: 0
0811 06:16:54.267042 (+ 154us) write_op.cc:270] Start()
0811 06:16:54.267064 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008044978 usec, L: 0
0811 06:16:54.267205 (+ 141us) write_op.cc:270] Start()
0811 06:16:54.267225 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008045660 usec, L: 0
0811 06:16:54.267522 (+ 297us) write_op.cc:270] Start()
0811 06:16:54.267548 (+ 26us) write_op.cc:276] Timestamp: P: 1786429008056282 usec, L: 0
0811 06:16:54.267732 (+ 184us) write_op.cc:270] Start()
0811 06:16:54.267755 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008059991 usec, L: 0
0811 06:16:54.267899 (+ 144us) write_op.cc:270] Start()
0811 06:16:54.267918 (+ 19us) write_op.cc:276] Timestamp: P: 1786429008152912 usec, L: 0
0811 06:16:54.268034 (+ 116us) write_op.cc:270] Start()
0811 06:16:54.268054 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008153733 usec, L: 0
0811 06:16:54.268228 (+ 174us) write_op.cc:270] Start()
0811 06:16:54.268250 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008154292 usec, L: 0
0811 06:16:54.268473 (+ 223us) write_op.cc:270] Start()
0811 06:16:54.268499 (+ 26us) write_op.cc:276] Timestamp: P: 1786429008163883 usec, L: 0
0811 06:16:54.268665 (+ 166us) write_op.cc:270] Start()
0811 06:16:54.268687 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008164646 usec, L: 0
0811 06:16:54.270285 (+ 1598us) write_op.cc:270] Start()
0811 06:16:54.270314 (+ 29us) write_op.cc:276] Timestamp: P: 1786429008165218 usec, L: 0
0811 06:16:54.270465 (+ 151us) write_op.cc:270] Start()
0811 06:16:54.270488 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008166793 usec, L: 0
0811 06:16:54.270673 (+ 185us) write_op.cc:270] Start()
0811 06:16:54.270697 (+ 24us) write_op.cc:276] Timestamp: P: 1786429008207947 usec, L: 0
0811 06:16:54.270861 (+ 164us) write_op.cc:270] Start()
0811 06:16:54.270885 (+ 24us) write_op.cc:276] Timestamp: P: 1786429008209230 usec, L: 0
0811 06:16:54.271037 (+ 152us) write_op.cc:270] Start()
0811 06:16:54.271082 (+ 45us) write_op.cc:276] Timestamp: P: 1786429008224251 usec, L: 0
0811 06:16:54.271244 (+ 162us) write_op.cc:270] Start()
0811 06:16:54.271274 (+ 30us) write_op.cc:276] Timestamp: P: 1786429008225376 usec, L: 0
0811 06:16:54.271401 (+ 127us) write_op.cc:270] Start()
0811 06:16:54.271420 (+ 19us) write_op.cc:276] Timestamp: P: 1786429008270730 usec, L: 0
0811 06:16:54.271566 (+ 146us) write_op.cc:270] Start()
0811 06:16:54.271586 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008300664 usec, L: 0
0811 06:16:54.271868 (+ 282us) write_op.cc:270] Start()
0811 06:16:54.271889 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008397345 usec, L: 0
0811 06:16:54.272025 (+ 136us) write_op.cc:270] Start()
0811 06:16:54.272046 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008464132 usec, L: 0
0811 06:16:54.275891 (+ 3845us) write_op.cc:270] Start()
0811 06:16:54.275954 (+ 63us) write_op.cc:276] Timestamp: P: 1786429008467815 usec, L: 0
0811 06:16:54.276622 (+ 668us) write_op.cc:270] Start()
0811 06:16:54.276681 (+ 59us) write_op.cc:276] Timestamp: P: 1786429008471751 usec, L: 0
0811 06:16:54.276963 (+ 282us) write_op.cc:270] Start()
0811 06:16:54.276986 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008472556 usec, L: 0
0811 06:16:54.277397 (+ 411us) write_op.cc:270] Start()
0811 06:16:54.277428 (+ 31us) write_op.cc:276] Timestamp: P: 1786429008473552 usec, L: 0
0811 06:16:54.277578 (+ 150us) write_op.cc:270] Start()
0811 06:16:54.277598 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008476442 usec, L: 0
0811 06:16:54.277749 (+ 151us) write_op.cc:270] Start()
0811 06:16:54.277771 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008516957 usec, L: 0
0811 06:16:54.277958 (+ 187us) write_op.cc:270] Start()
0811 06:16:54.277979 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008520626 usec, L: 0
0811 06:16:54.278163 (+ 184us) write_op.cc:270] Start()
0811 06:16:54.278184 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008522235 usec, L: 0
0811 06:16:54.278325 (+ 141us) write_op.cc:270] Start()
0811 06:16:54.278345 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008525908 usec, L: 0
0811 06:16:54.278534 (+ 189us) write_op.cc:270] Start()
0811 06:16:54.278556 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008528957 usec, L: 0
0811 06:16:54.278701 (+ 145us) write_op.cc:270] Start()
0811 06:16:54.278722 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008560613 usec, L: 0
0811 06:16:54.278913 (+ 191us) write_op.cc:270] Start()
0811 06:16:54.278935 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008561559 usec, L: 0
0811 06:16:54.279054 (+ 119us) write_op.cc:270] Start()
0811 06:16:54.279073 (+ 19us) write_op.cc:276] Timestamp: P: 1786429008562407 usec, L: 0
0811 06:16:54.279255 (+ 182us) write_op.cc:270] Start()
0811 06:16:54.279287 (+ 32us) write_op.cc:276] Timestamp: P: 1786429008563722 usec, L: 0
0811 06:16:54.279408 (+ 121us) write_op.cc:270] Start()
0811 06:16:54.279427 (+ 19us) write_op.cc:276] Timestamp: P: 1786429008566033 usec, L: 0
0811 06:16:54.279575 (+ 148us) write_op.cc:270] Start()
0811 06:16:54.279593 (+ 18us) write_op.cc:276] Timestamp: P: 1786429008567604 usec, L: 0
0811 06:16:54.279728 (+ 135us) write_op.cc:270] Start()
0811 06:16:54.279748 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008568465 usec, L: 0
0811 06:16:54.279877 (+ 129us) write_op.cc:270] Start()
0811 06:16:54.279897 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008570920 usec, L: 0
0811 06:16:54.280045 (+ 148us) write_op.cc:270] Start()
0811 06:16:54.280066 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008575919 usec, L: 0
0811 06:16:54.281011 (+ 945us) write_op.cc:270] Start()
0811 06:16:54.281036 (+ 25us) write_op.cc:276] Timestamp: P: 1786429008576944 usec, L: 0
0811 06:16:54.281306 (+ 270us) write_op.cc:270] Start()
0811 06:16:54.281330 (+ 24us) write_op.cc:276] Timestamp: P: 1786429008647840 usec, L: 0
0811 06:16:54.281862 (+ 532us) write_op.cc:270] Start()
0811 06:16:54.289981 (+ 8119us) write_op.cc:276] Timestamp: P: 1786429008648600 usec, L: 0
0811 06:16:54.290279 (+ 298us) write_op.cc:270] Start()
0811 06:16:54.290329 (+ 50us) write_op.cc:276] Timestamp: P: 1786429008665116 usec, L: 0
0811 06:16:54.290529 (+ 200us) write_op.cc:270] Start()
0811 06:16:54.290550 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008674147 usec, L: 0
0811 06:16:54.290686 (+ 136us) write_op.cc:270] Start()
0811 06:16:54.290706 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008701961 usec, L: 0
0811 06:16:54.290844 (+ 138us) write_op.cc:270] Start()
0811 06:16:54.290864 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008745388 usec, L: 0
0811 06:16:54.291009 (+ 145us) write_op.cc:270] Start()
0811 06:16:54.291028 (+ 19us) write_op.cc:276] Timestamp: P: 1786429008775493 usec, L: 0
0811 06:16:54.291164 (+ 136us) write_op.cc:270] Start()
0811 06:16:54.291182 (+ 18us) write_op.cc:276] Timestamp: P: 1786429008776237 usec, L: 0
0811 06:16:54.291305 (+ 123us) write_op.cc:270] Start()
0811 06:16:54.291340 (+ 35us) write_op.cc:276] Timestamp: P: 1786429008784688 usec, L: 0
0811 06:16:54.291503 (+ 163us) write_op.cc:270] Start()
0811 06:16:54.291524 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008879432 usec, L: 0
0811 06:16:54.291650 (+ 126us) write_op.cc:270] Start()
0811 06:16:54.291670 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008880462 usec, L: 0
0811 06:16:54.291832 (+ 162us) write_op.cc:270] Start()
0811 06:16:54.291856 (+ 24us) write_op.cc:276] Timestamp: P: 1786429008881098 usec, L: 0
0811 06:16:54.291996 (+ 140us) write_op.cc:270] Start()
0811 06:16:54.292017 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008888154 usec, L: 0
0811 06:16:54.292132 (+ 115us) write_op.cc:270] Start()
0811 06:16:54.292152 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008888781 usec, L: 0
0811 06:16:54.292629 (+ 477us) write_op.cc:270] Start()
0811 06:16:54.292657 (+ 28us) write_op.cc:276] Timestamp: P: 1786429008889336 usec, L: 0
0811 06:16:54.292852 (+ 195us) write_op.cc:270] Start()
0811 06:16:54.292876 (+ 24us) write_op.cc:276] Timestamp: P: 1786429008889916 usec, L: 0
0811 06:16:54.293024 (+ 148us) write_op.cc:270] Start()
0811 06:16:54.293045 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008919940 usec, L: 0
0811 06:16:54.293202 (+ 157us) write_op.cc:270] Start()
0811 06:16:54.293222 (+ 20us) write_op.cc:276] Timestamp: P: 1786429008949454 usec, L: 0
0811 06:16:54.293385 (+ 163us) write_op.cc:270] Start()
0811 06:16:54.293407 (+ 22us) write_op.cc:276] Timestamp: P: 1786429008950137 usec, L: 0
0811 06:16:54.293526 (+ 119us) write_op.cc:270] Start()
0811 06:16:54.293547 (+ 21us) write_op.cc:276] Timestamp: P: 1786429008950693 usec, L: 0
0811 06:16:54.295102 (+ 1555us) write_op.cc:270] Start()
0811 06:16:54.295129 (+ 27us) write_op.cc:276] Timestamp: P: 1786429008971262 usec, L: 0
0811 06:16:54.295350 (+ 221us) write_op.cc:270] Start()
0811 06:16:54.295375 (+ 25us) write_op.cc:276] Timestamp: P: 1786429008971924 usec, L: 0
0811 06:16:54.295554 (+ 179us) write_op.cc:270] Start()
0811 06:16:54.295577 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008987549 usec, L: 0
0811 06:16:54.295785 (+ 208us) write_op.cc:270] Start()
0811 06:16:54.295808 (+ 23us) write_op.cc:276] Timestamp: P: 1786429008988314 usec, L: 0
0811 06:16:54.296110 (+ 302us) write_op.cc:270] Start()
0811 06:16:54.296136 (+ 26us) write_op.cc:276] Timestamp: P: 1786429008988932 usec, L: 0
0811 06:16:54.296299 (+ 163us) write_op.cc:270] Start()
0811 06:16:54.296333 (+ 34us) write_op.cc:276] Timestamp: P: 1786429008989533 usec, L: 0
0811 06:16:54.296509 (+ 176us) write_op.cc:270] Start()
0811 06:16:54.296564 (+ 55us) write_op.cc:276] Timestamp: P: 1786429009017357 usec, L: 0
0811 06:16:54.296732 (+ 168us) write_op.cc:270] Start()
0811 06:16:54.296756 (+ 24us) write_op.cc:276] Timestamp: P: 1786429009047574 usec, L: 0
0811 06:16:54.296956 (+ 200us) write_op.cc:270] Start()
0811 06:16:54.296979 (+ 23us) write_op.cc:276] Timestamp: P: 1786429009131473 usec, L: 0
0811 06:16:54.297137 (+ 158us) write_op.cc:270] Start()
0811 06:16:54.297158 (+ 21us) write_op.cc:276] Timestamp: P: 1786429009142678 usec, L: 0
0811 06:16:54.297293 (+ 135us) write_op.cc:270] Start()
0811 06:16:54.297323 (+ 30us) write_op.cc:276] Timestamp: P: 1786429009145584 usec, L: 0
0811 06:16:54.297468 (+ 145us) write_op.cc:270] Start()
0811 06:16:54.297489 (+ 21us) write_op.cc:276] Timestamp: P: 1786429009158313 usec, L: 0
0811 06:16:54.297628 (+ 139us) write_op.cc:270] Start()
0811 06:16:54.297648 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009162986 usec, L: 0
0811 06:16:54.297924 (+ 276us) write_op.cc:270] Start()
0811 06:16:54.297990 (+ 66us) write_op.cc:276] Timestamp: P: 1786429009177453 usec, L: 0
0811 06:16:54.298333 (+ 343us) write_op.cc:270] Start()
0811 06:16:54.298390 (+ 57us) write_op.cc:276] Timestamp: P: 1786429009178269 usec, L: 0
0811 06:16:54.298808 (+ 418us) write_op.cc:270] Start()
0811 06:16:54.298864 (+ 56us) write_op.cc:276] Timestamp: P: 1786429009202210 usec, L: 0
0811 06:16:54.299121 (+ 257us) write_op.cc:270] Start()
0811 06:16:54.299141 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009287155 usec, L: 0
0811 06:16:54.299416 (+ 275us) write_op.cc:270] Start()
0811 06:16:54.299469 (+ 53us) write_op.cc:276] Timestamp: P: 1786429009327404 usec, L: 0
0811 06:16:54.299917 (+ 448us) write_op.cc:270] Start()
0811 06:16:54.299945 (+ 28us) write_op.cc:276] Timestamp: P: 1786429009345585 usec, L: 0
0811 06:16:54.300247 (+ 302us) write_op.cc:270] Start()
0811 06:16:54.300273 (+ 26us) write_op.cc:276] Timestamp: P: 1786429009354593 usec, L: 0
0811 06:16:54.300580 (+ 307us) write_op.cc:270] Start()
0811 06:16:54.300634 (+ 54us) write_op.cc:276] Timestamp: P: 1786429009356639 usec, L: 0
0811 06:16:54.302126 (+ 1492us) write_op.cc:270] Start()
0811 06:16:54.302151 (+ 25us) write_op.cc:276] Timestamp: P: 1786429009364994 usec, L: 0
0811 06:16:54.302277 (+ 126us) write_op.cc:270] Start()
0811 06:16:54.302296 (+ 19us) write_op.cc:276] Timestamp: P: 1786429009366450 usec, L: 0
0811 06:16:54.302436 (+ 140us) write_op.cc:270] Start()
0811 06:16:54.302455 (+ 19us) write_op.cc:276] Timestamp: P: 1786429009393250 usec, L: 0
0811 06:16:54.302646 (+ 191us) write_op.cc:270] Start()
0811 06:16:54.302668 (+ 22us) write_op.cc:276] Timestamp: P: 1786429009466667 usec, L: 0
0811 06:16:54.302869 (+ 201us) write_op.cc:270] Start()
0811 06:16:54.302909 (+ 40us) write_op.cc:276] Timestamp: P: 1786429009474706 usec, L: 0
0811 06:16:54.304211 (+ 1302us) write_op.cc:270] Start()
0811 06:16:54.304239 (+ 28us) write_op.cc:276] Timestamp: P: 1786429009501008 usec, L: 0
0811 06:16:54.304508 (+ 269us) write_op.cc:270] Start()
0811 06:16:54.304533 (+ 25us) write_op.cc:276] Timestamp: P: 1786429009502239 usec, L: 0
0811 06:16:54.304711 (+ 178us) write_op.cc:270] Start()
0811 06:16:54.304736 (+ 25us) write_op.cc:276] Timestamp: P: 1786429009502902 usec, L: 0
0811 06:16:54.304993 (+ 257us) write_op.cc:270] Start()
0811 06:16:54.305017 (+ 24us) write_op.cc:276] Timestamp: P: 1786429009512289 usec, L: 0
0811 06:16:54.305213 (+ 196us) write_op.cc:270] Start()
0811 06:16:54.305234 (+ 21us) write_op.cc:276] Timestamp: P: 1786429009513105 usec, L: 0
0811 06:16:54.305924 (+ 690us) write_op.cc:270] Start()
0811 06:16:54.305952 (+ 28us) write_op.cc:276] Timestamp: P: 1786429009598548 usec, L: 0
0811 06:16:54.306095 (+ 143us) write_op.cc:270] Start()
0811 06:16:54.306115 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009599399 usec, L: 0
0811 06:16:54.306361 (+ 246us) write_op.cc:270] Start()
0811 06:16:54.306384 (+ 23us) write_op.cc:276] Timestamp: P: 1786429009724294 usec, L: 0
0811 06:16:54.306531 (+ 147us) write_op.cc:270] Start()
0811 06:16:54.306551 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009729343 usec, L: 0
0811 06:16:54.306670 (+ 119us) write_op.cc:270] Start()
0811 06:16:54.306688 (+ 18us) write_op.cc:276] Timestamp: P: 1786429009740003 usec, L: 0
0811 06:16:54.306827 (+ 139us) write_op.cc:270] Start()
0811 06:16:54.306847 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009740695 usec, L: 0
0811 06:16:54.306972 (+ 125us) write_op.cc:270] Start()
0811 06:16:54.306991 (+ 19us) write_op.cc:276] Timestamp: P: 1786429009745048 usec, L: 0
0811 06:16:54.307267 (+ 276us) write_op.cc:270] Start()
0811 06:16:54.307294 (+ 27us) write_op.cc:276] Timestamp: P: 1786429009758648 usec, L: 0
0811 06:16:54.307473 (+ 179us) write_op.cc:270] Start()
0811 06:16:54.307517 (+ 44us) write_op.cc:276] Timestamp: P: 1786429009759343 usec, L: 0
0811 06:16:54.307679 (+ 162us) write_op.cc:270] Start()
0811 06:16:54.307700 (+ 21us) write_op.cc:276] Timestamp: P: 1786429009764892 usec, L: 0
0811 06:16:54.307862 (+ 162us) write_op.cc:270] Start()
0811 06:16:54.307885 (+ 23us) write_op.cc:276] Timestamp: P: 1786429009769708 usec, L: 0
0811 06:16:54.308056 (+ 171us) write_op.cc:270] Start()
0811 06:16:54.308133 (+ 77us) write_op.cc:276] Timestamp: P: 1786429009770356 usec, L: 0
0811 06:16:54.308553 (+ 420us) write_op.cc:270] Start()
0811 06:16:54.308580 (+ 27us) write_op.cc:276] Timestamp: P: 1786429009811185 usec, L: 0
0811 06:16:54.308780 (+ 200us) write_op.cc:270] Start()
0811 06:16:54.308802 (+ 22us) write_op.cc:276] Timestamp: P: 1786429009813905 usec, L: 0
0811 06:16:54.308949 (+ 147us) write_op.cc:270] Start()
0811 06:16:54.308972 (+ 23us) write_op.cc:276] Timestamp: P: 1786429009818569 usec, L: 0
0811 06:16:54.309123 (+ 151us) write_op.cc:270] Start()
0811 06:16:54.309142 (+ 19us) write_op.cc:276] Timestamp: P: 1786429009847150 usec, L: 0
0811 06:16:54.309321 (+ 179us) write_op.cc:270] Start()
0811 06:16:54.309343 (+ 22us) write_op.cc:276] Timestamp: P: 1786429009868050 usec, L: 0
0811 06:16:54.309463 (+ 120us) write_op.cc:270] Start()
0811 06:16:54.309482 (+ 19us) write_op.cc:276] Timestamp: P: 1786429009875255 usec, L: 0
0811 06:16:54.309631 (+ 149us) write_op.cc:270] Start()
0811 06:16:54.309653 (+ 22us) write_op.cc:276] Timestamp: P: 1786429009876075 usec, L: 0
0811 06:16:54.309857 (+ 204us) write_op.cc:270] Start()
0811 06:16:54.309881 (+ 24us) write_op.cc:276] Timestamp: P: 1786429009879186 usec, L: 0
0811 06:16:54.310066 (+ 185us) write_op.cc:270] Start()
0811 06:16:54.310130 (+ 64us) write_op.cc:276] Timestamp: P: 1786429009893208 usec, L: 0
0811 06:16:54.315425 (+ 5295us) write_op.cc:270] Start()
0811 06:16:54.315471 (+ 46us) write_op.cc:276] Timestamp: P: 1786429009928977 usec, L: 0
0811 06:16:54.315733 (+ 262us) write_op.cc:270] Start()
0811 06:16:54.315760 (+ 27us) write_op.cc:276] Timestamp: P: 1786429009937881 usec, L: 0
0811 06:16:54.315940 (+ 180us) write_op.cc:270] Start()
0811 06:16:54.315963 (+ 23us) write_op.cc:276] Timestamp: P: 1786429009941405 usec, L: 0
0811 06:16:54.316096 (+ 133us) write_op.cc:270] Start()
0811 06:16:54.316116 (+ 20us) write_op.cc:276] Timestamp: P: 1786429009961587 usec, L: 0
0811 06:16:54.316271 (+ 155us) write_op.cc:270] Start()
0811 06:16:54.316295 (+ 24us) write_op.cc:276] Timestamp: P: 1786429009962847 usec, L: 0
0811 06:16:54.316434 (+ 139us) write_op.cc:270] Start()
0811 06:16:54.316465 (+ 31us) write_op.cc:276] Timestamp: P: 1786429009967061 usec, L: 0
0811 06:16:54.316683 (+ 218us) write_op.cc:270] Start()
0811 06:16:54.316708 (+ 25us) write_op.cc:276] Timestamp: P: 1786429009977928 usec, L: 0
0811 06:16:54.316835 (+ 127us) write_op.cc:270] Start()
0811 06:16:54.316852 (+ 17us) write_op.cc:276] Timestamp: P: 1786429010007108 usec, L: 0
0811 06:16:54.317064 (+ 212us) write_op.cc:270] Start()
0811 06:16:54.317088 (+ 24us) write_op.cc:276] Timestamp: P: 1786429010010908 usec, L: 0
0811 06:16:54.317352 (+ 264us) write_op.cc:270] Start()
0811 06:16:54.317431 (+ 79us) write_op.cc:276] Timestamp: P: 1786429010013533 usec, L: 0
0811 06:16:54.317661 (+ 230us) write_op.cc:270] Start()
0811 06:16:54.317685 (+ 24us) write_op.cc:276] Timestamp: P: 1786429010015904 usec, L: 0
0811 06:16:54.317891 (+ 206us) write_op.cc:270] Start()
0811 06:16:54.317924 (+ 33us) write_op.cc:276] Timestamp: P: 1786429010023811 usec, L: 0
0811 06:16:54.318079 (+ 155us) write_op.cc:270] Start()
0811 06:16:54.318100 (+ 21us) write_op.cc:276] Timestamp: P: 1786429010032601 usec, L: 0
0811 06:16:54.318270 (+ 170us) write_op.cc:270] Start()
0811 06:16:54.318292 (+ 22us) write_op.cc:276] Timestamp: P: 1786429010127208 usec, L: 0
0811 06:16:54.318431 (+ 139us) write_op.cc:270] Start()
0811 06:16:54.318557 (+ 126us) write_op.cc:276] Timestamp: P: 1786429010134828 usec, L: 0
0811 06:16:54.318736 (+ 179us) write_op.cc:270] Start()
0811 06:16:54.318759 (+ 23us) write_op.cc:276] Timestamp: P: 1786429010144252 usec, L: 0
0811 06:16:54.318914 (+ 155us) write_op.cc:270] Start()
0811 06:16:54.318935 (+ 21us) write_op.cc:276] Timestamp: P: 1786429010203432 usec, L: 0
0811 06:16:54.319074 (+ 139us) write_op.cc:270] Start()
0811 06:16:54.319094 (+ 20us) write_op.cc:276] Timestamp: P: 1786429010210620 usec, L: 0
0811 06:16:54.319246 (+ 152us) write_op.cc:270] Start()
0811 06:16:54.319269 (+ 23us) write_op.cc:276] Timestamp: P: 1786429010221146 usec, L: 0
0811 06:16:54.319422 (+ 153us) write_op.cc:270] Start()
0811 06:16:54.319445 (+ 23us) write_op.cc:276] Timestamp: P: 1786429010225321 usec, L: 0
0811 06:16:54.319711 (+ 266us) write_op.cc:270] Start()
0811 06:16:54.319738 (+ 27us) write_op.cc:276] Timestamp: P: 17864290
I20260811 06:16:55.134029 11833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "29fb239be50c4171bdbc75e064555197" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:55.134598 11833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:55.140584 11961 raft_consensus.cc:482] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.150148 11960 raft_consensus.cc:482] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.153002 10925 raft_consensus.cc:2454] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:55.153877 11961 raft_consensus.cc:504] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.155001 11961 leader_election.cc:288] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.156134 11047 leader_election.cc:302] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:55.157465 11362 tablet_bootstrap.cc:654] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.158211 11961 raft_consensus.cc:2781] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:55.158649 11961 raft_consensus.cc:686] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:55.159569 11961 consensus_queue.cc:237] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.171207 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:55.171998 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f07dfeeb52d64d08811e3b22d8861f62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.173297 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_f7214648b53e4bbca0fa28baa9d9aa85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.174964 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_54ba1e15029743bf966febe3c88a4a0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.183907 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0fd9c63926f444c889cc20db4e5185a0" } new_table_name: "default.Table_35f27424dfb64652ba634de320305dc7" modify_external_catalogs: true
I20260811 06:16:55.150357 11960 raft_consensus.cc:504] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.192327 11960 leader_election.cc:288] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:55.193013 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:55.196026 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a378a6f20c564eb685b655a762b638ae" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:55.197388 11046 consensus_peers.cc:487] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b681f10c3de4bd798b9d519f10da103. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:16:55.199316 10813 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:55.199389 11371 ts_tablet_manager.cc:1918] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.199579 11371 log.cc:1196] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:55.200261 11371 ts_tablet_manager.cc:1939] T 516021603ee24b3f9bdffd1e30e5ea9d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:55.201906 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a378a6f20c564eb685b655a762b638ae" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:16:55.201474 10564 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:55.202299 10662 raft_consensus.cc:2454] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:55.202998 10810 leader_election.cc:302] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:55.203585 11960 raft_consensus.cc:2781] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:55.203840 11960 raft_consensus.cc:482] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:55.204015 11960 raft_consensus.cc:3037] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.205014 11368 ts_tablet_manager.cc:1918] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.205186 11368 log.cc:1196] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:55.205803 11368 ts_tablet_manager.cc:1939] T 5b681f10c3de4bd798b9d519f10da103 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:55.206195 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 243) took 2050 ms. Trace:
I20260811 06:16:55.206312 11368 rpcz_store.cc:276] 0811 06:16:53.155958 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.156016 (+ 58us) service_pool.cc:227] Handling call
0811 06:16:54.840386 (+1684370us) ts_tablet_manager.cc:1145] Deleting tablet 5b681f10c3de4bd798b9d519f10da103
0811 06:16:54.840400 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.141840 (+301440us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.204844 (+ 63004us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.206162 (+ 1318us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1684057}
I20260811 06:16:55.207554 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_940e7658aef54574be7fd31c40f81ec2" } new_table_name: "default.Table_0ba41638313a4d03b85b8ddac01ce6eb" modify_external_catalogs: true
I20260811 06:16:55.207957 11368 tablet_replica.cc:330] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:55.208741 11368 raft_consensus.cc:2229] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.202739 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 276) took 1127 ms. Trace:
I20260811 06:16:55.202540 10564 leader_election.cc:302] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:55.211135 11371 rpcz_store.cc:276] 0811 06:16:54.073980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.074270 (+ 290us) service_pool.cc:227] Handling call
0811 06:16:55.076447 (+1002177us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:16:55.076458 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.092204 (+ 15746us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.198844 (+106640us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.201582 (+ 2738us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":991291}
I20260811 06:16:55.211407 11976 raft_consensus.cc:2726] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:55.211650 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 282) took 1115 ms. Trace:
I20260811 06:16:55.211814 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 516021603ee24b3f9bdffd1e30e5ea9d (table default.Table_64c34f7955a74a59ac3a81ca903e25f3 [id=9ead873f818d428d989ee530a0993eb9]) successfully deleted
I20260811 06:16:55.211843 11371 rpcz_store.cc:276] 0811 06:16:54.096423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.096496 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:55.211452 (+1114956us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:16:55.211467 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.211607 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114671}
I20260811 06:16:55.212654 11371 tablet_replica.cc:330] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:16:55.212803 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 681736b44af04718b800d503ca645c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 681736b44af04718b800d503ca645c1a already in progress: creating tablet
I20260811 06:16:55.213178 11371 raft_consensus.cc:2229] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.213526 11371 raft_consensus.cc:2258] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.214383 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1ee53b81b8a441d8f9186bceb61129c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:55.215107 11371 ts_tablet_manager.cc:1905] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.220103 11365 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:55.220396 11365 ts_tablet_manager.cc:1397] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.260s user 0.026s sys 0.028s
I20260811 06:16:55.227756 11960 raft_consensus.cc:504] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.224539 11365 raft_consensus.cc:348] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.228408 11365 raft_consensus.cc:374] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:55.228790 11046 leader_election.cc:341] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:55.229455 11046 leader_election.cc:302] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:55.233703 11960 leader_election.cc:288] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:55.239765 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a378a6f20c564eb685b655a762b638ae" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:16:55.241163 10813 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:55.242507 11961 raft_consensus.cc:2726] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:55.244946 11368 raft_consensus.cc:2258] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.246254 11365 raft_consensus.cc:729] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.247365 11362 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:55.247634 11362 ts_tablet_manager.cc:1397] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.389s user 0.007s sys 0.001s
I20260811 06:16:55.248931 11362 raft_consensus.cc:348] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.249266 11362 raft_consensus.cc:374] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.249401 11362 raft_consensus.cc:729] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.250036 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a378a6f20c564eb685b655a762b638ae" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:55.248759 11365 consensus_queue.cc:260] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.254801 10662 raft_consensus.cc:3037] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.255677 11365 ts_tablet_manager.cc:1428] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.031s user 0.000s sys 0.004s
I20260811 06:16:55.256340 11365 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:55.261031 11362 consensus_queue.cc:260] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.262130 10662 raft_consensus.cc:2454] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:55.262822 10810 leader_election.cc:302] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:55.263232 11766 raft_consensus.cc:2781] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:55.263458 11766 raft_consensus.cc:686] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:55.263806 11766 consensus_queue.cc:237] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.266667 11371 ts_tablet_manager.cc:1918] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.267149 11362 ts_tablet_manager.cc:1428] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260811 06:16:55.267793 11362 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:55.272775 11361 tablet_bootstrap.cc:492] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:55.273048 11361 ts_tablet_manager.cc:1397] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.403s user 0.009s sys 0.004s
I20260811 06:16:55.274287 11361 raft_consensus.cc:348] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.274988 11361 raft_consensus.cc:374] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.275041 11362 tablet_bootstrap.cc:654] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.275164 11361 raft_consensus.cc:729] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.275947 11361 consensus_queue.cc:260] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.267380 11365 tablet_bootstrap.cc:654] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.280505 11368 ts_tablet_manager.cc:1905] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.279502 11371 log.cc:1196] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/16674be53bd54f9395b650e19edd3cf4
I20260811 06:16:55.281857 11371 ts_tablet_manager.cc:1939] T 16674be53bd54f9395b650e19edd3cf4 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:55.294209 11370 ts_tablet_manager.cc:1918] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.294574 11370 log.cc:1196] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:55.295300 11370 ts_tablet_manager.cc:1939] T 11c50f909aad4bb991bfdeae8eab8455 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:55.296202 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 162) took 4278 ms. Trace:
I20260811 06:16:55.296394 11370 rpcz_store.cc:276] 0811 06:16:51.017486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.017795 (+ 309us) service_pool.cc:227] Handling call
0811 06:16:54.278821 (+3261026us) ts_tablet_manager.cc:1145] Deleting tablet 11c50f909aad4bb991bfdeae8eab8455
0811 06:16:54.278832 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.019536 (+740704us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.293974 (+274438us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.296162 (+ 2188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11910,"tablet-delete.queue_time_us":3243212}
I20260811 06:16:55.296983 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 11c50f909aad4bb991bfdeae8eab8455 (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd]) successfully deleted
I20260811 06:16:55.299923 11371 tablet_replica.cc:330] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:55.302752 11371 raft_consensus.cc:2229] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.305163 11371 raft_consensus.cc:2258] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.306021 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 16674be53bd54f9395b650e19edd3cf4 (table default.Table_a64d6f4bab3143d38f8607e0bcd63898 [id=2b421f86f2ea4c92a7b124bbf300a02e]) successfully deleted
W20260811 06:16:55.306576 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f9fd17e8c6264f898493c15b0aa5518d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9fd17e8c6264f898493c15b0aa5518d already in progress: creating tablet
W20260811 06:16:55.306994 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet cdb93dcd940a47e78c5458041c768e36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdb93dcd940a47e78c5458041c768e36 already in progress: creating tablet
W20260811 06:16:55.307493 10307 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 11c50f909aad4bb991bfdeae8eab8455 because the tablet was not found. No further retry: Not found: Tablet not found: 11c50f909aad4bb991bfdeae8eab8455
I20260811 06:16:55.309988 11361 ts_tablet_manager.cc:1428] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.037s user 0.004s sys 0.000s
I20260811 06:16:55.311852 11362 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:55.312040 11362 ts_tablet_manager.cc:1397] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.004s
I20260811 06:16:55.313244 11362 raft_consensus.cc:348] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.313556 11362 raft_consensus.cc:374] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.313763 11362 raft_consensus.cc:729] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.313906 11361 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:16:55.313428 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:16:55.314062 11362 consensus_queue.cc:260] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.315117 11362 ts_tablet_manager.cc:1428] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:16:55.315526 11362 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:55.310665 11365 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:55.319514 11365 ts_tablet_manager.cc:1397] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.017s
I20260811 06:16:55.320854 11365 raft_consensus.cc:348] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.321138 11365 raft_consensus.cc:374] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.321271 11365 raft_consensus.cc:729] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:16:55.321416 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f07dfeeb52d64d08811e3b22d8861f62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.321458 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54ba1e15029743bf966febe3c88a4a0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.321589 11365 consensus_queue.cc:260] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.321841 11371 ts_tablet_manager.cc:1905] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.322527 11368 ts_tablet_manager.cc:1918] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.322706 11368 log.cc:1196] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e7d44fa2df924751a4835821901b56de
I20260811 06:16:55.323190 11368 ts_tablet_manager.cc:1939] T e7d44fa2df924751a4835821901b56de P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:55.323741 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 245) took 2143 ms. Trace:
I20260811 06:16:55.323939 11368 rpcz_store.cc:276] 0811 06:16:53.180170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.180575 (+ 405us) service_pool.cc:227] Handling call
0811 06:16:55.207824 (+2027249us) ts_tablet_manager.cc:1145] Deleting tablet e7d44fa2df924751a4835821901b56de
0811 06:16:55.207851 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.310364 (+102513us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.322405 (+ 12041us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.323652 (+ 1247us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2027027}
I20260811 06:16:55.206746 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 5b681f10c3de4bd798b9d519f10da103 (table default.Table_f29d57725aa74ed2b2d8eb05bd1e2990 [id=783d0e401b2a42b1adf7bbbaa13eed9c]) successfully deleted
W20260811 06:16:55.324422 10309 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 117600us
I20260811 06:16:55.324586 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 246) took 2141 ms. Trace:
I20260811 06:16:55.324713 11368 rpcz_store.cc:276] 0811 06:16:53.182768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.183858 (+ 1090us) service_pool.cc:227] Handling call
0811 06:16:55.324234 (+2140376us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:16:55.324245 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.324497 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140125}
I20260811 06:16:55.325268 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 247) took 2140 ms. Trace:
I20260811 06:16:55.325452 11368 rpcz_store.cc:276] 0811 06:16:53.185221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.185273 (+ 52us) service_pool.cc:227] Handling call
0811 06:16:55.324978 (+2139705us) ts_tablet_manager.cc:1145] Deleting tablet ea4eb7f5db2e4e75818bfb228b64ed0d
0811 06:16:55.324987 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.325161 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139477}
W20260811 06:16:55.325873 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7214648b53e4bbca0fa28baa9d9aa85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.325681 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet e7d44fa2df924751a4835821901b56de (table default.Table_f3920e2166f84954861eb83e3296fed4 [id=5b9959e1b81d47a7a923c6d7dbbc3020]) successfully deleted
W20260811 06:16:55.327468 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ea4eb7f5db2e4e75818bfb228b64ed0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea4eb7f5db2e4e75818bfb228b64ed0d already in progress: creating tablet
I20260811 06:16:55.329757 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 171) took 4256 ms. Trace:
I20260811 06:16:55.330991 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 248) took 2143 ms. Trace:
I20260811 06:16:55.331146 11368 rpcz_store.cc:276] 0811 06:16:53.187718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.188455 (+ 737us) service_pool.cc:227] Handling call
0811 06:16:55.325663 (+2137208us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:16:55.325672 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.330857 (+ 5185us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137017}
I20260811 06:16:55.331526 11368 tablet_replica.cc:330] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:55.331770 11368 raft_consensus.cc:2229] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 06:16:55.331877 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e5b4cdeb464861ada487eeb1b901a6 already in progress: creating tablet
I20260811 06:16:55.332119 11368 raft_consensus.cc:2258] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.333703 11370 rpcz_store.cc:276] 0811 06:16:51.072800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.073057 (+ 257us) service_pool.cc:227] Handling call
0811 06:16:55.297375 (+4224318us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:16:55.297387 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.329667 (+ 32280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4223872}
W20260811 06:16:55.334379 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ac8c5daeb3249e38d863ee94f1267b1 already in progress: creating tablet
W20260811 06:16:55.335768 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a04766ede03342efb594aaf081e112af has no consensus state
I20260811 06:16:55.334389 11362 tablet_bootstrap.cc:654] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.335997 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 168) took 4300 ms. Trace:
I20260811 06:16:55.336122 11370 rpcz_store.cc:276] 0811 06:16:51.035525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.035597 (+ 72us) service_pool.cc:227] Handling call
0811 06:16:55.335817 (+4300220us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:16:55.335833 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.335961 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4254014}
W20260811 06:16:55.336690 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6119212ae4be4204852a5d9437dcee72 already in progress: creating tablet
W20260811 06:16:55.339524 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a67daf4bdf45464b916905f432f0ec9c consensus state has no leader
I20260811 06:16:55.341759 11365 ts_tablet_manager.cc:1428] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260811 06:16:55.342276 11365 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:55.343577 10616 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.344159 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_e83ccea892504992b1e3339408fb4cd2" } new_table_name: "default.Table_edd6f59b376846248a03f18cd0c9ebe9" modify_external_catalogs: true
I20260811 06:16:55.345227 11370 tablet_replica.cc:330] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:55.345340 11365 tablet_bootstrap.cc:654] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.345569 11370 raft_consensus.cc:2229] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.345520 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9cba92820384428c9888d5fb5b4bbc4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.345927 11370 raft_consensus.cc:2258] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.347375 11361 tablet_bootstrap.cc:654] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.348224 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_28d17bc11c5147c785d93e4351465ea9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.351624 11370 ts_tablet_manager.cc:1905] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:55.355669 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cba92820384428c9888d5fb5b4bbc4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.359077 11368 ts_tablet_manager.cc:1905] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.369608 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 516e3c37321f4c7b9f3373164682a0ff (DEFAULT_TABLE table=default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.370143 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16" } modify_external_catalogs: true
I20260811 06:16:55.370749 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16" } modify_external_catalogs: true
I20260811 06:16:55.372937 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516e3c37321f4c7b9f3373164682a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.374531 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 5e990aa374204f2b95c08b04121176bc (DEFAULT_TABLE table=default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.375017 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e990aa374204f2b95c08b04121176bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:55.383661 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28d17bc11c5147c785d93e4351465ea9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.385510 11361 tablet_bootstrap.cc:492] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:55.385154 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_aa6b10390f404e3aba1f467371294eb8" } new_table_name: "default.Table_c27690eca2084b0cbcb99426b13ff8ee" modify_external_catalogs: true
I20260811 06:16:55.387063 10324 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:16:55.389250 11361 ts_tablet_manager.cc:1397] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.003s
I20260811 06:16:55.389549 11371 ts_tablet_manager.cc:1918] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.390441 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_29feb2450eea49108943aac8a6045185" } new_table_name: "default.Table_ee6cc44965e64249b5e0bf8d17d39099" modify_external_catalogs: true
I20260811 06:16:55.390766 11361 raft_consensus.cc:348] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.391156 11361 raft_consensus.cc:374] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.391196 11371 log.cc:1196] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:55.391357 11361 raft_consensus.cc:729] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.391665 11361 consensus_queue.cc:260] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.393342 11371 ts_tablet_manager.cc:1939] T 3025339a6c9e4e07bba4104006206bb8 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:55.396027 10307 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 51286.8us
I20260811 06:16:55.396796 11368 ts_tablet_manager.cc:1918] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.399494 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 3025339a6c9e4e07bba4104006206bb8 (table default.Table_88237316c36548428404ae24db07eee6 [id=38608eecd4ea4c92a3cedbfad1d631a6]) successfully deleted
W20260811 06:16:55.400002 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f12c8618198f4413b2727d04f850a10f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f12c8618198f4413b2727d04f850a10f already in progress: creating tablet
W20260811 06:16:55.400529 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:16:55.401798 10606 tablet_service.cc:1467] Processing CreateTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 (DEFAULT_TABLE table=default.Table_6dc46c22336b4c2f83418c51c5ecc919 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.402354 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc323cf778548ae86f45f0fd8bd4a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.406303 10615 tablet_service.cc:1467] Processing CreateTablet for tablet e329d808c59c4f66bbc515d751255e96 (DEFAULT_TABLE table=default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.406991 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e329d808c59c4f66bbc515d751255e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.413511 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 4124f64656614c91b7d9115c2efbecd1 (DEFAULT_TABLE table=default.Table_317717a9da1a41028e46bcebb073c694 [id=0fb1742233f640a8a51ca49d6be5191c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.414072 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4124f64656614c91b7d9115c2efbecd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.418563 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 05867781f7954fb280cc83b2a13d0d61
W20260811 06:16:55.421859 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8bd026d2c6064a67b1c432efa4474a0e consensus state has no leader
I20260811 06:16:55.422504 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9a7b04bde68640deb63e6bdbd0f322d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.422857 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.423245 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a7b04bde68640deb63e6bdbd0f322d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.423492 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.424758 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 5119e9bb88844329aea123dc3805d91d
W20260811 06:16:55.426764 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17d90d3d23454c5bbeba1bb900b68c73 consensus state has no leader
I20260811 06:16:55.428390 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b054c9a152034800800171e9f8d77579" } modify_external_catalogs: true
I20260811 06:16:55.428716 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_b054c9a152034800800171e9f8d77579" } modify_external_catalogs: true
I20260811 06:16:55.431079 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 37e73b8798b2455baf642abc532a5d8c
I20260811 06:16:55.431862 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 3250276181a24e58a2db92376b7520e7 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:55.435294 10328 master_service.cc:946] ReplaceTablet: received request to replace tablet 6dee9af5a4504b8284c9150298ab3462 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:55.435525 10337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:16:55.435928 11365 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:55.436172 11365 ts_tablet_manager.cc:1397] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.011s
I20260811 06:16:55.436439 10337 catalog_manager.cc:6565] ReplaceTablet: tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 deleted and replaced by tablet a33fc402d3084b458929d76b8fc22adb
I20260811 06:16:55.436736 10337 master_service.cc:946] ReplaceTablet: received request to replace tablet a0e5b4cdeb464861ada487eeb1b901a6 from {username='slave'} at 127.0.0.1:37928
I20260811 06:16:55.437245 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_53cb23e4e85049898ced77eaa6b01e32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.437671 11365 raft_consensus.cc:348] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:55.437964 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53cb23e4e85049898ced77eaa6b01e32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.438033 11365 raft_consensus.cc:374] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.438205 11365 raft_consensus.cc:729] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.440019 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5940fa3078de423d855e54ba1af1597a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.440804 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5940fa3078de423d855e54ba1af1597a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.441695 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 516e3c37321f4c7b9f3373164682a0ff (DEFAULT_TABLE table=default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.442262 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516e3c37321f4c7b9f3373164682a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.442622 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_0a7428e94c2a44059b7d8c83ce698701"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.443181 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a7428e94c2a44059b7d8c83ce698701 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.444290 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:16:55.446244 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 5e990aa374204f2b95c08b04121176bc (DEFAULT_TABLE table=default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.446848 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e990aa374204f2b95c08b04121176bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.450484 10613 tablet_service.cc:1467] Processing CreateTablet for tablet a04766ede03342efb594aaf081e112af (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.450973 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04766ede03342efb594aaf081e112af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:55.456714 10309 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 864c3bbf1e004579a4d0be809f83ca33 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 864c3bbf1e004579a4d0be809f83ca33 consensus state has no leader
I20260811 06:16:55.457060 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 54249325b2fa462bbc476ea609ec5389 (DEFAULT_TABLE table=default.Table_1eecfa20d58747f69101093c3f4c9443 [id=dcd0a85bedc24ef4b83da3f0786e87ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.457136 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.458128 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.458249 10619 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.458844 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:55.458887 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6dee9af5a4504b8284c9150298ab3462 consensus state has no leader
I20260811 06:16:55.459061 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.460009 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 10bb259b9721485db9c968763434f67e (DEFAULT_TABLE table=default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.460454 10632 tablet_service.cc:1467] Processing CreateTablet for tablet ce5f2fa8c64247419f2ca9b26df825b0 (DEFAULT_TABLE table=default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f [id=1d188ef5750f4c53a794d6fe52d9a273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.397779 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 4124f64656614c91b7d9115c2efbecd1 (DEFAULT_TABLE table=default.Table_317717a9da1a41028e46bcebb073c694 [id=0fb1742233f640a8a51ca49d6be5191c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.461895 11368 log.cc:1196] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:55.462106 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4124f64656614c91b7d9115c2efbecd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.462670 11368 ts_tablet_manager.cc:1939] T b1d6641dd44340889879d3b92018b3f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:55.464036 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 256) took 2120 ms. Trace:
I20260811 06:16:55.464236 11368 rpcz_store.cc:276] 0811 06:16:53.343015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.343209 (+ 194us) service_pool.cc:227] Handling call
0811 06:16:55.331408 (+1988199us) ts_tablet_manager.cc:1145] Deleting tablet b1d6641dd44340889879d3b92018b3f0
0811 06:16:55.331420 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.364304 (+ 32884us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.386436 (+ 22132us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.463613 (+ 77177us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1983982}
I20260811 06:16:55.398612 10867 tablet_service.cc:1467] Processing CreateTablet for tablet c03f18c65ada4b0b86534d29cd363d9a (DEFAULT_TABLE table=default.Table_4530e0ff64ae41b8a453e4be20673822 [id=3c39ffa2022447068fcc6f6f551a38a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.464473 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.464746 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 263) took 1774 ms. Trace:
I20260811 06:16:55.464986 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c03f18c65ada4b0b86534d29cd363d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.465159 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.464900 11368 rpcz_store.cc:276] 0811 06:16:53.690481 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.690834 (+ 353us) service_pool.cc:227] Handling call
0811 06:16:55.464543 (+1773709us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:16:55.464555 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.464683 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1758037}
I20260811 06:16:55.465785 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet b1d6641dd44340889879d3b92018b3f0 (table default.Table_35412a7c2bd54e9d95217170b0e53051 [id=ccf560e77b2a45bd81fc1f5d3c03fe08]) successfully deleted
I20260811 06:16:55.470574 11960 raft_consensus.cc:482] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.470767 11960 raft_consensus.cc:504] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.471591 11960 leader_election.cc:288] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:55.472461 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54249325b2fa462bbc476ea609ec5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.472558 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7 (DEFAULT_TABLE table=default.Table_12c813de7c074af4a5f244b7b9c3d9aa [id=2ede34034a9a4280840d8e8e77773ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.473240 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:16:55.398921 10864 tablet_service.cc:1467] Processing CreateTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 (DEFAULT_TABLE table=default.Table_6dc46c22336b4c2f83418c51c5ecc919 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.477952 11105 tablet_service.cc:1467] Processing CreateTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 (DEFAULT_TABLE table=default.Table_6dc46c22336b4c2f83418c51c5ecc919 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.478057 11103 tablet_service.cc:1467] Processing CreateTablet for tablet c03f18c65ada4b0b86534d29cd363d9a (DEFAULT_TABLE table=default.Table_4530e0ff64ae41b8a453e4be20673822 [id=3c39ffa2022447068fcc6f6f551a38a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.399070 10866 tablet_service.cc:1467] Processing CreateTablet for tablet e329d808c59c4f66bbc515d751255e96 (DEFAULT_TABLE table=default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.400353 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 (DEFAULT_TABLE table=default.Table_31f21072ad3b4938a8597fe126b2e970 [id=0d87a935d35c48b893db83a9ec292628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.400853 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 1271c4ab028d4d45acfee370f13a02d3 (DEFAULT_TABLE table=default.Table_71704b455f8b486386183aea5444d3ef [id=a625b1c349294cf7b3f9e79803d7b1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.401362 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 516e3c37321f4c7b9f3373164682a0ff (DEFAULT_TABLE table=default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.401816 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 5e990aa374204f2b95c08b04121176bc (DEFAULT_TABLE table=default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.402299 10879 tablet_service.cc:1467] Processing CreateTablet for tablet a04766ede03342efb594aaf081e112af (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.478449 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 4124f64656614c91b7d9115c2efbecd1 (DEFAULT_TABLE table=default.Table_317717a9da1a41028e46bcebb073c694 [id=0fb1742233f640a8a51ca49d6be5191c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.402736 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 54249325b2fa462bbc476ea609ec5389 (DEFAULT_TABLE table=default.Table_1eecfa20d58747f69101093c3f4c9443 [id=dcd0a85bedc24ef4b83da3f0786e87ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.409411 11766 consensus_queue.cc:1035] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:55.410358 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 10bb259b9721485db9c968763434f67e (DEFAULT_TABLE table=default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.479117 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 54249325b2fa462bbc476ea609ec5389 (DEFAULT_TABLE table=default.Table_1eecfa20d58747f69101093c3f4c9443 [id=dcd0a85bedc24ef4b83da3f0786e87ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.479538 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.479713 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 1271c4ab028d4d45acfee370f13a02d3 (DEFAULT_TABLE table=default.Table_71704b455f8b486386183aea5444d3ef [id=a625b1c349294cf7b3f9e79803d7b1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.414626 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb (DEFAULT_TABLE table=default.Table_04500ce2ab80444b9cafeaa864c9e65c [id=43248d68796b43e8b16d7ab6ce8f5507]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.415091 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7 (DEFAULT_TABLE table=default.Table_12c813de7c074af4a5f244b7b9c3d9aa [id=2ede34034a9a4280840d8e8e77773ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.415611 10884 tablet_service.cc:1467] Processing CreateTablet for tablet ce5f2fa8c64247419f2ca9b26df825b0 (DEFAULT_TABLE table=default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f [id=1d188ef5750f4c53a794d6fe52d9a273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.433581 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.434087 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.434537 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.436923 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.437186 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.482215 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d0530ec053f47df800cf2abf549b068 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:48 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.484107 11361 ts_tablet_manager.cc:1428] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.090s user 0.000s sys 0.003s
W20260811 06:16:55.484414 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
I20260811 06:16:55.484571 11361 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:55.486021 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88af70bbada49309a0e7cc7c333d6f0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:55.482163 11106 tablet_service.cc:1467] Processing CreateTablet for tablet a04766ede03342efb594aaf081e112af (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.487279 10627 tablet_service.cc:1467] Processing CreateTablet for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb (DEFAULT_TABLE table=default.Table_04500ce2ab80444b9cafeaa864c9e65c [id=43248d68796b43e8b16d7ab6ce8f5507]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:55.487651 10813 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:55.489552 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 (DEFAULT_TABLE table=default.Table_31f21072ad3b4938a8597fe126b2e970 [id=0d87a935d35c48b893db83a9ec292628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.490021 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 10bb259b9721485db9c968763434f67e (DEFAULT_TABLE table=default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.491523 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4124f64656614c91b7d9115c2efbecd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.490847 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7 (DEFAULT_TABLE table=default.Table_12c813de7c074af4a5f244b7b9c3d9aa [id=2ede34034a9a4280840d8e8e77773ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.493103 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc323cf778548ae86f45f0fd8bd4a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.493598 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.496295 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 1271c4ab028d4d45acfee370f13a02d3 (DEFAULT_TABLE table=default.Table_71704b455f8b486386183aea5444d3ef [id=a625b1c349294cf7b3f9e79803d7b1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.497484 11098 tablet_service.cc:1467] Processing CreateTablet for tablet ce5f2fa8c64247419f2ca9b26df825b0 (DEFAULT_TABLE table=default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f [id=1d188ef5750f4c53a794d6fe52d9a273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.497980 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bb259b9721485db9c968763434f67e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:55.498142 10810 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0
I20260811 06:16:55.498301 10810 leader_election.cc:302] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:55.498466 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb (DEFAULT_TABLE table=default.Table_04500ce2ab80444b9cafeaa864c9e65c [id=43248d68796b43e8b16d7ab6ce8f5507]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:55.498919 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1981dc26be24ec5afaa3c0bb5c46c8c already in progress: creating tablet
I20260811 06:16:55.499032 11115 tablet_service.cc:1467] Processing CreateTablet for tablet e329d808c59c4f66bbc515d751255e96 (DEFAULT_TABLE table=default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.499383 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.499631 10616 tablet_service.cc:1467] Processing CreateTablet for tablet c03f18c65ada4b0b86534d29cd363d9a (DEFAULT_TABLE table=default.Table_4530e0ff64ae41b8a453e4be20673822 [id=3c39ffa2022447068fcc6f6f551a38a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.501539 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.501574 11766 raft_consensus.cc:2726] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:55.501652 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.501883 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04766ede03342efb594aaf081e112af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.502501 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce5f2fa8c64247419f2ca9b26df825b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.504438 11371 tablet_replica.cc:330] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:55.504889 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 (DEFAULT_TABLE table=default.Table_31f21072ad3b4938a8597fe126b2e970 [id=0d87a935d35c48b893db83a9ec292628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.505944 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc323cf778548ae86f45f0fd8bd4a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.506059 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.506107 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e329d808c59c4f66bbc515d751255e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.506247 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54249325b2fa462bbc476ea609ec5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.507488 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.507757 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c03f18c65ada4b0b86534d29cd363d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.508220 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.508842 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c03f18c65ada4b0b86534d29cd363d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.509353 11371 raft_consensus.cc:2229] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.509578 11371 raft_consensus.cc:2258] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.509861 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54249325b2fa462bbc476ea609ec5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.505502 11365 consensus_queue.cc:260] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:55.513899 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.514213 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce5f2fa8c64247419f2ca9b26df825b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.514271 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10211a4e95464e9e9e2b2e70d23086a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.516079 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1271c4ab028d4d45acfee370f13a02d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.519445 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bb259b9721485db9c968763434f67e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.522214 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10211a4e95464e9e9e2b2e70d23086a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.523734 11371 ts_tablet_manager.cc:1905] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.525897 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.525956 11365 ts_tablet_manager.cc:1428] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.081s user 0.004s sys 0.000s
I20260811 06:16:55.527917 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e990aa374204f2b95c08b04121176bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.529531 11365 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:55.532244 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.533260 11961 raft_consensus.cc:482] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.533478 11961 raft_consensus.cc:504] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.534003 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1271c4ab028d4d45acfee370f13a02d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.534646 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet c00b6bdfc8ac4b5db81de9f614fcf213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.536136 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04766ede03342efb594aaf081e112af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.539057 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516e3c37321f4c7b9f3373164682a0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.540329 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a8113f59c0e34eb5874fb236cd107426" } new_table_name: "default.Table_3826ea7f52ba4532a58bb15b37cb67e5" modify_external_catalogs: true
I20260811 06:16:55.542870 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1271c4ab028d4d45acfee370f13a02d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.546409 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.547595 11961 leader_election.cc:288] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.550405 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_aecd4ad372f24176971a2c21bd9af268"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.551430 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aecd4ad372f24176971a2c21bd9af268 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.545377 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.553296 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6dc46c22336b4c2f83418c51c5ecc919" } new_table_name: "default.Table_c2df3453e7c04197819a9ddf42b2f6d1" modify_external_catalogs: true
I20260811 06:16:55.556180 11362 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:55.556231 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce5f2fa8c64247419f2ca9b26df825b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:55.558198 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0874f0e73267446fb873f4619f93307e consensus state has no leader
I20260811 06:16:55.547904 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c00b6bdfc8ac4b5db81de9f614fcf213" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:55.558435 11362 ts_tablet_manager.cc:1397] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.241s user 0.008s sys 0.008s
I20260811 06:16:55.558588 10921 raft_consensus.cc:2454] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:55.560112 11046 leader_election.cc:341] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:55.560508 11047 leader_election.cc:302] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:55.560906 11362 raft_consensus.cc:348] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.561199 11961 raft_consensus.cc:2781] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:55.561466 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10bb259b9721485db9c968763434f67e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.561939 11976 raft_consensus.cc:482] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.561784 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 262) took 1857 ms. Trace:
I20260811 06:16:55.563235 11766 consensus_queue.cc:1035] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:55.563844 11362 raft_consensus.cc:374] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.563963 11362 raft_consensus.cc:729] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.562927 11976 raft_consensus.cc:504] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.564800 11362 consensus_queue.cc:260] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.565599 11362 ts_tablet_manager.cc:1428] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260811 06:16:55.568051 11799 raft_consensus.cc:482] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:55.568192 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.568092 11961 raft_consensus.cc:482] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:55.570613 11976 leader_election.cc:288] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:55.571385 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c5fa9633057485b917f117819d79398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:55.571616 10921 raft_consensus.cc:2454] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:55.572508 10555 leader_election.cc:302] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:55.573457 11799 raft_consensus.cc:504] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.573956 11976 raft_consensus.cc:2781] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:55.574002 11362 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:55.574091 11976 raft_consensus.cc:482] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:55.574244 11976 raft_consensus.cc:3037] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.574235 11799 leader_election.cc:288] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.574697 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10211a4e95464e9e9e2b2e70d23086a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.576726 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0530ec053f47df800cf2abf549b068" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:55.577105 10921 raft_consensus.cc:2454] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:55.578716 11047 leader_election.cc:302] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:55.578732 11961 raft_consensus.cc:3037] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.578681 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e329d808c59c4f66bbc515d751255e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.582521 11799 raft_consensus.cc:2781] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:55.584482 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.587364 11362 tablet_bootstrap.cc:654] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.591897 11365 tablet_bootstrap.cc:654] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.583562 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c5fa9633057485b917f117819d79398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:55.593878 11799 raft_consensus.cc:482] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 06:16:55.597821 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fdc323cf778548ae86f45f0fd8bd4a89 consensus state has no leader
I20260811 06:16:55.599997 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_99ba61ba26854472b2956b8a4f61302b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.600632 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ba61ba26854472b2956b8a4f61302b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.602705 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.603297 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.603888 11368 rpcz_store.cc:276] 0811 06:16:53.690331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.690397 (+ 66us) service_pool.cc:227] Handling call
0811 06:16:55.467280 (+1776883us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:16:55.467292 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.547435 (+ 80143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1760630}
W20260811 06:16:55.606037 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d668bcfbeff54181ba3b4407b1eb5704 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d668bcfbeff54181ba3b4407b1eb5704 already in progress: creating tablet
I20260811 06:16:55.610697 11799 raft_consensus.cc:3037] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.611966 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 75094a86738d42fca39d57f8d90e8af9 (DEFAULT_TABLE table=default.Table_f7214648b53e4bbca0fa28baa9d9aa85 [id=35e26ca6163d4acdac6cc34f05d420fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.615309 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 264) took 1907 ms. Trace:
I20260811 06:16:55.615500 11368 rpcz_store.cc:276] 0811 06:16:53.708192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.708315 (+ 123us) service_pool.cc:227] Handling call
0811 06:16:55.615114 (+1906799us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:16:55.615125 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.615246 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1902324}
I20260811 06:16:55.615964 11368 tablet_replica.cc:330] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:55.616220 11368 raft_consensus.cc:2229] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:55.616462 11368 raft_consensus.cc:2258] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:55.616701 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6dee9af5a4504b8284c9150298ab3462
I20260811 06:16:55.617077 11368 ts_tablet_manager.cc:1905] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:55.617141 10328 catalog_manager.cc:6565] ReplaceTablet: tablet 6dee9af5a4504b8284c9150298ab3462 deleted and replaced by tablet c2527862e75b42aa9091456b0f5f994e
I20260811 06:16:55.618789 11362 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:55.618953 11362 ts_tablet_manager.cc:1397] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.000s
I20260811 06:16:55.620226 11362 raft_consensus.cc:348] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.624238 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 576a3e27d5424e4b999a05beb898d4bb (DEFAULT_TABLE table=default.Table_4f975881a087493596aaab9db2522ada [id=1fed2747c71345a79e630cd6c7e94aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.625418 10860 tablet_service.cc:1467] Processing CreateTablet for tablet fb5484b422a843b7810dd3b68a178ffd (DEFAULT_TABLE table=default.Table_c3e1b3f8f6d84555b87c499a26cbc29c [id=b40af271c2bf4a079699e9a4e3aa9b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.626534 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 866460b8d10a4cd1aed8a7a4e5511b29 (DEFAULT_TABLE table=default.Table_ae64cada77924676bd6d9731a89a7a6b [id=71b79ba7b26744d99e8d71863b12b5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.627436 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_7f5293da6027442190e67927b3957712" } modify_external_catalogs: true
I20260811 06:16:55.627707 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_7f5293da6027442190e67927b3957712" } modify_external_catalogs: true
I20260811 06:16:55.630548 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_31f21072ad3b4938a8597fe126b2e970" } new_table_name: "default.Table_0cb7dbf7c4d74e18abf6d9a5eba57e77" modify_external_catalogs: true
I20260811 06:16:55.634629 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c7fdf6b388124805afa944307aead1d1" } modify_external_catalogs: true
I20260811 06:16:55.634940 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c7fdf6b388124805afa944307aead1d1" } modify_external_catalogs: true
I20260811 06:16:55.638367 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0239afa9778a4851b82c1ed6655dc6dd" } new_table_name: "default.Table_1d92d36d1121431d96ae878f85642170" modify_external_catalogs: true
I20260811 06:16:55.638696 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c" } modify_external_catalogs: true
I20260811 06:16:55.639196 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c" } modify_external_catalogs: true
I20260811 06:16:55.641089 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d6b851b238cc407c91a9e72f70ac3b5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.641947 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6b851b238cc407c91a9e72f70ac3b5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.641752 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ab1832782184476f9e838bca820e45e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.642364 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab1832782184476f9e838bca820e45e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.651157 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 consensus state has no leader
W20260811 06:16:55.653168 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10211a4e95464e9e9e2b2e70d23086a5 consensus state has no leader
I20260811 06:16:55.656009 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5b5d84668c4a4af0af5832368bb75e15" } modify_external_catalogs: true
I20260811 06:16:55.657088 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_5b5d84668c4a4af0af5832368bb75e15" } modify_external_catalogs: true
I20260811 06:16:55.659222 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 7db813cbb8f74b329015b163ebd58c00
I20260811 06:16:55.665895 11362 raft_consensus.cc:374] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:55.655551 10330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 6703e639ab2042e78fadc63bd18c7602
I20260811 06:16:55.668460 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a74689c2487947639884dc54e461cf46" } new_table_name: "default.Table_4f7e2cab315242af8d129fc6b73494be" modify_external_catalogs: true
I20260811 06:16:55.668571 11362 raft_consensus.cc:729] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:55.668846 11362 consensus_queue.cc:260] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.672205 11362 ts_tablet_manager.cc:1428] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.050s user 0.002s sys 0.001s
I20260811 06:16:55.675029 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e37a4f07d9434d77a1a6ec7dfe022355"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.675765 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e37a4f07d9434d77a1a6ec7dfe022355 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.679419 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_221001ee9f7d4adbaeed611c4a678bcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.679890 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_99b250b50327413e93d821e917b05f4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.680095 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_221001ee9f7d4adbaeed611c4a678bcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:55.680576 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99b250b50327413e93d821e917b05f4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.682227 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:16:55.682842 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75094a86738d42fca39d57f8d90e8af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.683568 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5484b422a843b7810dd3b68a178ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.685916 11362 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:55.688433 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 866460b8d10a4cd1aed8a7a4e5511b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.692951 10324 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_98dfdc335a9a4099a9eecb03b173c8af" } modify_external_catalogs: true
I20260811 06:16:55.693236 10324 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_98dfdc335a9a4099a9eecb03b173c8af" } modify_external_catalogs: true
I20260811 06:16:55.693758 10886 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:55.694303 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3b5a8830887248dd84904417be8ddd49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.695015 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b5a8830887248dd84904417be8ddd49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.691949 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d7af297ac07b41e3b08ea8f3fdcda000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.697328 10854 tablet_service.cc:1467] Processing CreateTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b (DEFAULT_TABLE table=default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:55.696972 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7af297ac07b41e3b08ea8f3fdcda000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.708371 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 576a3e27d5424e4b999a05beb898d4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.711171 11121 tablet_service.cc:1467] Processing CreateTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b (DEFAULT_TABLE table=default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.719177 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fa71e5477644e0a0d7c40ecc55928b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:55.721551 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61114d1bcdb94af7b6c55b0331accee5 consensus state has no leader
I20260811 06:16:55.721848 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet e180cc2c38aa4a78897e264276e4c766
I20260811 06:16:55.722254 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 576a3e27d5424e4b999a05beb898d4bb (DEFAULT_TABLE table=default.Table_4f975881a087493596aaab9db2522ada [id=1fed2747c71345a79e630cd6c7e94aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.725652 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 576a3e27d5424e4b999a05beb898d4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.723060 11116 tablet_service.cc:1467] Processing CreateTablet for tablet 75094a86738d42fca39d57f8d90e8af9 (DEFAULT_TABLE table=default.Table_f7214648b53e4bbca0fa28baa9d9aa85 [id=35e26ca6163d4acdac6cc34f05d420fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.726609 10613 tablet_service.cc:1467] Processing CreateTablet for tablet fb5484b422a843b7810dd3b68a178ffd (DEFAULT_TABLE table=default.Table_c3e1b3f8f6d84555b87c499a26cbc29c [id=b40af271c2bf4a079699e9a4e3aa9b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.727219 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5484b422a843b7810dd3b68a178ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.730995 10609 tablet_service.cc:1467] Processing CreateTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b (DEFAULT_TABLE table=default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.731325 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75094a86738d42fca39d57f8d90e8af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.732067 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 7821b08482ed49ea8e90155805a88ae5 (DEFAULT_TABLE table=default.Table_2688b67c9243454f9fe9823b4e9c1318 [id=2f00a94a6f874331b2e6fbce027260bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.734449 10619 tablet_service.cc:1467] Processing CreateTablet for tablet eede55349694488b9899ec56a80c8d5b (DEFAULT_TABLE table=default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac [id=587929f897ff4559a8fc4f15e4346433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.734879 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 866460b8d10a4cd1aed8a7a4e5511b29 (DEFAULT_TABLE table=default.Table_ae64cada77924676bd6d9731a89a7a6b [id=71b79ba7b26744d99e8d71863b12b5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.735132 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 576a3e27d5424e4b999a05beb898d4bb (DEFAULT_TABLE table=default.Table_4f975881a087493596aaab9db2522ada [id=1fed2747c71345a79e630cd6c7e94aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.736195 10604 tablet_service.cc:1467] Processing CreateTablet for tablet b7409453e6e34172870dbb9fb3c5ac44 (DEFAULT_TABLE table=default.Table_f07dfeeb52d64d08811e3b22d8861f62 [id=5ba59e9fdaef4ce389c3495e99dd16e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.737510 10616 tablet_service.cc:1467] Processing CreateTablet for tablet 75094a86738d42fca39d57f8d90e8af9 (DEFAULT_TABLE table=default.Table_f7214648b53e4bbca0fa28baa9d9aa85 [id=35e26ca6163d4acdac6cc34f05d420fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.737986 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7821b08482ed49ea8e90155805a88ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.739272 10618 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.739683 10616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75094a86738d42fca39d57f8d90e8af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.739970 10619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eede55349694488b9899ec56a80c8d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.739589 11119 tablet_service.cc:1467] Processing CreateTablet for tablet fb5484b422a843b7810dd3b68a178ffd (DEFAULT_TABLE table=default.Table_c3e1b3f8f6d84555b87c499a26cbc29c [id=b40af271c2bf4a079699e9a4e3aa9b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.741684 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5484b422a843b7810dd3b68a178ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.743134 11976 raft_consensus.cc:504] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.743587 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0278945378465ea9d61180b5f539dd (DEFAULT_TABLE table=default.Table_54ba1e15029743bf966febe3c88a4a0d [id=9529d1977a76475089aedc4f6b39d450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.744340 11976 leader_election.cc:288] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:55.744608 11370 ts_tablet_manager.cc:1918] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:55.748129 10618 tablet_service.cc:1467] Processing CreateTablet for tablet 45fc206d95a244e395d19328ae289485 (DEFAULT_TABLE table=default.Table_c37fb719a3e14506afcc1723b90ae323 [id=effd576838844300b8d7a4ee9a30a0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.752839 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7409453e6e34172870dbb9fb3c5ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.753113 11110 tablet_service.cc:1467] Processing CreateTablet for tablet eede55349694488b9899ec56a80c8d5b (DEFAULT_TABLE table=default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac [id=587929f897ff4559a8fc4f15e4346433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.755638 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 7821b08482ed49ea8e90155805a88ae5 (DEFAULT_TABLE table=default.Table_2688b67c9243454f9fe9823b4e9c1318 [id=2f00a94a6f874331b2e6fbce027260bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.756148 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7821b08482ed49ea8e90155805a88ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.754311 10614 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.758967 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 866460b8d10a4cd1aed8a7a4e5511b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.759183 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 866460b8d10a4cd1aed8a7a4e5511b29 (DEFAULT_TABLE table=default.Table_ae64cada77924676bd6d9731a89a7a6b [id=71b79ba7b26744d99e8d71863b12b5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.758809 10627 tablet_service.cc:1467] Processing CreateTablet for tablet b8fefa0f4ed44b87825cc34f7ecafcbf (DEFAULT_TABLE table=default.Table_36da3a35575f40f6874a2055c8fc7faf [id=704fa680cec24a979014dbf21703f12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.761055 10618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fc206d95a244e395d19328ae289485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.761432 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 576a3e27d5424e4b999a05beb898d4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.763906 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fa71e5477644e0a0d7c40ecc55928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.764217 10627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fefa0f4ed44b87825cc34f7ecafcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.764487 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.764848 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.773465 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0278945378465ea9d61180b5f539dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.774085 11128 tablet_service.cc:1467] Processing CreateTablet for tablet b7409453e6e34172870dbb9fb3c5ac44 (DEFAULT_TABLE table=default.Table_f07dfeeb52d64d08811e3b22d8861f62 [id=5ba59e9fdaef4ce389c3495e99dd16e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.774322 10608 tablet_service.cc:1467] Processing CreateTablet for tablet a8513fc279dc44f48c45e9dda40e5398 (DEFAULT_TABLE table=default.Table_3d5b15230b7540f29a0085d1018944fb [id=7bef46a8e8374c59b811e037981d997f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.774634 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3fa8872f8b4a5e9b09da26f8bba721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.779763 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8513fc279dc44f48c45e9dda40e5398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.795506 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet e180cc2c38aa4a78897e264276e4c766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.796445 10324 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 516e3c37321f4c7b9f3373164682a0ff
I20260811 06:16:55.797657 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4227de75e23646f2a53a023b660c907f" } new_table_name: "default.Table_d7b23f45b7b14c719f98c5b359db7502" modify_external_catalogs: true
I20260811 06:16:55.787462 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.810096 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.810909 11961 raft_consensus.cc:504] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.811852 11961 leader_election.cc:288] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.801385 11799 raft_consensus.cc:504] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:55.815969 11371 ts_tablet_manager.cc:1918] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.819003 11799 leader_election.cc:288] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:55.843835 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eede55349694488b9899ec56a80c8d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.847723 11361 tablet_bootstrap.cc:654] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.848924 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 866460b8d10a4cd1aed8a7a4e5511b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.849478 11371 log.cc:1196] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a378a6f20c564eb685b655a762b638ae
I20260811 06:16:55.848649 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0278945378465ea9d61180b5f539dd (DEFAULT_TABLE table=default.Table_54ba1e15029743bf966febe3c88a4a0d [id=9529d1977a76475089aedc4f6b39d450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.861188 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fa71e5477644e0a0d7c40ecc55928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.866068 10607 tablet_service.cc:1467] Processing CreateTablet for tablet 6dd4a21086934bd9a64d74075ab41fbe (DEFAULT_TABLE table=default.Table_9a7b04bde68640deb63e6bdbd0f322d9 [id=7b85de4e62004d3bab802b1878b0722e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.866961 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dd4a21086934bd9a64d74075ab41fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.866569 10602 tablet_service.cc:1467] Processing CreateTablet for tablet f1276a6c043948529b7537081e34b257 (DEFAULT_TABLE table=default.Table_5940fa3078de423d855e54ba1af1597a [id=688e4024d52e40dd9e84aa7a08e8f33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.871776 11370 log.cc:1196] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bc53fcee3ed5480f85804f29c94c13f8
I20260811 06:16:55.873023 11117 tablet_service.cc:1467] Processing CreateTablet for tablet b8fefa0f4ed44b87825cc34f7ecafcbf (DEFAULT_TABLE table=default.Table_36da3a35575f40f6874a2055c8fc7faf [id=704fa680cec24a979014dbf21703f12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.873760 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7409453e6e34172870dbb9fb3c5ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.877432 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1276a6c043948529b7537081e34b257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.877995 11965 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:55.882969 11965 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: loading cluster ID for follower catalog manager: success
I20260811 06:16:55.883059 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.879108 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 45fc206d95a244e395d19328ae289485 (DEFAULT_TABLE table=default.Table_c37fb719a3e14506afcc1723b90ae323 [id=effd576838844300b8d7a4ee9a30a0d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:55.886253 11046 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:55.892007 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:55.892238 11106 tablet_service.cc:1467] Processing CreateTablet for tablet a8513fc279dc44f48c45e9dda40e5398 (DEFAULT_TABLE table=default.Table_3d5b15230b7540f29a0085d1018944fb [id=7bef46a8e8374c59b811e037981d997f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.896327 11370 ts_tablet_manager.cc:1939] T bc53fcee3ed5480f85804f29c94c13f8 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:55.897212 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fefa0f4ed44b87825cc34f7ecafcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.899411 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8513fc279dc44f48c45e9dda40e5398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.900604 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3fa8872f8b4a5e9b09da26f8bba721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.915542 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0278945378465ea9d61180b5f539dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.917789 11965 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: acquiring CA information for follower catalog manager: success
I20260811 06:16:55.920360 11368 ts_tablet_manager.cc:1918] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:55.932816 11965 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:16:55.953207 10886 tablet_service.cc:1467] Processing CreateTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.953897 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c5fa9633057485b917f117819d79398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:55.954262 10921 raft_consensus.cc:3037] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.958602 10921 raft_consensus.cc:2454] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:16:55.959723 11368 log.cc:1196] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/5d0530ec053f47df800cf2abf549b068
I20260811 06:16:55.960698 11368 ts_tablet_manager.cc:1939] T 5d0530ec053f47df800cf2abf549b068 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:55.962085 11362 tablet_bootstrap.cc:654] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:55.962553 11153 raft_consensus.cc:3037] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:55.961599 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 261) took 2271 ms. Trace:
I20260811 06:16:55.964744 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f3fa8872f8b4a5e9b09da26f8bba721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.965188 11371 ts_tablet_manager.cc:1939] T a378a6f20c564eb685b655a762b638ae P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:55.966825 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7d05ec3851467dbf1ef9319b1c9462 (DEFAULT_TABLE table=default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 [id=9fa071d93c0e4ff295700d3dd4f571ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.967634 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7d05ec3851467dbf1ef9319b1c9462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.972604 10606 tablet_service.cc:1467] Processing CreateTablet for tablet f6f682f675c344b6b5955e834f94091f (DEFAULT_TABLE table=default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.974077 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet e180cc2c38aa4a78897e264276e4c766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.963043 10867 tablet_service.cc:1467] Processing CreateTablet for tablet b7409453e6e34172870dbb9fb3c5ac44 (DEFAULT_TABLE table=default.Table_f07dfeeb52d64d08811e3b22d8861f62 [id=5ba59e9fdaef4ce389c3495e99dd16e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.976257 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7409453e6e34172870dbb9fb3c5ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.976452 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c5fa9633057485b917f117819d79398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:55.977034 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.978466 11105 tablet_service.cc:1467] Processing CreateTablet for tablet f1276a6c043948529b7537081e34b257 (DEFAULT_TABLE table=default.Table_5940fa3078de423d855e54ba1af1597a [id=688e4024d52e40dd9e84aa7a08e8f33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.979202 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1276a6c043948529b7537081e34b257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.964020 11368 rpcz_store.cc:276] 0811 06:16:53.690187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.695673 (+ 5486us) service_pool.cc:227] Handling call
0811 06:16:55.615879 (+1920206us) ts_tablet_manager.cc:1145] Deleting tablet 5d0530ec053f47df800cf2abf549b068
0811 06:16:55.615890 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.693706 (+ 77816us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.920239 (+226533us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.961468 (+ 41229us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1883964}
I20260811 06:16:55.980367 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 265) took 2266 ms. Trace:
I20260811 06:16:55.980556 11368 rpcz_store.cc:276] 0811 06:16:53.713870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.714145 (+ 275us) service_pool.cc:227] Handling call
0811 06:16:55.980128 (+2265983us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:16:55.980142 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.980288 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236681}
I20260811 06:16:55.981019 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 266) took 2152 ms. Trace:
I20260811 06:16:55.981178 11368 rpcz_store.cc:276] 0811 06:16:53.829024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.829097 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:55.980824 (+2151727us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:16:55.980836 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.980936 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2142890}
I20260811 06:16:55.981595 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 267) took 2021 ms. Trace:
I20260811 06:16:55.981779 11368 rpcz_store.cc:276] 0811 06:16:53.960291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.960548 (+ 257us) service_pool.cc:227] Handling call
0811 06:16:55.981424 (+2020876us) ts_tablet_manager.cc:1145] Deleting tablet 864c3bbf1e004579a4d0be809f83ca33
0811 06:16:55.981435 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.981533 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2020569}
I20260811 06:16:55.985803 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:55.986833 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f7214648b53e4bbca0fa28baa9d9aa85" } new_table_name: "default.Table_c8a55dfd94684d02b34a85dc6462c22f" modify_external_catalogs: true
I20260811 06:16:55.986654 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_02a8e77ed1244d0fad74b7f3de65575a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.987603 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a8e77ed1244d0fad74b7f3de65575a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.987478 10333 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_919cbb1f6a0e4d029dd90ae72e326608" } new_table_name: "default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8" modify_external_catalogs: true
I20260811 06:16:55.988425 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_364d018e0f034bee935a0a9ab1249f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:55.989053 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_364d018e0f034bee935a0a9ab1249f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.991618 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.993398 10555 leader_election.cc:302] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:55.994108 10620 tablet_service.cc:1467] Processing CreateTablet for tablet c2d9627d9f88466ba499aa175151f46a (DEFAULT_TABLE table=default.Table_28d17bc11c5147c785d93e4351465ea9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.994985 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f682f675c344b6b5955e834f94091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.992403 10623 tablet_service.cc:1467] Processing CreateTablet for tablet a33fc402d3084b458929d76b8fc22adb (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:55.999310 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.976220 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 169) took 4921 ms. Trace:
I20260811 06:16:56.001183 10626 tablet_service.cc:1467] Processing CreateTablet for tablet e7a707e7a6394e7a916001c0278a97bd (DEFAULT_TABLE table=default.Table_99ba61ba26854472b2956b8a4f61302b [id=0752fbfa69b24536ad4677ffe00d4032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.001637 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b79dca0f63044a20901e066a9c52d07f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.002364 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b79dca0f63044a20901e066a9c52d07f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:55.995950 10629 tablet_service.cc:1467] Processing CreateTablet for tablet a5008449b09e43fba758a7edab4a5c48 (DEFAULT_TABLE table=default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:55.996984 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 7821b08482ed49ea8e90155805a88ae5 (DEFAULT_TABLE table=default.Table_2688b67c9243454f9fe9823b4e9c1318 [id=2f00a94a6f874331b2e6fbce027260bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.005076 10318 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c37fb719a3e14506afcc1723b90ae323" } modify_external_catalogs: true
I20260811 06:16:56.005362 10318 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_c37fb719a3e14506afcc1723b90ae323" } modify_external_catalogs: true
I20260811 06:16:56.005952 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4485cb9a9e344ab5b4701e6fface0bba" } new_table_name: "default.Table_5370d92e09cb4fe4bcd141b66bc50f1e" modify_external_catalogs: true
I20260811 06:16:56.007261 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_236938dbaef84b3a93b4166937bfe2ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:55.996906 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0278945378465ea9d61180b5f539dd (DEFAULT_TABLE table=default.Table_54ba1e15029743bf966febe3c88a4a0d [id=9529d1977a76475089aedc4f6b39d450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.005934 10865 tablet_service.cc:1467] Processing CreateTablet for tablet eede55349694488b9899ec56a80c8d5b (DEFAULT_TABLE table=default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac [id=587929f897ff4559a8fc4f15e4346433]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.010376 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (DEFAULT_TABLE table=default.Table_d6b851b238cc407c91a9e72f70ac3b5a [id=0f76cb2b3f154167b4fa6a056cdf6fc3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.011081 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_236938dbaef84b3a93b4166937bfe2ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.012451 11370 rpcz_store.cc:276] 0811 06:16:51.049981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.050043 (+ 62us) service_pool.cc:227] Handling call
0811 06:16:55.345101 (+4295058us) ts_tablet_manager.cc:1145] Deleting tablet bc53fcee3ed5480f85804f29c94c13f8
0811 06:16:55.345117 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.357206 (+ 12089us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.736131 (+378925us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.970930 (+234799us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4263118}
I20260811 06:16:56.012919 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.014782 11116 tablet_service.cc:1467] Processing CreateTablet for tablet a33fc402d3084b458929d76b8fc22adb (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.015437 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (DEFAULT_TABLE table=default.Table_d6b851b238cc407c91a9e72f70ac3b5a [id=0f76cb2b3f154167b4fa6a056cdf6fc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.017515 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9fc91bec335145b987dbe074ac9af84c" } modify_external_catalogs: true
I20260811 06:16:56.017956 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9fc91bec335145b987dbe074ac9af84c" } modify_external_catalogs: true
I20260811 06:16:56.018194 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 03f2bd25baf347f7a1ba1b50459d8a97 (DEFAULT_TABLE table=default.Table_0a7428e94c2a44059b7d8c83ce698701 [id=30b28c4b8cdd49589b876d657179b2b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.023133 11121 tablet_service.cc:1467] Processing CreateTablet for tablet f6f682f675c344b6b5955e834f94091f (DEFAULT_TABLE table=default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.024317 11976 raft_consensus.cc:2781] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:56.024967 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0ba41638313a4d03b85b8ddac01ce6eb" } modify_external_catalogs: true
I20260811 06:16:56.025256 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0ba41638313a4d03b85b8ddac01ce6eb" } modify_external_catalogs: true
I20260811 06:16:56.026050 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7d05ec3851467dbf1ef9319b1c9462 (DEFAULT_TABLE table=default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 [id=9fa071d93c0e4ff295700d3dd4f571ed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.026468 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75094a86738d42fca39d57f8d90e8af9 consensus state has no leader
I20260811 06:16:56.027112 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.027788 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.030297 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7716cda181d444a99d69cbc9ade3269e consensus state has no leader
I20260811 06:16:56.030787 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8baf40088898402196034a63aa016e8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.031414 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8baf40088898402196034a63aa016e8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.032194 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 170) took 4960 ms. Trace:
I20260811 06:16:56.032649 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fc206d95a244e395d19328ae289485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.033200 10613 tablet_service.cc:1467] Processing CreateTablet for tablet c2527862e75b42aa9091456b0f5f994e (DEFAULT_TABLE table=default.Table_ee6cc44965e64249b5e0bf8d17d39099 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.033556 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9097f9641b7b4a29bb9c6dc0d3346561" } new_table_name: "default.Table_02fb58052e2d4a0586805d9fa2c0cbc3" modify_external_catalogs: true
I20260811 06:16:56.034230 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 6dd4a21086934bd9a64d74075ab41fbe (DEFAULT_TABLE table=default.Table_9a7b04bde68640deb63e6bdbd0f322d9 [id=7b85de4e62004d3bab802b1878b0722e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.034901 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7d05ec3851467dbf1ef9319b1c9462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.037359 11096 tablet_service.cc:1467] Processing CreateTablet for tablet c2d9627d9f88466ba499aa175151f46a (DEFAULT_TABLE table=default.Table_28d17bc11c5147c785d93e4351465ea9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.037518 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 316) took 1018 ms. Trace:
I20260811 06:16:56.038143 11116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33fc402d3084b458929d76b8fc22adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.045938 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 03f2bd25baf347f7a1ba1b50459d8a97 (DEFAULT_TABLE table=default.Table_0a7428e94c2a44059b7d8c83ce698701 [id=30b28c4b8cdd49589b876d657179b2b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.047081 10333 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e721083b8b2428bbea6b9e87a4a6e14 consensus state has no leader
I20260811 06:16:56.047889 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f17b738cb4a84bcfbda964f7e432d1d5" } modify_external_catalogs: true
I20260811 06:16:56.048019 11103 tablet_service.cc:1467] Processing CreateTablet for tablet cce9f8fd074348ffb60abcc086ac0519 (DEFAULT_TABLE table=default.Table_ab1832782184476f9e838bca820e45e5 [id=395d4cbde0114d879ead277a47184ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.048229 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f17b738cb4a84bcfbda964f7e432d1d5" } modify_external_catalogs: true
I20260811 06:16:56.048877 11119 tablet_service.cc:1467] Processing CreateTablet for tablet c2527862e75b42aa9091456b0f5f994e (DEFAULT_TABLE table=default.Table_ee6cc44965e64249b5e0bf8d17d39099 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.049475 11101 tablet_service.cc:1467] Processing CreateTablet for tablet e7a707e7a6394e7a916001c0278a97bd (DEFAULT_TABLE table=default.Table_99ba61ba26854472b2956b8a4f61302b [id=0752fbfa69b24536ad4677ffe00d4032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.049918 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.050694 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.037839 10634 tablet_service.cc:1467] Processing CreateTablet for tablet cce9f8fd074348ffb60abcc086ac0519 (DEFAULT_TABLE table=default.Table_ab1832782184476f9e838bca820e45e5 [id=395d4cbde0114d879ead277a47184ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.052867 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2ae1a5b3e72c4d80874cb4b7ea8b3329"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.053201 11371 rpcz_store.cc:276] 0811 06:16:54.975045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.980724 (+ 5679us) service_pool.cc:227] Handling call
0811 06:16:55.496105 (+515381us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:16:55.496119 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.750224 (+254105us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.815834 (+ 65610us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:55.993186 (+177352us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":499588}
W20260811 06:16:56.053623 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ae1a5b3e72c4d80874cb4b7ea8b3329 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.054373 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dd4a21086934bd9a64d74075ab41fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.055356 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e978aa9dd9f64a6396130a9ef90b76ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.055995 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e978aa9dd9f64a6396130a9ef90b76ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.056514 11118 tablet_service.cc:1467] Processing CreateTablet for tablet a5008449b09e43fba758a7edab4a5c48 (DEFAULT_TABLE table=default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.050837 11370 rpcz_store.cc:276] 0811 06:16:51.069320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.069382 (+ 62us) service_pool.cc:227] Handling call
0811 06:16:56.012813 (+4943431us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:16:56.012827 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.029367 (+ 16540us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925677}
I20260811 06:16:56.059587 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 2be78c7877934f438ac52e8bf82d145b (DEFAULT_TABLE table=default.Table_53cb23e4e85049898ced77eaa6b01e32 [id=7618b959c1824d0882b7e71e27533462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.056393 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 2be78c7877934f438ac52e8bf82d145b (DEFAULT_TABLE table=default.Table_53cb23e4e85049898ced77eaa6b01e32 [id=7618b959c1824d0882b7e71e27533462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.060235 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d9627d9f88466ba499aa175151f46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.058161 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.051904 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 511f08c3d4d642368805b6a89743b367 (DEFAULT_TABLE table=default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 [id=54ed6f7aa1874e0897b2b8583bc6f57d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.062603 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0391df1c64954f66a3987aba9257ca4b consensus state has no leader
I20260811 06:16:56.062625 12018 raft_consensus.cc:482] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.063166 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bc53fcee3ed5480f85804f29c94c13f8 (table default.Table_9dd290af671e42d6a5d6545e9651028b [id=7beb37c0e7be4e7fb7ab33339f4d5ad2]) successfully deleted
I20260811 06:16:56.065783 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a707e7a6394e7a916001c0278a97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.062947 12018 raft_consensus.cc:504] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:56.068434 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 187) took 4620 ms. Trace:
I20260811 06:16:56.068681 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.068656 11370 rpcz_store.cc:276] 0811 06:16:51.441226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.441798 (+ 572us) service_pool.cc:227] Handling call
0811 06:16:56.058956 (+4617158us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:16:56.058969 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.061164 (+ 2195us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4564620}
W20260811 06:16:56.070936 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3250276181a24e58a2db92376b7520e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3250276181a24e58a2db92376b7520e7 already in progress: creating tablet
I20260811 06:16:56.071821 11976 raft_consensus.cc:686] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:56.072638 11365 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:56.075459 11365 ts_tablet_manager.cc:1397] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.547s user 0.016s sys 0.034s
I20260811 06:16:56.076602 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864c3bbf1e004579a4d0be809f83ca33" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:56.077178 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5008449b09e43fba758a7edab4a5c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.079416 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 318) took 1007 ms. Trace:
I20260811 06:16:56.079583 11371 rpcz_store.cc:276] 0811 06:16:55.059146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.059304 (+ 158us) service_pool.cc:227] Handling call
0811 06:16:56.053589 (+994285us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:16:56.060541 (+ 6952us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.066992 (+ 6451us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":990760}
I20260811 06:16:56.080423 12018 leader_election.cc:288] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:56.082432 11365 raft_consensus.cc:348] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.083380 11976 consensus_queue.cc:237] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.089452 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a378a6f20c564eb685b655a762b638ae (table default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]) successfully deleted
I20260811 06:16:56.090723 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.090940 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce9f8fd074348ffb60abcc086ac0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.091252 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be78c7877934f438ac52e8bf82d145b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.092278 10555 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.092835 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 319) took 1019 ms. Trace:
W20260811 06:16:56.095062 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 97b348d30dc44fa383a27d9097c2e598 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97b348d30dc44fa383a27d9097c2e598 already in progress: creating tablet
I20260811 06:16:56.101962 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2527862e75b42aa9091456b0f5f994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.105967 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce9f8fd074348ffb60abcc086ac0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.106436 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7821b08482ed49ea8e90155805a88ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.109997 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f2bd25baf347f7a1ba1b50459d8a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.109906 10860 tablet_service.cc:1467] Processing CreateTablet for tablet a8513fc279dc44f48c45e9dda40e5398 (DEFAULT_TABLE table=default.Table_3d5b15230b7540f29a0085d1018944fb [id=7bef46a8e8374c59b811e037981d997f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.111076 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be78c7877934f438ac52e8bf82d145b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.111357 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8513fc279dc44f48c45e9dda40e5398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.112308 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f682f675c344b6b5955e834f94091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.115154 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d9627d9f88466ba499aa175151f46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.116045 10881 tablet_service.cc:1467] Processing CreateTablet for tablet b8fefa0f4ed44b87825cc34f7ecafcbf (DEFAULT_TABLE table=default.Table_36da3a35575f40f6874a2055c8fc7faf [id=704fa680cec24a979014dbf21703f12b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.117772 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fefa0f4ed44b87825cc34f7ecafcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.097900 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 511f08c3d4d642368805b6a89743b367 (DEFAULT_TABLE table=default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 [id=54ed6f7aa1874e0897b2b8583bc6f57d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.121881 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 188) took 4609 ms. Trace:
I20260811 06:16:56.122001 10322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9" } modify_external_catalogs: true
I20260811 06:16:56.122376 10322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9" } modify_external_catalogs: true
I20260811 06:16:56.124154 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ee6cc44965e64249b5e0bf8d17d39099" } new_table_name: "default.Table_ac3235af8d1f42d29a220ec551aa448a" modify_external_catalogs: true
I20260811 06:16:56.126879 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c00b6bdfc8ac4b5db81de9f614fcf213" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:56.127097 10921 raft_consensus.cc:3037] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:56.133409 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511f08c3d4d642368805b6a89743b367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.118901 11371 rpcz_store.cc:276] 0811 06:16:55.060384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.062124 (+ 1740us) service_pool.cc:227] Handling call
0811 06:16:56.079993 (+1017869us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:16:56.080011 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.080157 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016430}
W20260811 06:16:56.141152 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2527862e75b42aa9091456b0f5f994e consensus state has no leader
I20260811 06:16:56.143328 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33fc402d3084b458929d76b8fc22adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.143566 10322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet e329d808c59c4f66bbc515d751255e96
W20260811 06:16:56.144057 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b0d203f652b24b4897e62fc8c03d32df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0d203f652b24b4897e62fc8c03d32df already in progress: creating tablet
I20260811 06:16:56.140329 11370 rpcz_store.cc:276] 0811 06:16:51.463689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.463762 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:56.069124 (+4605362us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:16:56.069137 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.073211 (+ 4074us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4553414}
I20260811 06:16:56.145738 11365 raft_consensus.cc:374] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:56.146315 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f243c792a634abf83484aef820dbb48 already in progress: creating tablet
I20260811 06:16:56.156404 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.156472 11371 tablet_replica.cc:330] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:56.157305 11365 raft_consensus.cc:729] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:56.165990 10921 raft_consensus.cc:2454] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:56.167613 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.170114 11365 consensus_queue.cc:260] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.171182 11365 ts_tablet_manager.cc:1428] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.095s user 0.003s sys 0.001s
I20260811 06:16:56.160980 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.172359 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511f08c3d4d642368805b6a89743b367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:55.982349 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 268) took 2021 ms. Trace:
I20260811 06:16:56.173161 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.175606 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 191) took 4622 ms. Trace:
I20260811 06:16:56.177611 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet e180cc2c38aa4a78897e264276e4c766 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.178035 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eede55349694488b9899ec56a80c8d5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.181149 11047 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:56.182008 11371 raft_consensus.cc:2229] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:56.182070 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.185760 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a707e7a6394e7a916001c0278a97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.188437 11365 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:56.190302 10855 tablet_service.cc:1467] Processing CreateTablet for tablet f1276a6c043948529b7537081e34b257 (DEFAULT_TABLE table=default.Table_5940fa3078de423d855e54ba1af1597a [id=688e4024d52e40dd9e84aa7a08e8f33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.191236 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f2bd25baf347f7a1ba1b50459d8a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.193773 11368 rpcz_store.cc:276] 0811 06:16:53.960495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.960885 (+ 390us) service_pool.cc:227] Handling call
0811 06:16:55.982045 (+2021160us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:16:55.982055 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:55.982184 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2020883}
I20260811 06:16:56.192237 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 45fc206d95a244e395d19328ae289485 (DEFAULT_TABLE table=default.Table_c37fb719a3e14506afcc1723b90ae323 [id=effd576838844300b8d7a4ee9a30a0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.195425 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a0278945378465ea9d61180b5f539dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.196120 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.201097 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2527862e75b42aa9091456b0f5f994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.198113 11370 rpcz_store.cc:276] 0811 06:16:51.525873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.526360 (+ 487us) service_pool.cc:227] Handling call
0811 06:16:56.146032 (+4619672us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:16:56.146045 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.147919 (+ 1874us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4598066}
I20260811 06:16:56.202438 11371 pending_rounds.cc:62] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Trying to abort 1 pending ops.
W20260811 06:16:56.202644 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e873e2f7b3d34988856b3be044de1ed7 already in progress: creating tablet
I20260811 06:16:56.202652 11371 pending_rounds.cc:68] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213249891397632 op_type: NO_OP noop_request { }
W20260811 06:16:56.208671 10564 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.211323 11047 leader_election.cc:302] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:56.212713 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1276a6c043948529b7537081e34b257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.189419 10884 tablet_service.cc:1467] Processing CreateTablet for tablet f6f682f675c344b6b5955e834f94091f (DEFAULT_TABLE table=default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.213538 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f682f675c344b6b5955e834f94091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.216763 11371 raft_consensus.cc:2866] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:56.218315 10871 tablet_service.cc:1467] Processing CreateTablet for tablet c2d9627d9f88466ba499aa175151f46a (DEFAULT_TABLE table=default.Table_28d17bc11c5147c785d93e4351465ea9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.218519 11163 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.635s user 0.020s sys 0.025s
I20260811 06:16:56.219228 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fc206d95a244e395d19328ae289485. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.219687 10564 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.221447 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2d9627d9f88466ba499aa175151f46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.222719 11370 tablet_replica.cc:330] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:56.224921 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:56.226224 12036 consensus_queue.cc:1159] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24d29113b2454d9c93e23db3e3dac801" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260811 06:16:56.226897 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.227278 11766 consensus_queue.cc:1035] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260811 06:16:56.227947 11046 leader_election.cc:341] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c00b6bdfc8ac4b5db81de9f614fcf213
W20260811 06:16:56.228601 11046 leader_election.cc:341] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5d0530ec053f47df800cf2abf549b068
I20260811 06:16:56.228804 11046 leader_election.cc:302] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:56.228878 11371 raft_consensus.cc:2258] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:56.229228 11046 consensus_peers.cc:487] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1d6641dd44340889879d3b92018b3f0. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:56.230058 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5008449b09e43fba758a7edab4a5c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.230116 11961 raft_consensus.cc:2726] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.230468 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864c3bbf1e004579a4d0be809f83ca33" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:56.232205 12021 raft_consensus.cc:2781] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:56.232620 12021 raft_consensus.cc:686] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:56.237440 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 6dd4a21086934bd9a64d74075ab41fbe (DEFAULT_TABLE table=default.Table_9a7b04bde68640deb63e6bdbd0f322d9 [id=7b85de4e62004d3bab802b1878b0722e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.237708 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 269) took 2222 ms. Trace:
I20260811 06:16:56.237947 11368 rpcz_store.cc:276] 0811 06:16:53.982010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.982066 (+ 56us) service_pool.cc:227] Handling call
0811 06:16:56.194383 (+2212317us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:16:56.194419 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.204873 (+ 10454us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2211296}
I20260811 06:16:56.238504 11368 tablet_replica.cc:330] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:56.238623 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dd4a21086934bd9a64d74075ab41fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.238822 11368 raft_consensus.cc:2229] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:56.244745 11370 raft_consensus.cc:2229] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:56.245802 11371 ts_tablet_manager.cc:1905] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:56.246323 11368 pending_rounds.cc:62] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
W20260811 06:16:56.246392 11163 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.654s user 0.020s sys 0.026s
I20260811 06:16:56.246950 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7d05ec3851467dbf1ef9319b1c9462 (DEFAULT_TABLE table=default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 [id=9fa071d93c0e4ff295700d3dd4f571ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.247480 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7d05ec3851467dbf1ef9319b1c9462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.256923 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e1d6c05437784e07a5b7deefec230ae5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.257747 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1d6c05437784e07a5b7deefec230ae5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.260567 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3d62247a29ac401fb5d29f5a4ba2dd72" } new_table_name: "default.Table_4e15808f30a44360b496919b3bc6c412" modify_external_catalogs: true
I20260811 06:16:56.263511 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_0cb7dbf7c4d74e18abf6d9a5eba57e77" } new_table_name: "default.Table_80c64d7a49ca45e3bfad0438b70ed13d" modify_external_catalogs: true
I20260811 06:16:56.265278 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ae32a31bc8f64e96a549037c0d65f64e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.266072 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae32a31bc8f64e96a549037c0d65f64e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.268003 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_684e178eb9f141b7961759410506cbcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.269421 10853 tablet_service.cc:1467] Processing CreateTablet for tablet a33fc402d3084b458929d76b8fc22adb (DEFAULT_TABLE table=default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.270597 11766 raft_consensus.cc:482] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:56.268657 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_684e178eb9f141b7961759410506cbcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.281421 11368 pending_rounds.cc:68] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213245819498496 op_type: NO_OP noop_request { }
I20260811 06:16:56.271399 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_7ab95b8d63814510887b9a7442b5e329"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.282226 11047 consensus_peers.cc:487] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1d6641dd44340889879d3b92018b3f0. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:16:56.282891 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab95b8d63814510887b9a7442b5e329 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.287031 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10211a4e95464e9e9e2b2e70d23086a5 consensus state has no leader
I20260811 06:16:56.287472 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1d79ed1149e94fccb8e01b4aa32c53f8" } new_table_name: "default.Table_2736666c0c1e402cb4179d3d3c5c39f8" modify_external_catalogs: true
I20260811 06:16:56.288249 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 03f2bd25baf347f7a1ba1b50459d8a97 (DEFAULT_TABLE table=default.Table_0a7428e94c2a44059b7d8c83ce698701 [id=30b28c4b8cdd49589b876d657179b2b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.289132 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14a36a644dc4491dad838ce4e19793ab consensus state has no leader
I20260811 06:16:56.289614 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_631427441c8845c392c4e107eaca71d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.290259 10866 tablet_service.cc:1467] Processing CreateTablet for tablet cce9f8fd074348ffb60abcc086ac0519 (DEFAULT_TABLE table=default.Table_ab1832782184476f9e838bca820e45e5 [id=395d4cbde0114d879ead277a47184ce6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.290378 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_631427441c8845c392c4e107eaca71d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.292477 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.292980 10882 tablet_service.cc:1467] Processing CreateTablet for tablet c2527862e75b42aa9091456b0f5f994e (DEFAULT_TABLE table=default.Table_ee6cc44965e64249b5e0bf8d17d39099 [id=3b92a2f628794cb3827f5015816baa11]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.293169 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.294050 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (DEFAULT_TABLE table=default.Table_d6b851b238cc407c91a9e72f70ac3b5a [id=0f76cb2b3f154167b4fa6a056cdf6fc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.311065 11368 raft_consensus.cc:2866] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:56.311691 11368 raft_consensus.cc:2258] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:56.314445 11368 ts_tablet_manager.cc:1905] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:56.318542 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_695c2233e5f54b8da16c476efb46a8fc" } new_table_name: "default.Table_ebcbe00e3a0340d2a2911d4a5c73c393" modify_external_catalogs: true
I20260811 06:16:56.319451 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a33fc402d3084b458929d76b8fc22adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.322700 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_aafb83d805da497abbe1d6787dcfab64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.324604 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aafb83d805da497abbe1d6787dcfab64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.327667 11976 raft_consensus.cc:482] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.327967 11976 raft_consensus.cc:504] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:56.332998 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.336050 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 32407c8872464da2b1470a8ae21c86fd (DEFAULT_TABLE table=default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.342667 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03f2bd25baf347f7a1ba1b50459d8a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.342873 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.343820 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2527862e75b42aa9091456b0f5f994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.344144 11976 leader_election.cc:288] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:56.344421 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcc463affbb4154877624aec28435bc (DEFAULT_TABLE table=default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.345867 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cce9f8fd074348ffb60abcc086ac0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.345884 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32407c8872464da2b1470a8ae21c86fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.346619 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f48707b4fb746f49eaaf91b5b81e814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.347003 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcc463affbb4154877624aec28435bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.352583 10564 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.353050 10564 leader_election.cc:302] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:56.353519 11976 raft_consensus.cc:2726] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.355600 11365 tablet_bootstrap.cc:654] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.354442 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:56.361387 10555 leader_election.cc:341] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.373808 11370 pending_rounds.cc:62] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:56.373983 11370 pending_rounds.cc:68] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213235598532608 op_type: NO_OP noop_request { }
I20260811 06:16:56.374300 11370 raft_consensus.cc:2866] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:56.374517 11370 raft_consensus.cc:2258] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:56.375465 11370 ts_tablet_manager.cc:1905] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:56.379115 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 47738us
I20260811 06:16:56.379791 11361 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:56.293939 11766 raft_consensus.cc:504] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:56.386477 11046 consensus_peers.cc:487] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ff1ad74f2034ed9b24c9712bae14cd3. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:16:56.386722 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 57495.5us
I20260811 06:16:56.390304 11361 ts_tablet_manager.cc:1397] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.896s user 0.010s sys 0.023s
I20260811 06:16:56.391417 11766 leader_election.cc:288] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:56.391533 11361 raft_consensus.cc:348] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.391970 11361 raft_consensus.cc:374] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:56.392141 11361 raft_consensus.cc:729] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:56.392552 11361 consensus_queue.cc:260] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.393373 11361 ts_tablet_manager.cc:1428] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:56.395404 10858 tablet_service.cc:1467] Processing CreateTablet for tablet e7a707e7a6394e7a916001c0278a97bd (DEFAULT_TABLE table=default.Table_99ba61ba26854472b2956b8a4f61302b [id=0752fbfa69b24536ad4677ffe00d4032]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.397953 11047 consensus_peers.cc:487] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ff1ad74f2034ed9b24c9712bae14cd3. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:56.401574 11371 ts_tablet_manager.cc:1918] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:56.403038 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:56.400679 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 511f08c3d4d642368805b6a89743b367 (DEFAULT_TABLE table=default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 [id=54ed6f7aa1874e0897b2b8583bc6f57d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.406432 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 2be78c7877934f438ac52e8bf82d145b (DEFAULT_TABLE table=default.Table_53cb23e4e85049898ced77eaa6b01e32 [id=7618b959c1824d0882b7e71e27533462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.406606 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.387471 12021 consensus_queue.cc:237] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.408754 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f48707b4fb746f49eaaf91b5b81e814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.410912 11361 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:56.408761 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3025339a6c9e4e07bba4104006206bb8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:56.412679 10810 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:56.401861 11976 raft_consensus.cc:482] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.415561 11976 raft_consensus.cc:504] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.416159 10886 tablet_service.cc:1467] Processing CreateTablet for tablet a5008449b09e43fba758a7edab4a5c48 (DEFAULT_TABLE table=default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.416497 11976 leader_election.cc:288] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:56.417356 11371 log.cc:1196] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/9c5fa9633057485b917f117819d79398
I20260811 06:16:56.418159 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a707e7a6394e7a916001c0278a97bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.420830 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1a6ec07940654e19aa7ab999ba7462cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.421625 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a6ec07940654e19aa7ab999ba7462cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.425987 10310 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.125:35327, user_credentials={real_user=slave}} blocked reactor thread for 96503.1us
I20260811 06:16:56.427938 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 32407c8872464da2b1470a8ae21c86fd (DEFAULT_TABLE table=default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.428318 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd6584701c23406e83122bd2493b7972 consensus state has no leader
I20260811 06:16:56.430578 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcc463affbb4154877624aec28435bc (DEFAULT_TABLE table=default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.439258 10813 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.439500 10813 leader_election.cc:302] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:56.439404 10332 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_c5d51bfe8d4f4ac084ad0692d3c334be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.440469 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2be78c7877934f438ac52e8bf82d145b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.440821 10332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5d51bfe8d4f4ac084ad0692d3c334be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.442090 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 59c4e76ecde14d0a86fedc84815e78a7
I20260811 06:16:56.445429 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1ea175c323534584b69d9595c09821d7" } new_table_name: "default.Table_690e8cf28c9940afa78b2d3e003d35de" modify_external_catalogs: true
I20260811 06:16:56.448273 11361 tablet_bootstrap.cc:654] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.450230 11766 raft_consensus.cc:2726] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.450680 11362 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:56.452814 11362 ts_tablet_manager.cc:1397] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.773s user 0.007s sys 0.008s
I20260811 06:16:56.454272 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.454773 10330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2ae1a5b3e72c4d80874cb4b7ea8b3329" } modify_external_catalogs: true
I20260811 06:16:56.456692 10318 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 45fc206d95a244e395d19328ae289485
I20260811 06:16:56.456661 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.438166 11128 tablet_service.cc:1467] Processing CreateTablet for tablet e00a72f178f74ca59cc073fe78c99373 (DEFAULT_TABLE table=default.Table_3b5a8830887248dd84904417be8ddd49 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.462459 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcc463affbb4154877624aec28435bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.462728 10330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2ae1a5b3e72c4d80874cb4b7ea8b3329" } modify_external_catalogs: true
I20260811 06:16:56.462988 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b28c0f67c5f24e09a49263620f5d61f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.464926 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32407c8872464da2b1470a8ae21c86fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.465090 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0d203f652b24b4897e62fc8c03d32df" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:56.467089 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b28c0f67c5f24e09a49263620f5d61f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.467418 10307 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 14a36a644dc4491dad838ce4e19793ab consensus state has no leader
I20260811 06:16:56.468262 11117 tablet_service.cc:1467] Processing CreateTablet for tablet a2f8100e334a4fd1b3c9b059e3bdef3e (DEFAULT_TABLE table=default.Table_e37a4f07d9434d77a1a6ec7dfe022355 [id=1b9f2c3cb4854a7184b662f5ff2bad55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.472163 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.472190 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00a72f178f74ca59cc073fe78c99373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.476346 11362 raft_consensus.cc:348] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:56.484292 12053 log.cc:924] Time spent T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260811 06:16:56.484436 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f8100e334a4fd1b3c9b059e3bdef3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.491317 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ca0f53aec50841d4bf0e1f115ac50628" } new_table_name: "default.Table_b3e57e08da2a440ea87dba0f379d1b47" modify_external_catalogs: true
I20260811 06:16:56.496276 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet a67daf4bdf45464b916905f432f0ec9c
I20260811 06:16:56.497450 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet ae1118c96cff4ea387f3d0ee94bef79b
W20260811 06:16:56.498642 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cec2c3e143a4834a07aef7a31340d9c consensus state has no leader
I20260811 06:16:56.498174 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.503151 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6592e2a580a042a1854bdf75d49a8851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.504031 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6592e2a580a042a1854bdf75d49a8851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.505740 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.506690 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.508740 10328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_bed0d789166c45eea07dc86bda2e8497" } new_table_name: "default.Table_28705c2c84984e3cb45b2c26538fb2fb" modify_external_catalogs: true
I20260811 06:16:56.510458 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:56.510607 10330 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0c073a1ffcdc467a99c4eb18e8b9f96b
I20260811 06:16:56.521826 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511f08c3d4d642368805b6a89743b367. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.522650 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6063a34ee55495584ed5623215a130f consensus state has no leader
I20260811 06:16:56.523449 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_af483278f0004121a846ca38bec9d8d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.524292 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af483278f0004121a846ca38bec9d8d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.525761 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_4417703678a641a18717b8d5d7b2e294"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.526358 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4417703678a641a18717b8d5d7b2e294 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.530560 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 consensus state has no leader
I20260811 06:16:56.546855 11362 raft_consensus.cc:374] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:56.547101 11362 raft_consensus.cc:729] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
W20260811 06:16:56.558133 10328 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8123e24a8bbf4bd6a9344a83ca2163fc consensus state has no leader
I20260811 06:16:56.567605 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.580273 10882 tablet_service.cc:1467] Processing CreateTablet for tablet e00a72f178f74ca59cc073fe78c99373 (DEFAULT_TABLE table=default.Table_3b5a8830887248dd84904417be8ddd49 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.582085 11370 ts_tablet_manager.cc:1918] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:56.585057 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcc463affbb4154877624aec28435bc (DEFAULT_TABLE table=default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.582790 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0d203f652b24b4897e62fc8c03d32df" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:56.587036 10886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5008449b09e43fba758a7edab4a5c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.590643 11371 ts_tablet_manager.cc:1939] T 9c5fa9633057485b917f117819d79398 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:56.591193 10564 leader_election.cc:341] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.591091 11362 consensus_queue.cc:260] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:56.591480 10555 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.591854 11362 ts_tablet_manager.cc:1428] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.139s user 0.003s sys 0.000s
I20260811 06:16:56.593761 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f48707b4fb746f49eaaf91b5b81e814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.594646 10629 tablet_service.cc:1467] Processing CreateTablet for tablet a2f8100e334a4fd1b3c9b059e3bdef3e (DEFAULT_TABLE table=default.Table_e37a4f07d9434d77a1a6ec7dfe022355 [id=1b9f2c3cb4854a7184b662f5ff2bad55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.595439 10564 leader_election.cc:302] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:56.596199 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 320) took 1252 ms. Trace:
I20260811 06:16:56.596297 10620 tablet_service.cc:1467] Processing CreateTablet for tablet e00a72f178f74ca59cc073fe78c99373 (DEFAULT_TABLE table=default.Table_3b5a8830887248dd84904417be8ddd49 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.598026 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f8100e334a4fd1b3c9b059e3bdef3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.601960 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.606283 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.607251 11976 raft_consensus.cc:2726] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.607812 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.607911 11362 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:56.608093 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00a72f178f74ca59cc073fe78c99373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.609005 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcc463affbb4154877624aec28435bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.613338 10865 tablet_service.cc:1467] Processing CreateTablet for tablet 32407c8872464da2b1470a8ae21c86fd (DEFAULT_TABLE table=default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.613533 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 176952us
W20260811 06:16:56.614146 10564 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.614598 10882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e00a72f178f74ca59cc073fe78c99373. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.618355 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ab32f96671984766a54b5ee904c465f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab32f96671984766a54b5ee904c465f7 already in progress: creating tablet
I20260811 06:16:56.621070 10564 leader_election.cc:302] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:56.625320 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.609689 11371 rpcz_store.cc:276] 0811 06:16:55.343204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.343285 (+ 81us) service_pool.cc:227] Handling call
0811 06:16:56.141275 (+797990us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:16:56.141290 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.189992 (+ 48702us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x6150000f71a4. stack: 00007fa64ff3a66e 00007fa64ff3a430 00007fa64efc15ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fa65b47604d 00007fa65c71a5ec 00007fa65f0a92e6 00007fa65f0db404 00007fa65f0bc870 00007fa65f0bc5fd 00000000009edb7c 00007fa64ff80344 00007fa64ff8391b 00007fa64ff83798
0811 06:16:56.368956 (+178964us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.401361 (+ 32405us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.595291 (+193930us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10437376,"tablet-delete.queue_time_us":797481}
I20260811 06:16:56.626804 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 9c5fa9633057485b917f117819d79398 (table default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]) successfully deleted
I20260811 06:16:56.628274 11976 raft_consensus.cc:2726] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.633124 11370 log.cc:1196] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/94d04b025b1b45009260ddd9f1b0aabb
I20260811 06:16:56.634895 10321 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6580760971534d17ba27adcc6f5cd336" } new_table_name: "default.Table_c096b132248d4375b8754794d46d6030" modify_external_catalogs: true
I20260811 06:16:56.636353 11370 ts_tablet_manager.cc:1939] T 94d04b025b1b45009260ddd9f1b0aabb P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:56.639113 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_dc4f0ade100c4b05b31b548c1abe130e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.639932 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc4f0ade100c4b05b31b548c1abe130e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.642535 10331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_57e6d74041d748be8601b9304ae7f2c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.643419 10331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57e6d74041d748be8601b9304ae7f2c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.644256 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6ae50c6bd40447b191f2b98dc7c35552" } modify_external_catalogs: true
I20260811 06:16:56.644896 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_6ae50c6bd40447b191f2b98dc7c35552" } modify_external_catalogs: true
I20260811 06:16:56.646226 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 5d0530ec053f47df800cf2abf549b068 (table default.Table_79a06e688c7f4536bb78d323d80892cf [id=4bee63f6d83346efb4617155a5706f5b]) successfully deleted
W20260811 06:16:56.646732 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dab2b8209e5401c84a187882ef21e08 already in progress: creating tablet
W20260811 06:16:56.647099 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2875318863584e659e2b76ad2a72ca45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2875318863584e659e2b76ad2a72ca45 already in progress: creating tablet
W20260811 06:16:56.647425 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 864c3bbf1e004579a4d0be809f83ca33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 864c3bbf1e004579a4d0be809f83ca33 already in progress: creating tablet
W20260811 06:16:56.647858 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6c706bf0455341a0a953d937f9778b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c706bf0455341a0a953d937f9778b5f already in progress: creating tablet
W20260811 06:16:56.648376 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
I20260811 06:16:56.650822 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 337) took 1193 ms. Trace:
I20260811 06:16:56.654054 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.654593 10859 tablet_service.cc:1467] Processing CreateTablet for tablet a2f8100e334a4fd1b3c9b059e3bdef3e (DEFAULT_TABLE table=default.Table_e37a4f07d9434d77a1a6ec7dfe022355 [id=1b9f2c3cb4854a7184b662f5ff2bad55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.655345 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.659641 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1fd91288bb3747f69cb7219edb4271cb" } modify_external_catalogs: true
I20260811 06:16:56.659735 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.660173 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1fd91288bb3747f69cb7219edb4271cb" } modify_external_catalogs: true
I20260811 06:16:56.660722 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.668203 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32407c8872464da2b1470a8ae21c86fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.668889 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f8100e334a4fd1b3c9b059e3bdef3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:56.671135 10321 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd53ac72e2e3450a9f777316742653bc consensus state has no leader
I20260811 06:16:56.672917 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 190) took 5165 ms. Trace:
I20260811 06:16:56.672778 11371 rpcz_store.cc:276] 0811 06:16:55.440816 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.454328 (+ 13512us) service_pool.cc:227] Handling call
0811 06:16:56.626325 (+1171997us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:16:56.626342 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.634058 (+ 7716us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168828}
I20260811 06:16:56.673161 11370 rpcz_store.cc:276] 0811 06:16:51.472021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.472123 (+ 102us) service_pool.cc:227] Handling call
0811 06:16:56.202147 (+4730024us) ts_tablet_manager.cc:1145] Deleting tablet 94d04b025b1b45009260ddd9f1b0aabb
0811 06:16:56.202161 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.497320 (+295159us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.581662 (+ 84342us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.637550 (+ 55888us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4650176}
W20260811 06:16:56.673805 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 37e73b8798b2455baf642abc532a5d8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37e73b8798b2455baf642abc532a5d8c already in progress: creating tablet
I20260811 06:16:56.673929 10311 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 94d04b025b1b45009260ddd9f1b0aabb (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
I20260811 06:16:56.685055 11361 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:56.685320 11361 ts_tablet_manager.cc:1397] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.292s user 0.035s sys 0.043s
I20260811 06:16:56.686524 11361 raft_consensus.cc:348] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.686914 11361 raft_consensus.cc:374] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:56.687129 11361 raft_consensus.cc:729] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:56.687484 11361 consensus_queue.cc:260] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.688545 12021 raft_consensus.cc:482] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.688851 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 338) took 1236 ms. Trace:
I20260811 06:16:56.688766 12021 raft_consensus.cc:504] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.689553 12021 leader_election.cc:288] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:56.689105 11371 rpcz_store.cc:276] 0811 06:16:55.440996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.454348 (+ 13352us) service_pool.cc:227] Handling call
0811 06:16:56.673344 (+1218996us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:16:56.673357 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.677362 (+ 4005us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1215068}
I20260811 06:16:56.690800 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 335) took 1250 ms. Trace:
I20260811 06:16:56.691074 11371 rpcz_store.cc:276] 0811 06:16:55.440395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.454245 (+ 13850us) service_pool.cc:227] Handling call
0811 06:16:56.690421 (+1236176us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:16:56.690435 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.690604 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1232026}
I20260811 06:16:56.691489 11361 ts_tablet_manager.cc:1428] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260811 06:16:56.691951 11361 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:16:56.693136 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 already in progress: creating tablet
W20260811 06:16:56.693797 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
I20260811 06:16:56.692188 11365 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:56.694141 11365 ts_tablet_manager.cc:1397] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.523s user 0.015s sys 0.009s
I20260811 06:16:56.695147 11361 tablet_bootstrap.cc:654] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.695453 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c62cbef937a46dfbc4dbf934e887139" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:56.696405 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 339) took 1235 ms. Trace:
I20260811 06:16:56.696585 11371 rpcz_store.cc:276] 0811 06:16:55.457347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.457397 (+ 50us) service_pool.cc:227] Handling call
0811 06:16:56.692670 (+1235273us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:16:56.692681 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.692838 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233692}
W20260811 06:16:56.696969 11047 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:56.698544 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:16:56.698627 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2b0908c490b34de1b667987b39b6b8cc" } modify_external_catalogs: true
I20260811 06:16:56.698977 10331 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2b0908c490b34de1b667987b39b6b8cc" } modify_external_catalogs: true
I20260811 06:16:56.701530 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2dd734f7b4474e44acfdf0e5151b6b21" } modify_external_catalogs: true
I20260811 06:16:56.701828 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_2dd734f7b4474e44acfdf0e5151b6b21" } modify_external_catalogs: true
I20260811 06:16:56.702603 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_3b5a8830887248dd84904417be8ddd49" } new_table_name: "default.Table_08b52b87a0494cee8394125422ce0196" modify_external_catalogs: true
I20260811 06:16:56.704442 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_987b68deeac64dd1b9aad386fc6ffaff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.705174 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_987b68deeac64dd1b9aad386fc6ffaff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.706275 11046 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
I20260811 06:16:56.706708 11046 leader_election.cc:302] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:56.707559 12021 raft_consensus.cc:2726] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.708900 11361 tablet_bootstrap.cc:492] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:56.709203 11361 ts_tablet_manager.cc:1397] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.010s
I20260811 06:16:56.710058 11365 raft_consensus.cc:348] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:56.710523 11365 raft_consensus.cc:374] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:56.710479 11361 raft_consensus.cc:348] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.710855 11361 raft_consensus.cc:374] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:56.711014 11361 raft_consensus.cc:729] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:56.711359 11361 consensus_queue.cc:260] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.712097 11361 ts_tablet_manager.cc:1428] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:16:56.712538 11361 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:56.713337 10332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ac3235af8d1f42d29a220ec551aa448a" } modify_external_catalogs: true
I20260811 06:16:56.714665 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_373a8a768dcc4de9bffd2c2488b003de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.715307 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_373a8a768dcc4de9bffd2c2488b003de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.716128 11361 tablet_bootstrap.cc:654] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.716912 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.717573 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.718681 11362 tablet_bootstrap.cc:654] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.713635 10332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ac3235af8d1f42d29a220ec551aa448a" } modify_external_catalogs: true
I20260811 06:16:56.723990 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_897ed62b321f47fb89a724e148c60031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.724743 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_897ed62b321f47fb89a724e148c60031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.728745 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e00a72f178f74ca59cc073fe78c99373 consensus state has no leader
I20260811 06:16:56.729417 10337 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_615fc66df6ed4c148a1fc40f406cbb31" } new_table_name: "default.Table_21af64f531d94d2ca6bd55161d03a654" modify_external_catalogs: true
I20260811 06:16:56.734258 10318 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_7dac9d3b43fb4170aaf2b2d95de0d25f" } new_table_name: "default.Table_ec74453aafb6436c825c8333c1f0f468" modify_external_catalogs: true
I20260811 06:16:56.735986 11365 raft_consensus.cc:729] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:56.736388 11365 consensus_queue.cc:260] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:56.737109 11365 ts_tablet_manager.cc:1428] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.043s user 0.001s sys 0.002s
I20260811 06:16:56.737579 11365 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:56.740773 11365 tablet_bootstrap.cc:654] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:56.749402 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 336) took 1257 ms. Trace:
I20260811 06:16:56.749706 11371 rpcz_store.cc:276] 0811 06:16:55.440613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.454305 (+ 13692us) service_pool.cc:227] Handling call
0811 06:16:56.697172 (+1242867us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:16:56.697187 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.697933 (+ 746us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1237932}
W20260811 06:16:56.750746 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5119e9bb88844329aea123dc3805d91d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5119e9bb88844329aea123dc3805d91d already in progress: creating tablet
I20260811 06:16:56.753907 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 340) took 1253 ms. Trace:
I20260811 06:16:56.754318 11371 rpcz_store.cc:276] 0811 06:16:55.498444 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.498643 (+ 199us) service_pool.cc:227] Handling call
0811 06:16:56.751259 (+1252616us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:16:56.751274 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.751405 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249558}
W20260811 06:16:56.755030 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:16:56.756803 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 348) took 1030 ms. Trace:
I20260811 06:16:56.757004 11371 rpcz_store.cc:276] 0811 06:16:55.725181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.725276 (+ 95us) service_pool.cc:227] Handling call
0811 06:16:56.755440 (+1030164us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:16:56.755453 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.755571 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1015949}
W20260811 06:16:56.757689 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6dee9af5a4504b8284c9150298ab3462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dee9af5a4504b8284c9150298ab3462 already in progress: creating tablet
W20260811 06:16:56.758602 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7db813cbb8f74b329015b163ebd58c00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7db813cbb8f74b329015b163ebd58c00 already in progress: creating tablet
I20260811 06:16:56.762739 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2ff79d6d72ae4a03933f83dfd29053a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.763720 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ff79d6d72ae4a03933f83dfd29053a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.765288 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_45c213dc71dc4248a883fce2b58fc984" } new_table_name: "default.Table_2d172324032f4a89805a6dfb19f8db45" modify_external_catalogs: true
I20260811 06:16:56.772894 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:56.773458 11371 tablet_replica.cc:330] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:56.774101 11371 raft_consensus.cc:2229] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 06:16:56.777025 10337 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5797f3ba59924b41b92fbd089397218e consensus state has no leader
I20260811 06:16:56.777570 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_3b1ac4a64e764c4199189b7239086a89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.778237 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_b713c78a966d4e9e801312e6f5de79c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.779006 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b713c78a966d4e9e801312e6f5de79c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:56.778252 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b1ac4a64e764c4199189b7239086a89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.781924 11371 raft_consensus.cc:2258] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:56.798043 11961 raft_consensus.cc:482] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.798436 11961 raft_consensus.cc:504] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.799332 11961 leader_election.cc:288] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:56.800990 11046 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0
W20260811 06:16:56.804725 10318 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce5f2fa8c64247419f2ca9b26df825b0 consensus state has no leader
I20260811 06:16:56.806638 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2ff0844e55e44d41a704db6541346e95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:56.807376 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88af70bbada49309a0e7cc7c333d6f0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:56.807657 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ff0844e55e44d41a704db6541346e95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.807806 10915 raft_consensus.cc:2454] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:56.808252 10810 consensus_peers.cc:487] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:16:56.815526 10813 consensus_peers.cc:487] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:56.816289 11047 leader_election.cc:302] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:56.816993 11961 raft_consensus.cc:2781] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:56.817155 11961 raft_consensus.cc:482] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:56.817344 11961 raft_consensus.cc:3037] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:56.821229 11961 raft_consensus.cc:504] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.823186 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad42cef6aad49a1932bf1e9b20e169c (DEFAULT_TABLE table=default.Table_c5d51bfe8d4f4ac084ad0692d3c334be [id=12b005d427d949009b95d8f8a203e5c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.824009 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad42cef6aad49a1932bf1e9b20e169c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.825623 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 1649493bd0924ee48fd5044d7288932d (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.826367 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1649493bd0924ee48fd5044d7288932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.829300 11127 tablet_service.cc:1467] Processing CreateTablet for tablet c2c014c792fe4f309d15856f63f47cc9 (DEFAULT_TABLE table=default.Table_e978aa9dd9f64a6396130a9ef90b76ba [id=88fcae658b144d79a96df7c2b30a26a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.829763 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c014c792fe4f309d15856f63f47cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.830348 11121 tablet_service.cc:1467] Processing CreateTablet for tablet c42f153889c7490ea33002e3a857c631 (DEFAULT_TABLE table=default.Table_e1d6c05437784e07a5b7deefec230ae5 [id=47be197bbc8f46ea88c0436869954992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.830922 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c42f153889c7490ea33002e3a857c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.832605 11109 tablet_service.cc:1467] Processing CreateTablet for tablet 02bb2819d9cc4880803ef959c131b9ac (DEFAULT_TABLE table=default.Table_8baf40088898402196034a63aa016e8b [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.833214 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02bb2819d9cc4880803ef959c131b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.835058 11961 leader_election.cc:288] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:56.835795 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 61671753b0964b3987bd3f33226857b7 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.836746 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61671753b0964b3987bd3f33226857b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.837976 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 3c64c7100ccc4474bb895712f2d01b45 (DEFAULT_TABLE table=default.Table_236938dbaef84b3a93b4166937bfe2ff [id=dd2d621af0154d738a53335123f0e01d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.838093 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 231bbec61fa247ef97b090f6a180b737 (DEFAULT_TABLE table=default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 [id=5e9aaf8278a7448495ee4e3ada85919c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.838413 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c64c7100ccc4474bb895712f2d01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.838779 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 5d64ea5000504cbd82ecedcf5f6b78a9 (DEFAULT_TABLE table=default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 [id=f7cb75ea2c454129b47c41cbe2e5c488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.839473 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d64ea5000504cbd82ecedcf5f6b78a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.839835 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231bbec61fa247ef97b090f6a180b737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.840516 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 79f307f50e044435be880079219170d8 (DEFAULT_TABLE table=default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.840953 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f307f50e044435be880079219170d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.850862 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 3210614ebacf45c89d63413c51c8f923 (DEFAULT_TABLE table=default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.861368 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 00483ba1f60c4db386e3a7f1d57b921c (DEFAULT_TABLE table=default.Table_b79dca0f63044a20901e066a9c52d07f [id=258a0da1203e4162b4d2f87e9f0e3c32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:56.864840 11046 leader_election.cc:341] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0
W20260811 06:16:56.865669 10322 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 370d971f8ef14131afc5b54dbdbaae98 consensus state has no leader
I20260811 06:16:56.865835 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3210614ebacf45c89d63413c51c8f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.866930 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00483ba1f60c4db386e3a7f1d57b921c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.873524 10322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_6e61e223c12c4b6ebc75c0d5d04491c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.875301 10322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.875303 10330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_f43d88571e7e47fcb747e066587c6812" } new_table_name: "default.Table_ae798943d2514f6488c7ae50b11ef679" modify_external_catalogs: true
I20260811 06:16:56.886410 11371 ts_tablet_manager.cc:1905] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:56.885133 10613 tablet_service.cc:1467] Processing CreateTablet for tablet c42f153889c7490ea33002e3a857c631 (DEFAULT_TABLE table=default.Table_e1d6c05437784e07a5b7deefec230ae5 [id=47be197bbc8f46ea88c0436869954992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.888341 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88af70bbada49309a0e7cc7c333d6f0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:56.888682 10915 raft_consensus.cc:3037] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:56.889707 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 61671753b0964b3987bd3f33226857b7 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.890686 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 3210614ebacf45c89d63413c51c8f923 (DEFAULT_TABLE table=default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.890793 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c42f153889c7490ea33002e3a857c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.890313 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 1649493bd0924ee48fd5044d7288932d (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.892766 10867 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48778 (request call id 349) took 1164 ms. Trace:
I20260811 06:16:56.890113 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 02bb2819d9cc4880803ef959c131b9ac (DEFAULT_TABLE table=default.Table_8baf40088898402196034a63aa016e8b [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.893656 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 231bbec61fa247ef97b090f6a180b737 (DEFAULT_TABLE table=default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 [id=5e9aaf8278a7448495ee4e3ada85919c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.894486 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad42cef6aad49a1932bf1e9b20e169c (DEFAULT_TABLE table=default.Table_c5d51bfe8d4f4ac084ad0692d3c334be [id=12b005d427d949009b95d8f8a203e5c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.895280 10610 tablet_service.cc:1467] Processing CreateTablet for tablet c2c014c792fe4f309d15856f63f47cc9 (DEFAULT_TABLE table=default.Table_e978aa9dd9f64a6396130a9ef90b76ba [id=88fcae658b144d79a96df7c2b30a26a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.895416 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3210614ebacf45c89d63413c51c8f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.895741 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c014c792fe4f309d15856f63f47cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.896080 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 3c64c7100ccc4474bb895712f2d01b45 (DEFAULT_TABLE table=default.Table_236938dbaef84b3a93b4166937bfe2ff [id=dd2d621af0154d738a53335123f0e01d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.896582 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c64c7100ccc4474bb895712f2d01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.897792 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 5d64ea5000504cbd82ecedcf5f6b78a9 (DEFAULT_TABLE table=default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 [id=f7cb75ea2c454129b47c41cbe2e5c488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.893229 10867 rpcz_store.cc:276] 0811 06:16:55.708076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.710725 (+ 2649us) service_pool.cc:227] Handling call
0811 06:16:55.975975 (+265250us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:55.976003 (+ 28us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:56.405364 (+429361us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.870623 (+465259us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:56.872651 (+ 2028us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:56.898526 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1649493bd0924ee48fd5044d7288932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.898845 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 189) took 5427 ms. Trace:
I20260811 06:16:56.899304 11370 rpcz_store.cc:276] 0811 06:16:51.466985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.467164 (+ 179us) service_pool.cc:227] Handling call
0811 06:16:56.865417 (+5398253us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:16:56.865431 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.892549 (+ 27118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5313344}
W20260811 06:16:56.900264 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 16674be53bd54f9395b650e19edd3cf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16674be53bd54f9395b650e19edd3cf4 already in progress: creating tablet
I20260811 06:16:56.902351 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 00483ba1f60c4db386e3a7f1d57b921c (DEFAULT_TABLE table=default.Table_b79dca0f63044a20901e066a9c52d07f [id=258a0da1203e4162b4d2f87e9f0e3c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.904328 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 79f307f50e044435be880079219170d8 (DEFAULT_TABLE table=default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.904811 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d64ea5000504cbd82ecedcf5f6b78a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.905084 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231bbec61fa247ef97b090f6a180b737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.909837 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02bb2819d9cc4880803ef959c131b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.911026 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f307f50e044435be880079219170d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.913793 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad42cef6aad49a1932bf1e9b20e169c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.915472 10915 raft_consensus.cc:2454] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:56.917528 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00483ba1f60c4db386e3a7f1d57b921c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.902083 12059 raft_consensus.cc:482] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.918988 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 192) took 5366 ms. Trace:
I20260811 06:16:56.919719 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61671753b0964b3987bd3f33226857b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.920352 11047 leader_election.cc:302] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:56.924736 11370 rpcz_store.cc:276] 0811 06:16:51.534791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:51.536017 (+ 1226us) service_pool.cc:227] Handling call
0811 06:16:56.900749 (+5364732us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:16:56.900767 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.900942 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5335210}
W20260811 06:16:56.925630 10311 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet dc6254bf781740019c3f71b26179f25d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6254bf781740019c3f71b26179f25d already in progress: creating tablet
I20260811 06:16:56.928025 12059 raft_consensus.cc:504] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.938448 11961 raft_consensus.cc:2781] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:56.941771 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_1882451cbcfe432aa9188327086bf0e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.942744 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1882451cbcfe432aa9188327086bf0e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.938092 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a00b0b51f574bfb843b65c0876ab4fc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:56.947278 10880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48778 (request call id 346) took 1158 ms. Trace:
W20260811 06:16:56.948235 10810 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc
W20260811 06:16:56.949678 10813 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:56.948367 11960 raft_consensus.cc:482] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:56.951793 10813 leader_election.cc:302] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:56.952179 11766 raft_consensus.cc:2726] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:56.951284 12059 leader_election.cc:288] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:56.955068 10880 rpcz_store.cc:276] 0811 06:16:55.649002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.699639 (+ 50637us) service_pool.cc:227] Handling call
0811 06:16:56.005673 (+306034us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:56.006033 (+ 360us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:56.348420 (+342387us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.672337 (+323917us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:56.807056 (+134719us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:56.958895 10324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c" } new_table_name: "default.Table_8e32495bbc6f44fd8b5e684f16ed7c88" modify_external_catalogs: true
I20260811 06:16:56.959128 11368 ts_tablet_manager.cc:1918] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:56.963763 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:56.967051 11960 raft_consensus.cc:504] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.972879 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_2418f358fbab49a585c61348c4764570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:56.973819 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2418f358fbab49a585c61348c4764570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:56.973912 11961 raft_consensus.cc:686] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:56.974257 11961 consensus_queue.cc:237] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:56.977245 11370 tablet_replica.cc:330] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:56.978610 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 61671753b0964b3987bd3f33226857b7 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.979336 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 8ad42cef6aad49a1932bf1e9b20e169c (DEFAULT_TABLE table=default.Table_c5d51bfe8d4f4ac084ad0692d3c334be [id=12b005d427d949009b95d8f8a203e5c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.982450 11370 raft_consensus.cc:2229] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:56.989148 11365 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:56.994112 10632 tablet_service.cc:1467] Processing CreateTablet for tablet e7dc9bfb0c444d799b18c3e647b186fa (DEFAULT_TABLE table=default.Table_1a6ec07940654e19aa7ab999ba7462cb [id=059f7292deab4fbcb4ba097aa1737fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:56.994683 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7dc9bfb0c444d799b18c3e647b186fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:56.998564 11370 raft_consensus.cc:2258] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:56.999382 11370 ts_tablet_manager.cc:1905] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:56.999878 10328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 006d3214480c47babe390496b335de70
I20260811 06:16:57.002640 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516021603ee24b3f9bdffd1e30e5ea9d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:57.009763 10608 tablet_service.cc:1467] Processing CreateTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.016012 11127 tablet_service.cc:1467] Processing CreateTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.016623 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dfa9eb84334e9e86434aa2d9593efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.017088 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:57.018167 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 085179a610734942b9dd050ce9cf56d4 (DEFAULT_TABLE table=default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.018342 11109 tablet_service.cc:1467] Processing CreateTablet for tablet e7dc9bfb0c444d799b18c3e647b186fa (DEFAULT_TABLE table=default.Table_1a6ec07940654e19aa7ab999ba7462cb [id=059f7292deab4fbcb4ba097aa1737fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.019531 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dfa9eb84334e9e86434aa2d9593efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.022842 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7dc9bfb0c444d799b18c3e647b186fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.023273 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 085179a610734942b9dd050ce9cf56d4 (DEFAULT_TABLE table=default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.023488 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 085179a610734942b9dd050ce9cf56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.023808 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:57.025769 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 085179a610734942b9dd050ce9cf56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.028358 11100 tablet_service.cc:1467] Processing CreateTablet for tablet f4ed851746ef4861a624940952796a37 (DEFAULT_TABLE table=default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c [id=f226ec40ad1f4701bb7e6a289a6ca5bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.029223 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ed851746ef4861a624940952796a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.029583 10328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:57.030403 10328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.034274 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 00206b4e8c99424c9f1c4ba39fe51c82 (DEFAULT_TABLE table=default.Table_631427441c8845c392c4e107eaca71d8 [id=b8766a818b8a4ec6a618df0081a23c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.034853 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00206b4e8c99424c9f1c4ba39fe51c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.037967 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 7e87f192975a484ea038dc6c66fd6bae (DEFAULT_TABLE table=default.Table_364d018e0f034bee935a0a9ab1249f34 [id=f8872b7a8c2140e3acbb418a770173cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.038686 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e87f192975a484ea038dc6c66fd6bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.038828 11365 ts_tablet_manager.cc:1397] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.254s user 0.005s sys 0.004s
I20260811 06:16:57.041010 11361 tablet_bootstrap.cc:492] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:57.041209 11361 ts_tablet_manager.cc:1397] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.329s user 0.060s sys 0.099s
W20260811 06:16:57.041675 11153 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.596s user 0.028s sys 0.075s
W20260811 06:16:57.041949 11153 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.596s user 0.028s sys 0.075s
I20260811 06:16:57.042667 11361 raft_consensus.cc:348] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.042965 11361 raft_consensus.cc:374] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.043223 11361 raft_consensus.cc:729] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.052410 10620 tablet_service.cc:1467] Processing CreateTablet for tablet f4ed851746ef4861a624940952796a37 (DEFAULT_TABLE table=default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c [id=f226ec40ad1f4701bb7e6a289a6ca5bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.053655 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 00206b4e8c99424c9f1c4ba39fe51c82 (DEFAULT_TABLE table=default.Table_631427441c8845c392c4e107eaca71d8 [id=b8766a818b8a4ec6a618df0081a23c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.060400 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 7e87f192975a484ea038dc6c66fd6bae (DEFAULT_TABLE table=default.Table_364d018e0f034bee935a0a9ab1249f34 [id=f8872b7a8c2140e3acbb418a770173cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.069135 10321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 45ebef95922f4e7f93533b54c07b7cec
I20260811 06:16:57.072289 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:57.075002 10321 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]). Expected version 3 got 0
I20260811 06:16:57.077155 10321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_7704cd8b9ad742bd92383ed86acacc8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:57.078442 11361 consensus_queue.cc:260] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.078779 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:57.079312 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ed851746ef4861a624940952796a37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:57.084071 10321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7704cd8b9ad742bd92383ed86acacc8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.084805 12016 raft_consensus.cc:482] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.086486 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 94d04b025b1b45009260ddd9f1b0aabb with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcf7c7a470144c0a084aebc2032d896) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:57.090412 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61671753b0964b3987bd3f33226857b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.094475 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 1649493bd0924ee48fd5044d7288932d (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.095171 11362 tablet_bootstrap.cc:492] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.085209 12016 raft_consensus.cc:504] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.095430 11362 ts_tablet_manager.cc:1397] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.503s user 0.007s sys 0.011s
I20260811 06:16:57.092661 11153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.9.203.65:51819 (request call id 36) took 1089 ms. Trace:
I20260811 06:16:57.097289 12016 leader_election.cc:288] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:57.098313 10810 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:57.098901 11960 leader_election.cc:288] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:57.099992 10813 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.101850 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 3210614ebacf45c89d63413c51c8f923 (DEFAULT_TABLE table=default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.102198 12064 tablet.cc:1722] T e1ee53b81b8a441d8f9186bceb61129c P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:16:57.103518 10332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet c2527862e75b42aa9091456b0f5f994e
I20260811 06:16:57.104389 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ad42cef6aad49a1932bf1e9b20e169c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.105165 10880 tablet_service.cc:1467] Processing CreateTablet for tablet c42f153889c7490ea33002e3a857c631 (DEFAULT_TABLE table=default.Table_e1d6c05437784e07a5b7deefec230ae5 [id=47be197bbc8f46ea88c0436869954992]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.105270 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:57.107511 10332 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_1243732da50e4052abb053fb7274c580" } new_table_name: "default.Table_08562628f460412fbbe8b7b6a32bcba3" modify_external_catalogs: true
W20260811 06:16:57.114589 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 108219us
I20260811 06:16:57.114434 11368 log.cc:1196] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/cb854704951e4a399267766fb5be40e2
I20260811 06:16:57.115201 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 02bb2819d9cc4880803ef959c131b9ac (DEFAULT_TABLE table=default.Table_8baf40088898402196034a63aa016e8b [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.116109 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 231bbec61fa247ef97b090f6a180b737 (DEFAULT_TABLE table=default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 [id=5e9aaf8278a7448495ee4e3ada85919c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.114470 10813 leader_election.cc:302] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:57.112715 10867 tablet_service.cc:1467] Processing CreateTablet for tablet c2c014c792fe4f309d15856f63f47cc9 (DEFAULT_TABLE table=default.Table_e978aa9dd9f64a6396130a9ef90b76ba [id=88fcae658b144d79a96df7c2b30a26a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.119704 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c42f153889c7490ea33002e3a857c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.120033 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3210614ebacf45c89d63413c51c8f923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.098268 11365 raft_consensus.cc:348] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.122845 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 3c64c7100ccc4474bb895712f2d01b45 (DEFAULT_TABLE table=default.Table_236938dbaef84b3a93b4166937bfe2ff [id=dd2d621af0154d738a53335123f0e01d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.123116 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e87f192975a484ea038dc6c66fd6bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.123500 11365 raft_consensus.cc:374] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.123659 11365 raft_consensus.cc:729] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.123518 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
W20260811 06:16:57.124172 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 103306us
I20260811 06:16:57.121503 11362 raft_consensus.cc:348] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.136093 10333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:16:57.137339 10331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Sending DeleteTablet for 3 replicas of tablet b0cdc826a1d8460aba1aae684c13131d
I20260811 06:16:57.142153 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 2df64ad168f341be899eba30e55b7f44 (DEFAULT_TABLE table=default.Table_ae32a31bc8f64e96a549037c0d65f64e [id=3577c42e6da543858c4f923ca3694893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.142828 11365 consensus_queue.cc:260] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.144738 11365 ts_tablet_manager.cc:1428] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.106s user 0.003s sys 0.000s
I20260811 06:16:57.145568 11365 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.145371 10333 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_ef3697835c0e4cedbb64c0a58636d94b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:57.146287 10333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef3697835c0e4cedbb64c0a58636d94b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.148710 10331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_4e402e7edac3451e992194b471d8a664" } new_table_name: "default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31" modify_external_catalogs: true
I20260811 06:16:57.151003 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:57.151461 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00206b4e8c99424c9f1c4ba39fe51c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.157054 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02bb2819d9cc4880803ef959c131b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.157068 11368 ts_tablet_manager.cc:1939] T cb854704951e4a399267766fb5be40e2 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:57.160208 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 79f307f50e044435be880079219170d8 (DEFAULT_TABLE table=default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:16:57.161213 10330 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52ecffcf4a0e46428caed6f7d72199bd consensus state has no leader
I20260811 06:16:57.167448 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:57.166741 10330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_cc937b90426f431999efcbb356bc29f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:57.169021 12059 raft_consensus.cc:482] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.169147 11362 raft_consensus.cc:374] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:57.170397 10330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc937b90426f431999efcbb356bc29f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.171382 11960 raft_consensus.cc:2726] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:57.176601 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df64ad168f341be899eba30e55b7f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.179987 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 5d64ea5000504cbd82ecedcf5f6b78a9 (DEFAULT_TABLE table=default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 [id=f7cb75ea2c454129b47c41cbe2e5c488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.152077 12092 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260811 06:16:57.181397 10322 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_9a7b04bde68640deb63e6bdbd0f322d9" } new_table_name: "default.Table_7baf5a935fc041a6818ad62931bb8665" modify_external_catalogs: true
I20260811 06:16:57.181521 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:38572
I20260811 06:16:57.185076 10871 tablet_service.cc:1467] Processing CreateTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.188791 10337 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:16:57.191612 10337 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_cbef4a2446cd4a37bd3907ccd1ce6804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:57.192518 10337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbef4a2446cd4a37bd3907ccd1ce6804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:57.197999 10810 consensus_peers.cc:487] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:57.202826 11365 tablet_bootstrap.cc:654] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:57.206425 10324 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4ed851746ef4861a624940952796a37 consensus state has no leader
I20260811 06:16:57.209450 10324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_e631da66bfa04a7596d0d39becf5be95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:57.210342 10324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e631da66bfa04a7596d0d39becf5be95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.219646 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1649493bd0924ee48fd5044d7288932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.221645 11362 raft_consensus.cc:729] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.222028 11362 consensus_queue.cc:260] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.224879 10318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37928:
name: "default.Table_8691c9b01d514e36803289085cb4c93d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:16:57.225931 10318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8691c9b01d514e36803289085cb4c93d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:57.227231 10864 tablet_service.cc:1467] Processing CreateTablet for tablet e7dc9bfb0c444d799b18c3e647b186fa (DEFAULT_TABLE table=default.Table_1a6ec07940654e19aa7ab999ba7462cb [id=059f7292deab4fbcb4ba097aa1737fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.227653 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d64ea5000504cbd82ecedcf5f6b78a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.228147 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 270) took 3176 ms. Trace:
I20260811 06:16:57.228497 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.229043 10866 tablet_service.cc:1467] Processing CreateTablet for tablet f4ed851746ef4861a624940952796a37 (DEFAULT_TABLE table=default.Table_8e43a5fc1f11478bb4c38e16bf92fe6c [id=f226ec40ad1f4701bb7e6a289a6ca5bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.231575 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 085179a610734942b9dd050ce9cf56d4 (DEFAULT_TABLE table=default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.232052 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7dc9bfb0c444d799b18c3e647b186fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.233785 11362 ts_tablet_manager.cc:1428] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.127s user 0.003s sys 0.000s
I20260811 06:16:57.235814 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4ed851746ef4861a624940952796a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.235517 11368 rpcz_store.cc:276] 0811 06:16:53.991773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.991834 (+ 61us) service_pool.cc:227] Handling call
0811 06:16:56.238292 (+2246458us) ts_tablet_manager.cc:1145] Deleting tablet cb854704951e4a399267766fb5be40e2
0811 06:16:56.238305 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:56.701866 (+463561us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:56.958999 (+257133us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.167763 (+208764us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2246117}
I20260811 06:16:57.246332 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet cb854704951e4a399267766fb5be40e2 (table default.Table_f855f0704b4a4ffdb05fc1987726f090 [id=fb4d89cc1c0346e282b734a2c8a070b0]) successfully deleted
I20260811 06:16:57.247668 12059 raft_consensus.cc:504] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.248406 12059 leader_election.cc:288] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:57.249500 10328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_221001ee9f7d4adbaeed611c4a678bcf" } modify_external_catalogs: true
I20260811 06:16:57.249841 10328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_221001ee9f7d4adbaeed611c4a678bcf" } modify_external_catalogs: true
I20260811 06:16:57.251230 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 00483ba1f60c4db386e3a7f1d57b921c (DEFAULT_TABLE table=default.Table_b79dca0f63044a20901e066a9c52d07f [id=258a0da1203e4162b4d2f87e9f0e3c32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.251669 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8dfa9eb84334e9e86434aa2d9593efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.255046 11362 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.266641 11371 ts_tablet_manager.cc:1918] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:57.266892 11371 log.cc:1196] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e180cc2c38aa4a78897e264276e4c766
I20260811 06:16:57.267643 11371 ts_tablet_manager.cc:1939] T e180cc2c38aa4a78897e264276e4c766 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:57.273854 10321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a78aa76e7c2c4be2a021e44457b7091a" } modify_external_catalogs: true
I20260811 06:16:57.274178 10321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_a78aa76e7c2c4be2a021e44457b7091a" } modify_external_catalogs: true
W20260811 06:16:57.278643 10332 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a25b6d0d733c44398a233b595caad8a0 consensus state has no leader
I20260811 06:16:57.279141 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 085179a610734942b9dd050ce9cf56d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.282200 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 271) took 3248 ms. Trace:
I20260811 06:16:57.288311 11368 rpcz_store.cc:276] 0811 06:16:54.007913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.007997 (+ 84us) service_pool.cc:227] Handling call
0811 06:16:57.244121 (+3236124us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:16:57.255367 (+ 11246us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.256355 (+ 988us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3235869}
W20260811 06:16:57.290442 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 847df543db4244a6b2900fc16fea7c07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 847df543db4244a6b2900fc16fea7c07 already in progress: creating tablet
I20260811 06:16:57.293192 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f307f50e044435be880079219170d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.306001 10333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d118a4eb489941a6a06cd47e966d09a4" } modify_external_catalogs: true
I20260811 06:16:57.306447 10333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_d118a4eb489941a6a06cd47e966d09a4" } modify_external_catalogs: true
W20260811 06:16:57.312122 10331 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc0ec3b040cd4a54a7919a15f8eb5da7 consensus state has no leader
I20260811 06:16:57.312533 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c014c792fe4f309d15856f63f47cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.314838 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 279) took 3192 ms. Trace:
I20260811 06:16:57.317324 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c64c7100ccc4474bb895712f2d01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.324219 11368 rpcz_store.cc:276] 0811 06:16:54.096766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.098662 (+ 1896us) service_pool.cc:227] Handling call
0811 06:16:57.289090 (+3190428us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:16:57.289132 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.289390 (+ 258us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3190164}
I20260811 06:16:57.324468 10029 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu pid 10273
W20260811 06:16:57.325517 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 681736b44af04718b800d503ca645c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 681736b44af04718b800d503ca645c1a already in progress: creating tablet
I20260811 06:16:57.326169 10393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:16:57.326263 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231bbec61fa247ef97b090f6a180b737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.326838 10852 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48768 (request call id 82) took 1477 ms. Trace:
I20260811 06:16:57.333144 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:57.333523 10662 raft_consensus.cc:2454] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:57.334182 10851 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48768 (request call id 81) took 1664 ms. Trace:
I20260811 06:16:57.334461 10851 rpcz_store.cc:276] 0811 06:16:55.658542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.658605 (+ 63us) service_pool.cc:227] Handling call
0811 06:16:56.674695 (+1016090us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x6150000d9e24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.179498 (+504803us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x6150000f4224. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.323431 (+143933us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2844660352}
I20260811 06:16:57.337188 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00483ba1f60c4db386e3a7f1d57b921c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.344491 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 00206b4e8c99424c9f1c4ba39fe51c82 (DEFAULT_TABLE table=default.Table_631427441c8845c392c4e107eaca71d8 [id=b8766a818b8a4ec6a618df0081a23c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.363358 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 358) took 1586 ms. Trace:
I20260811 06:16:57.367177 11371 rpcz_store.cc:276] 0811 06:16:55.777142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.777198 (+ 56us) service_pool.cc:227] Handling call
0811 06:16:56.758902 (+981704us) ts_tablet_manager.cc:1145] Deleting tablet e180cc2c38aa4a78897e264276e4c766
0811 06:16:56.758913 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.162898 (+403985us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.266426 (+103528us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.363277 (+ 96851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963149}
I20260811 06:16:57.374207 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 356) took 1603 ms. Trace:
I20260811 06:16:57.375396 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.377485 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.385835 11371 rpcz_store.cc:276] 0811 06:16:55.771046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.771200 (+ 154us) service_pool.cc:227] Handling call
0811 06:16:57.373612 (+1602412us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:16:57.373626 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.374116 (+ 490us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1568432}
I20260811 06:16:57.386410 11365 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.386662 11365 ts_tablet_manager.cc:1397] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.241s user 0.016s sys 0.022s
I20260811 06:16:57.388070 11365 raft_consensus.cc:348] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.388396 11365 raft_consensus.cc:374] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.388552 11365 raft_consensus.cc:729] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.388859 11365 consensus_queue.cc:260] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.389761 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 357) took 1616 ms. Trace:
I20260811 06:16:57.391438 12016 raft_consensus.cc:482] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.391681 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 2df64ad168f341be899eba30e55b7f44 (DEFAULT_TABLE table=default.Table_ae32a31bc8f64e96a549037c0d65f64e [id=3577c42e6da543858c4f923ca3694893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.393899 11371 rpcz_store.cc:276] 0811 06:16:55.773704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.773798 (+ 94us) service_pool.cc:227] Handling call
0811 06:16:57.389457 (+1615659us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:16:57.389468 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.389638 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1579180}
I20260811 06:16:57.394223 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
I20260811 06:16:57.394369 11365 ts_tablet_manager.cc:1428] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:57.395944 11365 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:16:57.398576 11046 leader_election.cc:341] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:57.399044 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 363) took 1508 ms. Trace:
I20260811 06:16:57.399418 11371 rpcz_store.cc:276] 0811 06:16:55.890802 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.890861 (+ 59us) service_pool.cc:227] Handling call
0811 06:16:57.398734 (+1507873us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:16:57.398745 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.398933 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1506525}
I20260811 06:16:57.400198 11371 tablet_replica.cc:330] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:57.400516 11371 raft_consensus.cc:2229] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.400817 11371 raft_consensus.cc:2258] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.401021 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df64ad168f341be899eba30e55b7f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.400570 12016 raft_consensus.cc:504] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.402464 11371 ts_tablet_manager.cc:1905] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.403790 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:34696
W20260811 06:16:57.404206 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 281683us
W20260811 06:16:57.404523 11047 leader_election.cc:341] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:57.102735 11153 rpcz_store.cc:276] 0811 06:16:55.961064 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.961949 (+ 885us) service_pool.cc:227] Handling call
0811 06:16:55.962339 (+ 390us) raft_consensus.cc:1457] Updating replica for 2 ops
0811 06:16:55.985176 (+ 22837us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 06:16:55.985182 (+ 6us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0811 06:16:55.985423 (+ 241us) alter_schema_op.cc:126] START. Timestamp: 1786429013852614
0811 06:16:56.226276 (+240853us) log.cc:842] Serialized 199 byte log entry
0811 06:16:56.445044 (+218768us) raft_consensus.cc:1631] Marking committed up to 2
0811 06:16:56.445615 (+ 571us) log.cc:842] Serialized 14 byte log entry
0811 06:16:57.042070 (+596455us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 06:16:57.049170 (+ 7100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 06:16:57.049185 (+ 15us) raft_consensus.cc:1671] finished
0811 06:16:57.049188 (+ 3us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 06:16:57.050098 (+ 910us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:56.233474 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0811 06:16:56.238065 (+ 4591us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0811 06:16:56.238076 (+ 11us) alter_schema_op.cc:65] Acquired schema lock
0811 06:16:56.238083 (+ 7us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0811 06:16:56.445803 (+207720us) op_driver.cc:444] REPLICATION: finished
0811 06:16:57.100912 (+655109us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0811 06:16:57.103541 (+ 2629us) log.cc:842] Serialized 5 byte log entry
Metrics: {"prepare.queue_time_us":279,"prepare.run_cpu_time_us":12,"prepare.run_wall_time_us":13,"raft.queue_time_us":3404,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":91,"thread_start_us":218648,"threads_started":1,"wal-append.queue_time_us":217830,"child_traces":[["op",{"apply.queue_time_us":655026,"prepare.queue_time_us":240883,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":11695,"replication_time_us":460366,"thread_start_us":832685,"threads_started":2}]]}
I20260811 06:16:57.410907 12016 leader_election.cc:288] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:57.405694 11365 tablet_bootstrap.cc:654] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.412863 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:57.428092 11047 leader_election.cc:302] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:57.430600 11976 raft_consensus.cc:482] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.430943 11976 raft_consensus.cc:504] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.431880 11976 leader_election.cc:288] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:57.434324 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bbf657cb27f4da9a4f595242864163a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:57.434725 12094 raft_consensus.cc:2726] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:16:57.434892 11365 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.435145 11365 ts_tablet_manager.cc:1397] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.007s
W20260811 06:16:57.435653 10564 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.436512 11365 raft_consensus.cc:348] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.436918 11365 raft_consensus.cc:374] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.437101 11365 raft_consensus.cc:729] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.437537 11365 consensus_queue.cc:260] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.445883 11365 ts_tablet_manager.cc:1428] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.011s user 0.000s sys 0.004s
I20260811 06:16:57.446600 11365 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.447800 10850 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48768 (request call id 78) took 1726 ms. Trace:
I20260811 06:16:57.448026 10850 rpcz_store.cc:276] 0811 06:16:55.602413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.602488 (+ 75us) service_pool.cc:227] Handling call
0811 06:16:56.682591 (+1080103us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x6150000d9e24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.177483 (+494892us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x6150000f4224. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.257760 (+ 80277us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x6150001d13a4. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.329065 (+ 71305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2855777152}
I20260811 06:16:57.448328 11368 tablet_replica.cc:330] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:57.448617 11368 raft_consensus.cc:2229] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.448753 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a46cec25944310a838d8323b119883" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:57.449002 11368 raft_consensus.cc:2258] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.449121 10921 raft_consensus.cc:2454] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:57.449748 11368 ts_tablet_manager.cc:1905] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.454206 10847 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48768 (request call id 80) took 1716 ms. Trace:
I20260811 06:16:57.454444 10847 rpcz_store.cc:276] 0811 06:16:55.643563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.643632 (+ 69us) service_pool.cc:227] Handling call
0811 06:16:56.683945 (+1040313us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x6150000d9e24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.179730 (+495785us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x6150000f4224. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.359588 (+179858us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1891810304}
I20260811 06:16:57.455955 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00206b4e8c99424c9f1c4ba39fe51c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:16:57.458513 11365 tablet_bootstrap.cc:654] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:57.459695 11094 consensus_meta.cc:287] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: Time spent flushing consensus metadata: real 0.513s user 0.002s sys 0.003s
I20260811 06:16:57.463002 11361 ts_tablet_manager.cc:1428] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.422s user 0.042s sys 0.042s
I20260811 06:16:57.463433 11361 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:57.442471 10852 rpcz_store.cc:276] 0811 06:16:55.849673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.849745 (+ 72us) service_pool.cc:227] Handling call
0811 06:16:56.680158 (+830413us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x6150000d9e24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.177193 (+497035us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x6150000f4224. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.256384 (+ 79191us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x6150001d13a4. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.326758 (+ 70374us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2863571840}
I20260811 06:16:57.468886 12091 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260811 06:16:57.471145 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 7e87f192975a484ea038dc6c66fd6bae (DEFAULT_TABLE table=default.Table_364d018e0f034bee935a0a9ab1249f34 [id=f8872b7a8c2140e3acbb418a770173cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.483959 11365 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.484230 11365 ts_tablet_manager.cc:1397] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
I20260811 06:16:57.472760 10810 leader_election.cc:302] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:57.487002 11365 raft_consensus.cc:348] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.487278 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.487353 11365 raft_consensus.cc:374] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.487569 11365 raft_consensus.cc:729] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.487604 10882 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.487850 10886 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:48778 (request call id 367) took 1188 ms. Trace:
I20260811 06:16:57.487972 10886 rpcz_store.cc:276] 0811 06:16:56.275178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.275424 (+ 246us) service_pool.cc:227] Handling call
0811 06:16:56.416516 (+141092us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0811 06:16:56.416565 (+ 49us) ts_tablet_manager.cc:676] Creating new metadata...
0811 06:16:56.987483 (+570918us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.459920 (+472437us) tablet_replica.cc:205] Creating consensus instance
0811 06:16:57.462522 (+ 2602us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:57.488018 11365 consensus_queue.cc:260] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.488821 11365 ts_tablet_manager.cc:1428] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260811 06:16:57.501878 11362 tablet_bootstrap.cc:654] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:57.502653 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 120697us
I20260811 06:16:57.505180 12021 raft_consensus.cc:482] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.505422 12021 raft_consensus.cc:504] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.506289 12021 leader_election.cc:288] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:57.507710 11365 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.509110 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 2df64ad168f341be899eba30e55b7f44 (DEFAULT_TABLE table=default.Table_ae32a31bc8f64e96a549037c0d65f64e [id=3577c42e6da543858c4f923ca3694893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:16:57.512516 11361 tablet_bootstrap.cc:654] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:57.520355 11046 leader_election.cc:341] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a4a46cec25944310a838d8323b119883
W20260811 06:16:57.520937 11046 consensus_peers.cc:487] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c00b6bdfc8ac4b5db81de9f614fcf213. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:57.523989 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e87f192975a484ea038dc6c66fd6bae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:57.524820 11046 leader_election.cc:341] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e7d44fa2df924751a4835821901b56de
I20260811 06:16:57.526328 11365 tablet_bootstrap.cc:654] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:57.539134 10813 leader_election.cc:341] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.540979 12059 raft_consensus.cc:2781] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:57.541227 12059 raft_consensus.cc:482] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:57.541455 12059 raft_consensus.cc:3037] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:57.540416 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:48778
I20260811 06:16:57.545675 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2df64ad168f341be899eba30e55b7f44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:16:57.554538 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 103472us
I20260811 06:16:57.553335 11365 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.555138 11365 ts_tablet_manager.cc:1397] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.006s
I20260811 06:16:57.556967 11365 raft_consensus.cc:348] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.557489 11365 raft_consensus.cc:374] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.557658 11365 raft_consensus.cc:729] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.558184 11365 consensus_queue.cc:260] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.558911 11365 ts_tablet_manager.cc:1428] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:57.559398 11365 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.566691 11047 leader_election.cc:302] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:57.567332 12021 raft_consensus.cc:2781] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:57.567526 12021 raft_consensus.cc:482] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:57.567806 12021 raft_consensus.cc:3037] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:57.568393 11365 tablet_bootstrap.cc:654] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.570350 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bbf657cb27f4da9a4f595242864163a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:57.575701 10555 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.576077 10555 leader_election.cc:302] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:57.576483 11047 leader_election.cc:341] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: e7d44fa2df924751a4835821901b56de
I20260811 06:16:57.576704 11047 leader_election.cc:302] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:57.577756 11371 ts_tablet_manager.cc:1918] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:57.577921 11371 log.cc:1196] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/864c3bbf1e004579a4d0be809f83ca33
I20260811 06:16:57.578424 11371 ts_tablet_manager.cc:1939] T 864c3bbf1e004579a4d0be809f83ca33 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:57.579384 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 374) took 1562 ms. Trace:
I20260811 06:16:57.579530 11371 rpcz_store.cc:276] 0811 06:16:56.016573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.044005 (+ 27432us) service_pool.cc:227] Handling call
0811 06:16:57.400115 (+1356110us) ts_tablet_manager.cc:1145] Deleting tablet 864c3bbf1e004579a4d0be809f83ca33
0811 06:16:57.400126 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.473151 (+ 73025us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.577584 (+104433us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.579260 (+ 1676us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331230}
I20260811 06:16:57.580269 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 375) took 1431 ms. Trace:
I20260811 06:16:57.580440 11371 rpcz_store.cc:276] 0811 06:16:56.148835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.148901 (+ 66us) service_pool.cc:227] Handling call
0811 06:16:57.579964 (+1431063us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:16:57.579976 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.580089 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407810}
I20260811 06:16:57.580889 11371 tablet_replica.cc:330] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:57.581171 11371 raft_consensus.cc:2229] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.581602 11371 raft_consensus.cc:2258] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.582379 11371 ts_tablet_manager.cc:1905] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.582651 12016 raft_consensus.cc:2726] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:57.588083 11976 raft_consensus.cc:2726] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:57.597129 11361 tablet_bootstrap.cc:492] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:57.597522 11361 ts_tablet_manager.cc:1397] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.134s user 0.002s sys 0.006s
I20260811 06:16:57.602828 12021 raft_consensus.cc:504] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.604660 12021 leader_election.cc:288] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:57.610158 11046 leader_election.cc:341] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a4a46cec25944310a838d8323b119883
I20260811 06:16:57.624092 12064 tablet.cc:1722] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:16:57.623960 12021 consensus_queue.cc:1035] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:16:57.654515 10846 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:48768 (request call id 79) took 1992 ms. Trace:
I20260811 06:16:57.654836 10846 rpcz_store.cc:276] 0811 06:16:55.635461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.635517 (+ 56us) service_pool.cc:227] Handling call
0811 06:16:56.687102 (+1051585us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x6150000d9e24. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.217993 (+530891us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x6150000f4224. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.255635 (+ 37642us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x6150001d13a4. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f1947455630 00007f194b02dc7f 00007f1945b99016 00007f1945b98d45 00007f1942a859be 00007f1942a8479e 00007f1942a8ab25 00007f1942a8b54f 00007f1942a8b378 00000000009edb7c
0811 06:16:57.627802 (+372167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1850743680}
I20260811 06:16:57.655184 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a46cec25944310a838d8323b119883" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:57.658077 11362 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.660233 11362 ts_tablet_manager.cc:1397] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.420s user 0.006s sys 0.010s
I20260811 06:16:57.661325 10925 raft_consensus.cc:3037] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:57.670318 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 94620.7us
I20260811 06:16:57.672981 11361 raft_consensus.cc:348] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.682482 11365 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.682775 11365 ts_tablet_manager.cc:1397] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.124s user 0.011s sys 0.018s
I20260811 06:16:57.684173 11365 raft_consensus.cc:348] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.684468 11371 ts_tablet_manager.cc:1918] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:57.684816 11371 log.cc:1196] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/b0d203f652b24b4897e62fc8c03d32df
I20260811 06:16:57.685856 11371 ts_tablet_manager.cc:1939] T b0d203f652b24b4897e62fc8c03d32df P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:57.684567 11365 raft_consensus.cc:374] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.686343 11365 raft_consensus.cc:729] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.686774 11365 consensus_queue.cc:260] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.687745 11365 ts_tablet_manager.cc:1428] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:16:57.688163 11365 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.691413 11365 tablet_bootstrap.cc:654] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.676157 11370 ts_tablet_manager.cc:1918] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:57.697254 11370 log.cc:1196] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6c62cbef937a46dfbc4dbf934e887139
I20260811 06:16:57.698015 11370 ts_tablet_manager.cc:1939] T 6c62cbef937a46dfbc4dbf934e887139 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:57.677089 12091 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:34696 (request call id 363) took 1716 ms. Trace:
I20260811 06:16:57.698334 12091 rpcz_store.cc:276] 0811 06:16:55.960488 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.060555 (+100067us) service_pool.cc:227] Handling call
0811 06:16:57.677035 (+1616480us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:56.238151 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0811 06:16:56.238215 (+ 64us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0811 06:16:56.238222 (+ 7us) alter_schema_op.cc:65] Acquired schema lock
0811 06:16:56.238227 (+ 5us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0811 06:16:56.238269 (+ 42us) alter_schema_op.cc:126] START. Timestamp: 1786429016238236
0811 06:16:56.238271 (+ 2us) op_driver.cc:331] REPLICATION: starting
0811 06:16:56.238852 (+ 581us) log.cc:842] Serialized 173 byte log entry
0811 06:16:57.038809 (+799957us) op_driver.cc:444] REPLICATION: finished
0811 06:16:57.468682 (+429873us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0811 06:16:57.471443 (+ 2761us) log.cc:842] Serialized 5 byte log entry
0811 06:16:57.676619 (+205176us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.676949 (+ 330us) log.cc:842] Serialized 14 byte log entry
0811 06:16:57.676991 (+ 42us) alter_schema_op.cc:71] Released schema lock
0811 06:16:57.676995 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":429805,"prepare.queue_time_us":156741,"prepare.run_cpu_time_us":55152,"prepare.run_wall_time_us":204766,"raft.queue_time_us":51,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":336,"replication_time_us":800507,"thread_start_us":781185,"threads_started":3,"wal-append.queue_time_us":207153}]]}
I20260811 06:16:57.700194 11361 raft_consensus.cc:374] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.700426 11361 raft_consensus.cc:729] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.704663 11361 consensus_queue.cc:260] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.705742 11361 ts_tablet_manager.cc:1428] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.108s user 0.000s sys 0.004s
I20260811 06:16:57.712350 11361 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:57.715041 11368 ts_tablet_manager.cc:1918] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:57.714833 11362 raft_consensus.cc:348] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.716151 12122 tablet.cc:1722] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:16:57.719827 11362 raft_consensus.cc:374] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.720093 11362 raft_consensus.cc:729] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.720664 11362 consensus_queue.cc:260] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.721957 11368 log.cc:1196] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:16:57.723749 11368 ts_tablet_manager.cc:1939] T c5efe8eb16e84575abd18a5079aad2c9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:57.723999 11361 tablet_bootstrap.cc:654] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.734911 11362 ts_tablet_manager.cc:1428] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.058s user 0.004s sys 0.000s
I20260811 06:16:57.735503 11362 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.738976 11365 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.739288 11365 ts_tablet_manager.cc:1397] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.001s
I20260811 06:16:57.740796 11365 raft_consensus.cc:348] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.741113 11365 raft_consensus.cc:374] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.741245 11365 raft_consensus.cc:729] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.742349 11365 consensus_queue.cc:260] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.743026 11365 ts_tablet_manager.cc:1428] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:16:57.746908 11365 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.748400 12118 raft_consensus.cc:482] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.718196 12119 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260811 06:16:57.748791 12118 raft_consensus.cc:504] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.750336 12118 leader_election.cc:288] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:57.751150 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:57.751351 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:57.751904 10564 leader_election.cc:341] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:57.752123 10555 leader_election.cc:341] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.752328 10555 leader_election.cc:302] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:57.753193 12118 raft_consensus.cc:2726] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:57.759537 11365 tablet_bootstrap.cc:654] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.766731 12131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:57.767269 11362 tablet_bootstrap.cc:654] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.767138 12131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:57.769704 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 376) took 1571 ms. Trace:
I20260811 06:16:57.770961 11371 rpcz_store.cc:276] 0811 06:16:56.198133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.198206 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:57.580673 (+1382467us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:16:57.580682 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.676031 (+ 95349us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.684174 (+ 8143us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.769593 (+ 85419us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1355578}
I20260811 06:16:57.771617 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 383) took 1175 ms. Trace:
I20260811 06:16:57.771891 11371 rpcz_store.cc:276] 0811 06:16:56.596530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.596585 (+ 55us) service_pool.cc:227] Handling call
0811 06:16:57.771340 (+1174755us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:16:57.771354 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.771491 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169197}
I20260811 06:16:57.772550 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 382) took 1178 ms. Trace:
I20260811 06:16:57.772826 11371 rpcz_store.cc:276] 0811 06:16:56.595832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.595898 (+ 66us) service_pool.cc:227] Handling call
0811 06:16:57.772260 (+1176362us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:16:57.772272 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.772398 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165790}
I20260811 06:16:57.773324 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 384) took 1166 ms. Trace:
I20260811 06:16:57.773478 11371 rpcz_store.cc:276] 0811 06:16:56.606884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.607658 (+ 774us) service_pool.cc:227] Handling call
0811 06:16:57.773081 (+1165423us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:16:57.773091 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.773214 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165137}
I20260811 06:16:57.775120 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 385) took 1168 ms. Trace:
I20260811 06:16:57.776573 12059 raft_consensus.cc:504] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.777586 12059 leader_election.cc:288] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:57.776149 11371 rpcz_store.cc:276] 0811 06:16:56.607035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.607102 (+ 67us) service_pool.cc:227] Handling call
0811 06:16:57.774894 (+1167792us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:16:57.774907 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.775027 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148156}
I20260811 06:16:57.778093 11371 tablet_replica.cc:330] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:57.779093 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 206) took 5682 ms. Trace:
I20260811 06:16:57.779379 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:57.779402 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:57.779621 10662 raft_consensus.cc:3037] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:57.780050 11370 rpcz_store.cc:276] 0811 06:16:52.096842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.096999 (+ 157us) service_pool.cc:227] Handling call
0811 06:16:56.926035 (+4829036us) ts_tablet_manager.cc:1145] Deleting tablet 6c62cbef937a46dfbc4dbf934e887139
0811 06:16:56.926050 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.473699 (+547649us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.675956 (+202257us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.779017 (+103061us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4879,"tablet-delete.queue_time_us":4811825}
I20260811 06:16:57.780839 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 207) took 5674 ms. Trace:
I20260811 06:16:57.781080 11370 rpcz_store.cc:276] 0811 06:16:52.106329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.106487 (+ 158us) service_pool.cc:227] Handling call
0811 06:16:57.780493 (+5674006us) ts_tablet_manager.cc:1145] Deleting tablet d4d44dea35e94ed788b7e1e5a8a24d8e
0811 06:16:57.780504 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.780738 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5654146}
I20260811 06:16:57.781648 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 208) took 5672 ms. Trace:
I20260811 06:16:57.781900 11370 rpcz_store.cc:276] 0811 06:16:52.109211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.109299 (+ 88us) service_pool.cc:227] Handling call
0811 06:16:57.781352 (+5672053us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:16:57.781362 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.781533 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5647719}
I20260811 06:16:57.782409 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 210) took 5657 ms. Trace:
I20260811 06:16:57.782658 11370 rpcz_store.cc:276] 0811 06:16:52.124722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.124916 (+ 194us) service_pool.cc:227] Handling call
0811 06:16:57.782244 (+5657328us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:16:57.782254 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.782344 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5629110}
I20260811 06:16:57.783277 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 209) took 5666 ms. Trace:
I20260811 06:16:57.783540 11370 rpcz_store.cc:276] 0811 06:16:52.117030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.117238 (+ 208us) service_pool.cc:227] Handling call
0811 06:16:57.783055 (+5665817us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:16:57.783065 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.783177 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5626906}
W20260811 06:16:57.784580 10813 leader_election.cc:341] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.786228 11371 raft_consensus.cc:2229] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.786558 11371 raft_consensus.cc:2258] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.787444 11371 ts_tablet_manager.cc:1905] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.789582 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 211) took 5651 ms. Trace:
I20260811 06:16:57.789945 11370 rpcz_store.cc:276] 0811 06:16:52.138459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.138669 (+ 210us) service_pool.cc:227] Handling call
0811 06:16:57.789316 (+5650647us) ts_tablet_manager.cc:1145] Deleting tablet 52543aa31a1749d1a0fd5e48cbe30889
0811 06:16:57.789329 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.789475 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5617307}
I20260811 06:16:57.790937 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 230) took 5514 ms. Trace:
I20260811 06:16:57.792171 11370 rpcz_store.cc:276] 0811 06:16:52.276367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.634485 (+358118us) service_pool.cc:227] Handling call
0811 06:16:57.790651 (+5156166us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:16:57.790662 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.790833 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5155299}
I20260811 06:16:57.792783 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 231) took 5516 ms. Trace:
I20260811 06:16:57.793494 11370 rpcz_store.cc:276] 0811 06:16:52.276462 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.635405 (+358943us) service_pool.cc:227] Handling call
0811 06:16:57.792544 (+5157139us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:16:57.792555 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.792678 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5128349}
I20260811 06:16:57.794312 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 232) took 5517 ms. Trace:
I20260811 06:16:57.794610 11370 rpcz_store.cc:276] 0811 06:16:52.276598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.638368 (+361770us) service_pool.cc:227] Handling call
0811 06:16:57.794068 (+5155700us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:16:57.794079 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.794203 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5128217}
I20260811 06:16:57.795068 11370 tablet_replica.cc:330] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:57.795496 11370 raft_consensus.cc:2229] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.795841 11370 raft_consensus.cc:2258] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.796662 11370 ts_tablet_manager.cc:1905] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.810879 12131 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:57.819741 11362 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.820106 11362 ts_tablet_manager.cc:1397] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.005s
I20260811 06:16:57.821408 11362 raft_consensus.cc:348] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.821784 11362 raft_consensus.cc:374] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.822007 11362 raft_consensus.cc:729] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.822695 11362 consensus_queue.cc:260] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.824827 11362 ts_tablet_manager.cc:1428] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:16:57.825263 11362 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.827178 11365 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.827382 11365 ts_tablet_manager.cc:1397] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.010s
I20260811 06:16:57.828542 11365 raft_consensus.cc:348] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:57.828915 11365 raft_consensus.cc:374] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.829100 11365 raft_consensus.cc:729] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.829391 11365 consensus_queue.cc:260] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:57.835111 11365 ts_tablet_manager.cc:1428] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260811 06:16:57.836328 11362 tablet_bootstrap.cc:654] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.842438 11365 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.844940 11365 tablet_bootstrap.cc:654] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.850713 12141 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:57.851251 11361 tablet_bootstrap.cc:492] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:57.851590 11361 ts_tablet_manager.cc:1397] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.139s user 0.002s sys 0.007s
I20260811 06:16:57.852845 11361 raft_consensus.cc:348] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.856966 11361 raft_consensus.cc:374] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.857323 11361 raft_consensus.cc:729] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.851110 12141 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:57.860966 11361 consensus_queue.cc:260] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.862260 11361 ts_tablet_manager.cc:1428] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260811 06:16:57.865020 11361 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:57.869391 11361 tablet_bootstrap.cc:654] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.871439 11362 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.871826 11362 ts_tablet_manager.cc:1397] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.003s
I20260811 06:16:57.872797 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 4 candidate_status { last_received { term: 3 index: 569 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:16:57.873135 10114 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a36d6d06a0cb4489b5014178b9973219 in term 3.
I20260811 06:16:57.873091 12141 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:57.873240 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 4 candidate_status { last_received { term: 3 index: 564 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:16:57.873729 11584 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219; no voters:
I20260811 06:16:57.874155 11362 raft_consensus.cc:348] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.874660 11362 raft_consensus.cc:374] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.874879 11365 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.874884 11362 raft_consensus.cc:729] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.875093 11365 ts_tablet_manager.cc:1397] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.005s
I20260811 06:16:57.875455 11362 consensus_queue.cc:260] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.876216 11365 raft_consensus.cc:348] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.876572 11365 raft_consensus.cc:374] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.876710 11715 raft_consensus.cc:2396] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ff4bfd7a38d4d999137c09f50fe4c57 for term 4 because replica has last-logged OpId of term: 3 index: 569, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 564.
I20260811 06:16:57.876703 11365 raft_consensus.cc:729] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.877403 12141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260811 06:16:57.877969 12141 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29fb239be50c4171bdbc75e064555197)
I20260811 06:16:57.878239 12141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 3 FOLLOWER]: Advancing to term 4
I20260811 06:16:57.880173 11362 ts_tablet_manager.cc:1428] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260811 06:16:57.877032 11365 consensus_queue.cc:260] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.880918 11362 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.883860 10925 raft_consensus.cc:2454] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:57.886379 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 280) took 3766 ms. Trace:
I20260811 06:16:57.887977 11368 rpcz_store.cc:276] 0811 06:16:54.119637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.119694 (+ 57us) service_pool.cc:227] Handling call
0811 06:16:57.324742 (+3205048us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:16:57.324757 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.583382 (+258625us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.691789 (+108407us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.886334 (+194545us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3201561}
W20260811 06:16:57.888461 10871 consensus_meta.cc:287] T e8dfa9eb84334e9e86434aa2d9593efd P 56a371f7ed104f68a5db9ca097eb237e: Time spent flushing consensus metadata: real 0.507s user 0.005s sys 0.001s
I20260811 06:16:57.888782 10662 raft_consensus.cc:2454] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:57.889511 11365 ts_tablet_manager.cc:1428] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260811 06:16:57.889518 11047 leader_election.cc:302] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:57.893891 12016 raft_consensus.cc:2781] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:57.892026 12118 raft_consensus.cc:482] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.894788 10810 leader_election.cc:302] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:57.895438 12059 raft_consensus.cc:2781] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:57.896245 12059 raft_consensus.cc:686] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:57.896626 12059 consensus_queue.cc:237] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.894918 12118 raft_consensus.cc:504] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:57.897146 11365 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.899996 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 290) took 3491 ms. Trace:
I20260811 06:16:57.900352 11368 rpcz_store.cc:276] 0811 06:16:54.407564 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.414379 (+ 6815us) service_pool.cc:227] Handling call
0811 06:16:57.888266 (+3473887us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:16:57.889307 (+ 1041us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.899349 (+ 10042us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3473562}
I20260811 06:16:57.900758 11368 tablet_replica.cc:330] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:57.901182 11368 raft_consensus.cc:2229] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:57.901451 11368 raft_consensus.cc:2258] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:57.884052 11362 tablet_bootstrap.cc:654] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.902261 11365 tablet_bootstrap.cc:654] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.902675 11368 ts_tablet_manager.cc:1905] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:57.902912 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:57.903492 12118 leader_election.cc:288] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:57.903940 10555 leader_election.cc:341] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.911442 12016 raft_consensus.cc:686] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:57.912391 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:57.913388 10564 leader_election.cc:341] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:57.914001 11961 raft_consensus.cc:482] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:57.914227 11961 raft_consensus.cc:504] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.914744 10564 leader_election.cc:302] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:57.915094 12118 raft_consensus.cc:2726] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:57.914003 12016 consensus_queue.cc:237] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.918174 11961 leader_election.cc:288] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:57.918079 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a00b0b51f574bfb843b65c0876ab4fc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:57.918463 10925 raft_consensus.cc:2454] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:57.920086 11046 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:16:57.920902 11047 leader_election.cc:302] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:57.921630 12094 raft_consensus.cc:2781] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:57.921900 12094 raft_consensus.cc:482] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:57.922130 12094 raft_consensus.cc:3037] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:57.930454 12094 raft_consensus.cc:504] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.931908 12094 leader_election.cc:288] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:57.935123 11371 ts_tablet_manager.cc:1918] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:57.935451 11371 log.cc:1196] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/0bbf657cb27f4da9a4f595242864163a
I20260811 06:16:57.935981 11371 ts_tablet_manager.cc:1939] T 0bbf657cb27f4da9a4f595242864163a P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:16:57.938437 11046 leader_election.cc:341] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:16:57.938922 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a00b0b51f574bfb843b65c0876ab4fc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:57.939350 10925 raft_consensus.cc:3037] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:57.943761 12141 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:57.945358 12141 leader_election.cc:288] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 election: Requested vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:16:57.947065 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a36d6d06a0cb4489b5014178b9973219" candidate_term: 4 candidate_status { last_received { term: 3 index: 569 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57"
I20260811 06:16:57.947420 10114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 3 FOLLOWER]: Advancing to term 4
I20260811 06:16:57.951431 11362 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.951875 11362 ts_tablet_manager.cc:1397] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.010s
I20260811 06:16:57.953307 11362 raft_consensus.cc:348] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.953689 11362 raft_consensus.cc:374] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.953970 11362 raft_consensus.cc:729] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.954394 11362 consensus_queue.cc:260] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.957154 11362 ts_tablet_manager.cc:1428] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260811 06:16:57.958046 11362 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.965886 11365 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:57.966166 11365 ts_tablet_manager.cc:1397] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.004s
I20260811 06:16:57.967702 11365 raft_consensus.cc:348] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.968102 11365 raft_consensus.cc:374] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.968343 11365 raft_consensus.cc:729] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.968783 11365 consensus_queue.cc:260] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.970368 11362 tablet_bootstrap.cc:654] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.971720 11361 tablet_bootstrap.cc:492] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:57.972064 11361 ts_tablet_manager.cc:1397] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.007s
I20260811 06:16:57.974357 11361 raft_consensus.cc:348] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.974987 11361 raft_consensus.cc:374] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.975129 11361 raft_consensus.cc:729] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.977685 11361 consensus_queue.cc:260] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.981341 11361 ts_tablet_manager.cc:1428] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20260811 06:16:57.982033 11365 ts_tablet_manager.cc:1428] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260811 06:16:57.984061 11361 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:57.986919 11362 tablet_bootstrap.cc:492] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:57.987344 11362 ts_tablet_manager.cc:1397] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.008s
I20260811 06:16:57.988760 11362 raft_consensus.cc:348] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.989235 11362 raft_consensus.cc:374] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:57.989399 11362 raft_consensus.cc:729] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:57.989841 11362 consensus_queue.cc:260] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:57.992033 11362 ts_tablet_manager.cc:1428] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 06:16:57.992601 11362 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:57.994000 11365 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:57.995903 11362 tablet_bootstrap.cc:654] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.008064 11361 tablet_bootstrap.cc:654] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:57.996989 11365 tablet_bootstrap.cc:654] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.010414 11362 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.010654 11362 ts_tablet_manager.cc:1397] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20260811 06:16:58.011620 11362 raft_consensus.cc:348] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.011984 11362 raft_consensus.cc:374] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.012122 11362 raft_consensus.cc:729] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.012432 11362 consensus_queue.cc:260] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.015213 11362 ts_tablet_manager.cc:1428] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 06:16:58.015587 11362 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.017593 11362 tablet_bootstrap.cc:654] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.026997 11361 tablet_bootstrap.cc:492] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.027275 11361 ts_tablet_manager.cc:1397] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.004s
I20260811 06:16:58.028772 11361 raft_consensus.cc:348] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.029203 11361 raft_consensus.cc:374] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.029441 11361 raft_consensus.cc:729] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.029984 11361 consensus_queue.cc:260] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.032477 11368 ts_tablet_manager.cc:1918] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.032480 10114 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a36d6d06a0cb4489b5014178b9973219 in term 4.
I20260811 06:16:58.033084 11370 ts_tablet_manager.cc:1918] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.033349 11370 log.cc:1196] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/cd7390a2221f4a1b9948c8a1353e4a49
I20260811 06:16:58.033473 11368 log.cc:1196] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:58.034144 11368 ts_tablet_manager.cc:1939] T c00b6bdfc8ac4b5db81de9f614fcf213 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.034499 11362 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.034960 11362 ts_tablet_manager.cc:1397] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260811 06:16:58.035099 11370 ts_tablet_manager.cc:1939] T cd7390a2221f4a1b9948c8a1353e4a49 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.035800 11361 ts_tablet_manager.cc:1428] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.000s sys 0.004s
I20260811 06:16:58.037415 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 235) took 5205 ms. Trace:
I20260811 06:16:58.037611 11370 rpcz_store.cc:276] 0811 06:16:52.831948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.832158 (+ 210us) service_pool.cc:227] Handling call
0811 06:16:57.794931 (+4962773us) ts_tablet_manager.cc:1145] Deleting tablet cd7390a2221f4a1b9948c8a1353e4a49
0811 06:16:57.794942 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.884016 (+ 89074us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.032960 (+148944us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.037283 (+ 4323us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4953807}
I20260811 06:16:58.038457 11584 leader_election.cc:302] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219; no voters:
I20260811 06:16:58.039068 12141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 4 FOLLOWER]: Leader election won for term 4
I20260811 06:16:58.039980 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 234) took 5208 ms. Trace:
I20260811 06:16:58.040181 11370 rpcz_store.cc:276] 0811 06:16:52.830987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:52.831184 (+ 197us) service_pool.cc:227] Handling call
0811 06:16:58.039580 (+5208396us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:16:58.039593 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.039793 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5195930}
I20260811 06:16:58.040723 11365 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.037251 11362 raft_consensus.cc:348] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.041234 11365 ts_tablet_manager.cc:1397] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.006s
I20260811 06:16:58.041744 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 238) took 4870 ms. Trace:
I20260811 06:16:58.044654 10925 raft_consensus.cc:2454] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:58.045115 11370 rpcz_store.cc:276] 0811 06:16:53.170769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.171181 (+ 412us) service_pool.cc:227] Handling call
0811 06:16:58.041400 (+4870219us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:16:58.041412 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.041560 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4838731}
I20260811 06:16:58.045459 11047 leader_election.cc:302] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.045915 12141 raft_consensus.cc:686] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 4 LEADER]: Becoming Leader. State: Replica: a36d6d06a0cb4489b5014178b9973219, State: Running, Role: LEADER
I20260811 06:16:58.046190 11961 raft_consensus.cc:2781] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.046499 11961 raft_consensus.cc:686] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:58.046820 12141 consensus_queue.cc:237] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 569, Committed index: 569, Last appended: 3.569, Last appended by leader: 569, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:16:58.046867 11961 consensus_queue.cc:237] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.044710 11361 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.049283 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 289) took 3681 ms. Trace:
I20260811 06:16:58.049527 11368 rpcz_store.cc:276] 0811 06:16:54.363921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.390081 (+ 26160us) service_pool.cc:227] Handling call
0811 06:16:57.900656 (+3510575us) ts_tablet_manager.cc:1145] Deleting tablet c00b6bdfc8ac4b5db81de9f614fcf213
0811 06:16:57.900669 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.932308 (+ 31639us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.032326 (+100018us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.044848 (+ 12522us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3483618}
I20260811 06:16:58.051012 11370 tablet_replica.cc:330] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.051337 11370 raft_consensus.cc:2229] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.051942 11370 raft_consensus.cc:2258] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.052366 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 386) took 1269 ms. Trace:
I20260811 06:16:58.052742 11371 rpcz_store.cc:276] 0811 06:16:56.772612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.772701 (+ 89us) service_pool.cc:227] Handling call
0811 06:16:57.778006 (+1005305us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:16:57.778019 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:57.881919 (+103900us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:57.934873 (+ 52954us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.041581 (+106708us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1004914}
I20260811 06:16:58.052906 12059 raft_consensus.cc:482] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.053143 12059 raft_consensus.cc:504] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.053514 11370 ts_tablet_manager.cc:1905] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.054147 12059 leader_election.cc:288] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.054585 11368 tablet_replica.cc:330] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.054885 11368 raft_consensus.cc:2229] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:58.055042 11365 raft_consensus.cc:348] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.055444 11368 pending_rounds.cc:62] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:16:58.055603 11368 pending_rounds.cc:68] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213246524022784 op_type: NO_OP noop_request { }
I20260811 06:16:58.055697 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864c3bbf1e004579a4d0be809f83ca33" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.055809 11362 raft_consensus.cc:374] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.056057 11368 raft_consensus.cc:2866] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:58.056434 11368 raft_consensus.cc:2258] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.056526 11365 raft_consensus.cc:374] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.056711 11365 raft_consensus.cc:729] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.056228 12118 raft_consensus.cc:482] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.057386 11362 raft_consensus.cc:729] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.057289 12118 raft_consensus.cc:504] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.057315 11365 consensus_queue.cc:260] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.058192 11368 ts_tablet_manager.cc:1905] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.058612 11362 consensus_queue.cc:260] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.059330 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1e42440ff14857b297621ca6031835" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.059696 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1e42440ff14857b297621ca6031835" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.060179 11362 ts_tablet_manager.cc:1428] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.025s user 0.001s sys 0.002s
I20260811 06:16:58.060956 12118 leader_election.cc:288] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:58.060880 10813 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.061705 10810 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 864c3bbf1e004579a4d0be809f83ca33
I20260811 06:16:58.064786 11362 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.065261 10810 leader_election.cc:302] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.066814 12059 raft_consensus.cc:2726] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.068503 11362 tablet_bootstrap.cc:654] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.070421 11361 tablet_bootstrap.cc:654] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.050141 12164 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36d6d06a0cb4489b5014178b9973219. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:58.074189 12164 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:58.074790 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 402) took 1053 ms. Trace:
I20260811 06:16:58.074949 11365 ts_tablet_manager.cc:1428] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20260811 06:16:58.075034 11371 rpcz_store.cc:276] 0811 06:16:57.007917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.008247 (+ 330us) service_pool.cc:227] Handling call
0811 06:16:58.053107 (+1044860us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:16:58.061111 (+ 8004us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.061297 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035855}
W20260811 06:16:58.075484 10564 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.075947 10555 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.077478 11365 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.077877 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 406) took 1005 ms. Trace:
I20260811 06:16:58.077999 12168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 06:16:58.078168 11371 rpcz_store.cc:276] 0811 06:16:57.072292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.078466 (+ 6174us) service_pool.cc:227] Handling call
0811 06:16:58.075385 (+996919us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:16:58.077255 (+ 1870us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.077521 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":996425}
I20260811 06:16:58.078963 10555 leader_election.cc:302] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.081156 12118 raft_consensus.cc:2726] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.081318 11365 tablet_bootstrap.cc:654] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.082574 11371 tablet_replica.cc:330] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:58.082945 11371 raft_consensus.cc:2229] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.083392 11371 raft_consensus.cc:2258] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.083530 11961 raft_consensus.cc:482] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.083788 11961 raft_consensus.cc:504] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.084290 11371 ts_tablet_manager.cc:1905] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.085611 11961 leader_election.cc:288] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:58.086238 11046 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:16:58.090719 12118 raft_consensus.cc:482] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.090962 12118 raft_consensus.cc:504] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.091434 11961 raft_consensus.cc:482] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.091934 12118 leader_election.cc:288] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.091727 11961 raft_consensus.cc:504] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.093040 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:58.093876 10564 leader_election.cc:341] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.094745 11046 leader_election.cc:341] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588
W20260811 06:16:58.095130 11047 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:16:58.095299 11961 leader_election.cc:288] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.095499 11047 leader_election.cc:302] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:58.096401 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.096813 11961 raft_consensus.cc:2726] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:16:58.098115 10555 leader_election.cc:341] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.098416 10555 leader_election.cc:302] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:58.099529 11046 consensus_peers.cc:487] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:58.099699 12118 raft_consensus.cc:2726] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.101114 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f458dba9444bfa8841a84cdb798588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.101760 10925 raft_consensus.cc:2454] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:58.102514 11047 leader_election.cc:302] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.102949 11961 raft_consensus.cc:2781] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.103219 11961 raft_consensus.cc:482] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.103457 11961 raft_consensus.cc:3037] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.110918 11361 tablet_bootstrap.cc:492] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.111253 11361 ts_tablet_manager.cc:1397] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.006s
I20260811 06:16:58.111304 11365 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.111537 11365 ts_tablet_manager.cc:1397] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.003s
I20260811 06:16:58.112681 11361 raft_consensus.cc:348] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.112867 11365 raft_consensus.cc:348] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.113184 11361 raft_consensus.cc:374] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.113241 11365 raft_consensus.cc:374] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.113353 11361 raft_consensus.cc:729] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.113546 11365 raft_consensus.cc:729] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.113828 11361 consensus_queue.cc:260] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.113991 11365 consensus_queue.cc:260] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.114890 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]
I20260811 06:16:58.115062 11365 ts_tablet_manager.cc:1428] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:58.115427 11365 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.123037 11361 ts_tablet_manager.cc:1428] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.012s user 0.000s sys 0.003s
I20260811 06:16:58.123683 11361 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.124122 12118 raft_consensus.cc:482] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.124390 12118 raft_consensus.cc:504] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.126461 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.126865 12118 leader_election.cc:288] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.126943 11361 tablet_bootstrap.cc:654] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:58.127348 10564 leader_election.cc:341] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.127862 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.128698 10555 leader_election.cc:341] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.128991 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1a6ec07940654e19aa7ab999ba7462cb [id=059f7292deab4fbcb4ba097aa1737fbe]
I20260811 06:16:58.128978 10555 leader_election.cc:302] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.129640 12118 raft_consensus.cc:2726] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.130103 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_41e1f2dfdfa04338a8cecda87d649f86 [id=06b4ac61ca8a41f788cc0949b6991ce2]
I20260811 06:16:58.130977 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]
I20260811 06:16:58.132004 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_99ba61ba26854472b2956b8a4f61302b [id=0752fbfa69b24536ad4677ffe00d4032]
I20260811 06:16:58.132900 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]
I20260811 06:16:58.133451 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743]
I20260811 06:16:58.134294 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_987b68deeac64dd1b9aad386fc6ffaff [id=09583b2d1b314b72bb2511f52d0a0eae]
I20260811 06:16:58.138090 11365 tablet_bootstrap.cc:654] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.140492 11368 ts_tablet_manager.cc:1918] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.140813 11368 log.cc:1196] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a378a6f20c564eb685b655a762b638ae
I20260811 06:16:58.140849 11961 raft_consensus.cc:504] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.141549 11368 ts_tablet_manager.cc:1939] T a378a6f20c564eb685b655a762b638ae P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.142027 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]
I20260811 06:16:58.142109 11961 leader_election.cc:288] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.142716 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67f458dba9444bfa8841a84cdb798588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.143131 10925 raft_consensus.cc:3037] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.143788 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d6b851b238cc407c91a9e72f70ac3b5a [id=0f76cb2b3f154167b4fa6a056cdf6fc3]
I20260811 06:16:58.144826 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]
I20260811 06:16:58.146661 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_317717a9da1a41028e46bcebb073c694 [id=0fb1742233f640a8a51ca49d6be5191c]
I20260811 06:16:58.147470 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_af483278f0004121a846ca38bec9d8d8 [id=101a0c8ac67443e8925b8770d0d105e2]
I20260811 06:16:58.148558 11362 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.148854 11362 ts_tablet_manager.cc:1397] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.010s
I20260811 06:16:58.148610 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]
I20260811 06:16:58.149968 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c5d51bfe8d4f4ac084ad0692d3c334be [id=12b005d427d949009b95d8f8a203e5c3]
I20260811 06:16:58.151929 11361 tablet_bootstrap.cc:492] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.152261 11361 ts_tablet_manager.cc:1397] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.012s
I20260811 06:16:58.150943 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]
I20260811 06:16:58.153930 11361 raft_consensus.cc:348] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.154439 11361 raft_consensus.cc:374] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.154734 11361 raft_consensus.cc:729] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:16:58.154776 11046 leader_election.cc:341] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588
I20260811 06:16:58.155179 11361 consensus_queue.cc:260] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.157708 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e37a4f07d9434d77a1a6ec7dfe022355 [id=1b9f2c3cb4854a7184b662f5ff2bad55]
I20260811 06:16:58.157954 11362 raft_consensus.cc:348] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.158326 11362 raft_consensus.cc:374] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.158587 11362 raft_consensus.cc:729] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.158634 11361 ts_tablet_manager.cc:1428] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260811 06:16:58.158978 11362 consensus_queue.cc:260] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.162860 11362 ts_tablet_manager.cc:1428] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260811 06:16:58.163211 11362 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.163307 11365 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.163671 11365 ts_tablet_manager.cc:1397] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.005s
I20260811 06:16:58.165025 11365 raft_consensus.cc:348] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.165565 11365 raft_consensus.cc:374] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.165763 11365 raft_consensus.cc:729] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.166239 11365 consensus_queue.cc:260] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.167956 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]
I20260811 06:16:58.168437 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]
I20260811 06:16:58.168519 11365 ts_tablet_manager.cc:1428] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:16:58.168944 11361 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.170696 11362 tablet_bootstrap.cc:654] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.168984 11365 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.174875 11361 tablet_bootstrap.cc:654] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.179867 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016]
I20260811 06:16:58.183667 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]
I20260811 06:16:58.187160 11365 tablet_bootstrap.cc:654] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.192782 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4f975881a087493596aaab9db2522ada [id=1fed2747c71345a79e630cd6c7e94aac]
I20260811 06:16:58.195976 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b79dca0f63044a20901e066a9c52d07f [id=258a0da1203e4162b4d2f87e9f0e3c32]
I20260811 06:16:58.197734 11362 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.197948 11362 ts_tablet_manager.cc:1397] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.002s
I20260811 06:16:58.198819 11362 raft_consensus.cc:348] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.199100 11362 raft_consensus.cc:374] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.199191 11362 raft_consensus.cc:729] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.199471 11362 consensus_queue.cc:260] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.200063 11362 ts_tablet_manager.cc:1428] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:58.200389 11362 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.203025 11362 tablet_bootstrap.cc:654] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.206279 11361 tablet_bootstrap.cc:492] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.206631 11361 ts_tablet_manager.cc:1397] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.002s
I20260811 06:16:58.208169 11361 raft_consensus.cc:348] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.208561 11361 raft_consensus.cc:374] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.208690 11361 raft_consensus.cc:729] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.208977 11365 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.209095 11361 consensus_queue.cc:260] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.209281 11365 ts_tablet_manager.cc:1397] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.003s
I20260811 06:16:58.209548 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ef3697835c0e4cedbb64c0a58636d94b [id=2b588f0344cf48d5a6debfc5f8c53f05]
I20260811 06:16:58.210472 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_373a8a768dcc4de9bffd2c2488b003de [id=2b620a8250214aa2997083b1ab297b70]
I20260811 06:16:58.210721 11365 raft_consensus.cc:348] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.211103 11365 raft_consensus.cc:374] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.210788 11361 ts_tablet_manager.cc:1428] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 06:16:58.211315 11365 raft_consensus.cc:729] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.211730 11361 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.211856 11365 consensus_queue.cc:260] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.212610 11365 ts_tablet_manager.cc:1428] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:16:58.216496 11361 tablet_bootstrap.cc:654] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.217945 11365 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.224598 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd [id=2c17310139a841fab9f7e4aaed39cc98]
I20260811 06:16:58.225281 11961 consensus_queue.cc:1035] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:58.228199 11365 tablet_bootstrap.cc:654] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.229750 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_12c813de7c074af4a5f244b7b9c3d9aa [id=2ede34034a9a4280840d8e8e77773ad2]
I20260811 06:16:58.230908 11362 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.230998 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 291) took 3801 ms. Trace:
I20260811 06:16:58.231202 11368 rpcz_store.cc:276] 0811 06:16:54.429782 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.432491 (+ 2709us) service_pool.cc:227] Handling call
0811 06:16:58.050651 (+3618160us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:16:58.050666 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.135733 (+ 85067us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.140334 (+ 4601us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.230810 (+ 90476us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3617813}
I20260811 06:16:58.231731 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2688b67c9243454f9fe9823b4e9c1318 [id=2f00a94a6f874331b2e6fbce027260bf]
I20260811 06:16:58.232101 11368 tablet_replica.cc:330] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.232439 11368 raft_consensus.cc:2229] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.232988 11368 raft_consensus.cc:2258] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.233285 11362 ts_tablet_manager.cc:1397] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20260811 06:16:58.234036 11368 ts_tablet_manager.cc:1905] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.234802 10925 raft_consensus.cc:2454] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:58.234961 11371 ts_tablet_manager.cc:1918] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.235035 11370 ts_tablet_manager.cc:1918] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.235262 11370 log.cc:1196] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e7d44fa2df924751a4835821901b56de
I20260811 06:16:58.235241 11371 log.cc:1196] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ae1e42440ff14857b297621ca6031835
I20260811 06:16:58.235584 11047 leader_election.cc:302] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.235975 11370 ts_tablet_manager.cc:1939] T e7d44fa2df924751a4835821901b56de P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.236001 11371 ts_tablet_manager.cc:1939] T ae1e42440ff14857b297621ca6031835 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:16:58.236106 11961 raft_consensus.cc:2781] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.236331 11961 raft_consensus.cc:686] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:58.236877 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 412) took 1070 ms. Trace:
I20260811 06:16:58.236918 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 239) took 5051 ms. Trace:
I20260811 06:16:58.236699 11961 consensus_queue.cc:237] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.237075 11371 rpcz_store.cc:276] 0811 06:16:57.166513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.167293 (+ 780us) service_pool.cc:227] Handling call
0811 06:16:58.082337 (+915044us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:16:58.082346 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.137941 (+ 55595us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.234778 (+ 96837us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.236838 (+ 2060us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":914715}
I20260811 06:16:58.237390 11370 rpcz_store.cc:276] 0811 06:16:53.185581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.185959 (+ 378us) service_pool.cc:227] Handling call
0811 06:16:58.050772 (+4864813us) ts_tablet_manager.cc:1145] Deleting tablet e7d44fa2df924751a4835821901b56de
0811 06:16:58.050782 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.135695 (+ 84913us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.234818 (+ 99123us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.236813 (+ 1995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4847666}
I20260811 06:16:58.237689 11371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38572 (request call id 411) took 1089 ms. Trace:
I20260811 06:16:58.237957 11371 rpcz_store.cc:276] 0811 06:16:57.147808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.149611 (+ 1803us) service_pool.cc:227] Handling call
0811 06:16:58.237380 (+1087769us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:16:58.237392 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.237581 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053820}
I20260811 06:16:58.238273 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 240) took 5052 ms. Trace:
I20260811 06:16:58.238672 11362 raft_consensus.cc:348] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.238997 11362 raft_consensus.cc:374] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.238924 11370 rpcz_store.cc:276] 0811 06:16:53.185772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.186284 (+ 512us) service_pool.cc:227] Handling call
0811 06:16:58.237682 (+5051398us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:16:58.237695 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.238150 (+ 455us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5034520}
I20260811 06:16:58.239244 11362 raft_consensus.cc:729] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.239626 11362 consensus_queue.cc:260] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.240680 11362 ts_tablet_manager.cc:1428] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260811 06:16:58.241113 11362 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.241705 11361 tablet_bootstrap.cc:492] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.241887 11361 ts_tablet_manager.cc:1397] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.004s
I20260811 06:16:58.242921 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 241) took 5054 ms. Trace:
I20260811 06:16:58.243259 11370 rpcz_store.cc:276] 0811 06:16:53.185896 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.186648 (+ 752us) service_pool.cc:227] Handling call
0811 06:16:58.240021 (+5053373us) ts_tablet_manager.cc:1145] Deleting tablet ea4eb7f5db2e4e75818bfb228b64ed0d
0811 06:16:58.240033 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.240140 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5036822}
I20260811 06:16:58.243587 11361 raft_consensus.cc:348] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.244058 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 242) took 5053 ms. Trace:
I20260811 06:16:58.244325 11370 rpcz_store.cc:276] 0811 06:16:53.190695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.190756 (+ 61us) service_pool.cc:227] Handling call
0811 06:16:58.243728 (+5052972us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:16:58.243739 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.243954 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5039969}
I20260811 06:16:58.243892 11361 raft_consensus.cc:374] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.244774 11361 raft_consensus.cc:729] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.245085 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 237) took 5075 ms. Trace:
I20260811 06:16:58.245399 11370 rpcz_store.cc:276] 0811 06:16:53.169926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.200709 (+ 30783us) service_pool.cc:227] Handling call
0811 06:16:58.244841 (+5044132us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:16:58.244850 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.244976 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5040517}
I20260811 06:16:58.245628 11361 consensus_queue.cc:260] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.246994 11370 tablet_replica.cc:330] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.247267 11361 ts_tablet_manager.cc:1428] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:16:58.247351 11370 raft_consensus.cc:2229] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:58.247663 11361 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.247813 12021 raft_consensus.cc:482] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.248021 12021 raft_consensus.cc:504] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.249728 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516021603ee24b3f9bdffd1e30e5ea9d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.250248 10925 raft_consensus.cc:2454] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:58.251228 11046 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:58.251560 11047 leader_election.cc:302] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.252161 12094 raft_consensus.cc:2781] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.252362 12094 raft_consensus.cc:482] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.252578 12021 leader_election.cc:288] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:58.252959 12094 raft_consensus.cc:3037] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.253445 11362 tablet_bootstrap.cc:654] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.254410 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_0a7428e94c2a44059b7d8c83ce698701 [id=30b28c4b8cdd49589b876d657179b2b1]
I20260811 06:16:58.256134 12118 raft_consensus.cc:482] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.256418 12118 raft_consensus.cc:504] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:58.257474 12118 leader_election.cc:288] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.257825 11370 pending_rounds.cc:62] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:58.258054 11370 pending_rounds.cc:68] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213240480649216 op_type: NO_OP noop_request { }
I20260811 06:16:58.258296 11370 raft_consensus.cc:2866] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:58.258630 11370 raft_consensus.cc:2258] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.258756 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]
I20260811 06:16:58.258853 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.259306 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]
I20260811 06:16:58.259508 11370 ts_tablet_manager.cc:1905] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:58.260236 10564 leader_election.cc:341] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.260047 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.260941 10555 leader_election.cc:341] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.261217 10555 leader_election.cc:302] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.261801 12118 raft_consensus.cc:2726] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.261809 11365 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.262833 11365 ts_tablet_manager.cc:1397] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.004s
I20260811 06:16:58.264883 11365 raft_consensus.cc:348] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.265391 11365 raft_consensus.cc:374] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.265586 11365 raft_consensus.cc:729] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.268066 11365 consensus_queue.cc:260] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.271410 11361 tablet_bootstrap.cc:654] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.277696 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_03a56dbcc387459a9a6ae4fdfb454c6a [id=32c58f06cf094acdac22d9ca6fe36811]
I20260811 06:16:58.278575 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]
I20260811 06:16:58.280529 11365 ts_tablet_manager.cc:1428] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260811 06:16:58.281077 11365 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.282748 11361 tablet_bootstrap.cc:492] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.283089 11361 ts_tablet_manager.cc:1397] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.000s
W20260811 06:16:58.284299 10310 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4ed851746ef4861a624940952796a37 consensus state has no leader
I20260811 06:16:58.284449 11361 raft_consensus.cc:348] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.284866 11361 raft_consensus.cc:374] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.285254 11361 raft_consensus.cc:729] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.285748 11361 consensus_queue.cc:260] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.288396 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet c5efe8eb16e84575abd18a5079aad2c9 (table default.Table_59bc917bf1c440c6a607b0727ef3a8ff [id=4a189ec6459341a6b50dc5c1d28bd101]) successfully deleted
I20260811 06:16:58.290606 11361 ts_tablet_manager.cc:1428] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s
W20260811 06:16:58.290596 10309 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f9fd17e8c6264f898493c15b0aa5518d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9fd17e8c6264f898493c15b0aa5518d already in progress: creating tablet
I20260811 06:16:58.291217 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet c00b6bdfc8ac4b5db81de9f614fcf213 (table default.Table_c94c766b75e749a7bf08f8b110567bf6 [id=93e85671b313459588f530b2d88ef20e]) successfully deleted
I20260811 06:16:58.291690 10309 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a378a6f20c564eb685b655a762b638ae (table default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]) successfully deleted
I20260811 06:16:58.291751 11361 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.296226 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]
I20260811 06:16:58.296957 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ae32a31bc8f64e96a549037c0d65f64e [id=3577c42e6da543858c4f923ca3694893]
I20260811 06:16:58.297542 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]
I20260811 06:16:58.304364 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]
I20260811 06:16:58.305707 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ab1832782184476f9e838bca820e45e5 [id=395d4cbde0114d879ead277a47184ce6]
I20260811 06:16:58.306325 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]
I20260811 06:16:58.307408 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4530e0ff64ae41b8a453e4be20673822 [id=3c39ffa2022447068fcc6f6f551a38a6]
I20260811 06:16:58.308377 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_60f9ff39184a401d92a346f88abbd7e3 [id=3d036ef0c0fb497ba15fe0468f792eab]
I20260811 06:16:58.313956 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]
I20260811 06:16:58.315367 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d619bfe299b14454abfe4a31106bb81d [id=426356f4c6f6426ab91d0dd3cd349304]
I20260811 06:16:58.316004 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_04500ce2ab80444b9cafeaa864c9e65c [id=43248d68796b43e8b16d7ab6ce8f5507]
I20260811 06:16:58.316576 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34]
I20260811 06:16:58.319259 10307 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e180cc2c38aa4a78897e264276e4c766 (table default.Table_7f5293da6027442190e67927b3957712 [id=3ce3acb19d6b45ea8d81a47f1f35de2c]) successfully deleted
I20260811 06:16:58.320300 10349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 4 candidate_status { last_received { term: 3 index: 564 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
W20260811 06:16:58.321064 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
W20260811 06:16:58.321589 10393 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:37884 (request call id 38) took 995 ms (client timeout 1000 ms). Trace:
I20260811 06:16:58.323452 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]
I20260811 06:16:58.324101 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]
I20260811 06:16:58.322700 10331 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37928:
table { table_name: "default.Table_ae798943d2514f6488c7ae50b11ef679" } modify_external_catalogs: true
I20260811 06:16:58.324611 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e1d6c05437784e07a5b7deefec230ae5 [id=47be197bbc8f46ea88c0436869954992]
W20260811 06:16:58.325018 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:16:58.325407 10307 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:16:58.325219 10393 rpcz_store.cc:269] 0811 06:16:57.325282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.325770 (+ 488us) service_pool.cc:227] Handling call
0811 06:16:58.320305 (+994535us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 06:16:58.325919 10029 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu pid 10273: Timed out: CheckLeaks RPC to 127.9.203.124:45045 timed out after 1.000s (SENT)
I20260811 06:16:58.326268 10029 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu with pid 10273
I20260811 06:16:58.331871 12118 raft_consensus.cc:482] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.332223 12118 raft_consensus.cc:504] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.324961 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 [id=485faa9398f8447398dbdc64b6ef2167]
I20260811 06:16:58.335556 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]
I20260811 06:16:58.339094 11365 tablet_bootstrap.cc:654] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.340338 11368 ts_tablet_manager.cc:1918] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.340649 11368 log.cc:1196] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/cdb93dcd940a47e78c5458041c768e36
I20260811 06:16:58.341325 12094 raft_consensus.cc:504] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.342756 12094 leader_election.cc:288] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:58.343845 11368 ts_tablet_manager.cc:1939] T cdb93dcd940a47e78c5458041c768e36 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.344188 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb93dcd940a47e78c5458041c768e36" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.344188 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516021603ee24b3f9bdffd1e30e5ea9d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.344681 10915 raft_consensus.cc:3037] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.352223 11960 raft_consensus.cc:482] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.352442 11960 raft_consensus.cc:504] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.353145 11960 leader_election.cc:288] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.354604 10810 leader_election.cc:341] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 16674be53bd54f9395b650e19edd3cf4
I20260811 06:16:58.344709 11362 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.355496 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16674be53bd54f9395b650e19edd3cf4" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.355649 11362 ts_tablet_manager.cc:1397] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.115s user 0.015s sys 0.036s
I20260811 06:16:58.355829 11158 raft_consensus.cc:2454] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.356550 10813 leader_election.cc:302] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.356622 11362 raft_consensus.cc:348] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:58.356911 11362 raft_consensus.cc:374] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.356993 11362 raft_consensus.cc:729] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.357223 11362 consensus_queue.cc:260] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:58.357875 11766 raft_consensus.cc:2781] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.357877 11362 ts_tablet_manager.cc:1428] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 06:16:58.358068 11766 raft_consensus.cc:482] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.358183 11766 raft_consensus.cc:3037] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.358317 11362 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.360226 11362 tablet_bootstrap.cc:654] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.362381 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]
I20260811 06:16:58.362898 11361 tablet_bootstrap.cc:654] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.363623 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]
I20260811 06:16:58.365342 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_8baf40088898402196034a63aa016e8b [id=4df7e577a0a9424f95a5009e534db476]
I20260811 06:16:58.365908 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]
I20260811 06:16:58.366441 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2418f358fbab49a585c61348c4764570 [id=51128de8177d416cad485dbe668152ab]
I20260811 06:16:58.366870 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]
I20260811 06:16:58.370352 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_525aee396dc64b5c8c61da99ad866f4a [id=53bd4127d81e4fb092a5943858c8ee51]
I20260811 06:16:58.370827 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 [id=54ed6f7aa1874e0897b2b8583bc6f57d]
I20260811 06:16:58.371541 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]
I20260811 06:16:58.371637 12021 raft_consensus.cc:482] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.371834 12021 raft_consensus.cc:504] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.372467 12118 leader_election.cc:288] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.372545 12021 leader_election.cc:288] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.374365 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.374712 10662 raft_consensus.cc:2379] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:16:58.375105 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb93dcd940a47e78c5458041c768e36" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:58.375905 10564 leader_election.cc:341] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.376063 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac [id=587929f897ff4559a8fc4f15e4346433]
W20260811 06:16:58.376252 11046 leader_election.cc:341] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:58.376508 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_6a9b87183c994b7d9e7879d511ebfb97 [id=58cc3c5fbc6e41a6acbad99baee36cd5]
I20260811 06:16:58.377077 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_f108c0e6821b45039886e052f9f9dba3 [id=5936fbf06baf4ab0b2e34f9997c81e3b]
I20260811 06:16:58.378119 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0391df1c64954f66a3987aba9257ca4b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.378340 11361 tablet_bootstrap.cc:492] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.378521 11361 ts_tablet_manager.cc:1397] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.004s
I20260811 06:16:58.379431 11361 raft_consensus.cc:348] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.379686 11361 raft_consensus.cc:374] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.379802 11361 raft_consensus.cc:729] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.380082 11361 consensus_queue.cc:260] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.380805 11361 ts_tablet_manager.cc:1428] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 06:16:58.381132 11361 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.387446 11362 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.389088 11362 ts_tablet_manager.cc:1397] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.014s
I20260811 06:16:58.389952 11362 raft_consensus.cc:348] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.390187 11362 raft_consensus.cc:374] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.390266 11362 raft_consensus.cc:729] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.390738 11362 consensus_queue.cc:260] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.391301 11362 ts_tablet_manager.cc:1428] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:16:58.391633 11362 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.393400 11362 tablet_bootstrap.cc:654] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.394279 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_f07dfeeb52d64d08811e3b22d8861f62 [id=5ba59e9fdaef4ce389c3495e99dd16e1]
I20260811 06:16:58.394797 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]
I20260811 06:16:58.395530 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]
I20260811 06:16:58.395954 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 [id=5e9aaf8278a7448495ee4e3ada85919c]
I20260811 06:16:58.396327 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]
I20260811 06:16:58.396733 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]
I20260811 06:16:58.397145 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]
I20260811 06:16:58.397524 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_fc4b03d50c57434da608ba22b5e91522 [id=6145f219b330458381821a6aaeb0fa0b]
I20260811 06:16:58.397948 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ae798943d2514f6488c7ae50b11ef679 [id=6265dc35475144bd9f4b3348ed37447a]
I20260811 06:16:58.398573 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]
I20260811 06:16:58.398945 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_5940fa3078de423d855e54ba1af1597a [id=688e4024d52e40dd9e84aa7a08e8f33a]
I20260811 06:16:58.399366 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_897ed62b321f47fb89a724e148c60031 [id=68f45e1274514ff2afe14bbb13d23867]
I20260811 06:16:58.399896 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_6972e78580ee49178a1c6ce6f017dc52 [id=696d50b178d4478d81d03a34a5ede1b4]
I20260811 06:16:58.400305 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]
I20260811 06:16:58.400676 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]
I20260811 06:16:58.401450 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_36da3a35575f40f6874a2055c8fc7faf [id=704fa680cec24a979014dbf21703f12b]
I20260811 06:16:58.401824 11361 tablet_bootstrap.cc:654] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.401861 11047 leader_election.cc:302] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:58.403302 12094 raft_consensus.cc:3037] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.409750 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 292) took 3963 ms. Trace:
I20260811 06:16:58.409935 11368 rpcz_store.cc:276] 0811 06:16:54.446192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.450967 (+ 4775us) service_pool.cc:227] Handling call
0811 06:16:58.231645 (+3780678us) ts_tablet_manager.cc:1145] Deleting tablet cdb93dcd940a47e78c5458041c768e36
0811 06:16:58.231659 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.336549 (+104890us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.340175 (+ 3626us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.409676 (+ 69501us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3780396}
I20260811 06:16:58.410449 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 293) took 3897 ms. Trace:
I20260811 06:16:58.410557 11368 rpcz_store.cc:276] 0811 06:16:54.512940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.513073 (+ 133us) service_pool.cc:227] Handling call
0811 06:16:58.410291 (+3897218us) ts_tablet_manager.cc:1145] Deleting tablet 11c50f909aad4bb991bfdeae8eab8455
0811 06:16:58.410303 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.410408 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3864039}
I20260811 06:16:58.410894 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 310) took 3708 ms. Trace:
I20260811 06:16:58.411001 11368 rpcz_store.cc:276] 0811 06:16:54.702334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.702439 (+ 105us) service_pool.cc:227] Handling call
0811 06:16:58.410753 (+3708314us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:16:58.410762 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.410853 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3683378}
I20260811 06:16:58.411334 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 308) took 3766 ms. Trace:
I20260811 06:16:58.411454 11368 rpcz_store.cc:276] 0811 06:16:54.644463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.644544 (+ 81us) service_pool.cc:227] Handling call
0811 06:16:58.411206 (+3766662us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:16:58.411216 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.411304 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3668030}
I20260811 06:16:58.411752 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 309) took 3711 ms. Trace:
I20260811 06:16:58.411851 11368 rpcz_store.cc:276] 0811 06:16:54.700377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.705672 (+ 5295us) service_pool.cc:227] Handling call
0811 06:16:58.411643 (+3705971us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:16:58.411653 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.411721 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3668176}
I20260811 06:16:58.413060 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 312) took 3686 ms. Trace:
I20260811 06:16:58.413188 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1fb146978bd445a0b62f5c36e9ba593b [id=71a6e6e546cd44e3af189cbf486e121f]
I20260811 06:16:58.413164 11368 rpcz_store.cc:276] 0811 06:16:54.726354 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.726828 (+ 474us) service_pool.cc:227] Handling call
0811 06:16:58.412880 (+3686052us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:16:58.412891 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.413006 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3665571}
I20260811 06:16:58.413496 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 315) took 3399 ms. Trace:
I20260811 06:16:58.413625 11368 rpcz_store.cc:276] 0811 06:16:55.027519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.027615 (+ 96us) service_pool.cc:227] Handling call
0811 06:16:58.413364 (+3385749us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:16:58.413374 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.413465 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3337721}
I20260811 06:16:58.413745 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ae64cada77924676bd6d9731a89a7a6b [id=71b79ba7b26744d99e8d71863b12b5a5]
I20260811 06:16:58.413995 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 316) took 3359 ms. Trace:
I20260811 06:16:58.414098 11368 rpcz_store.cc:276] 0811 06:16:55.054217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.061151 (+ 6934us) service_pool.cc:227] Handling call
0811 06:16:58.413848 (+3352697us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:16:58.413857 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.413961 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3329115}
W20260811 06:16:58.414112 10555 leader_election.cc:341] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:58.414350 11368 tablet_replica.cc:330] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.414348 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_7704cd8b9ad742bd92383ed86acacc8c [id=7457527ea9f143f0a1d5ead22ee5b5d8]
I20260811 06:16:58.414371 10555 leader_election.cc:302] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.414722 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_53cb23e4e85049898ced77eaa6b01e32 [id=7618b959c1824d0882b7e71e27533462]
I20260811 06:16:58.415012 12118 raft_consensus.cc:2726] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.415750 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]
I20260811 06:16:58.416142 11361 tablet_bootstrap.cc:492] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.416155 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]
I20260811 06:16:58.416352 11361 ts_tablet_manager.cc:1397] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.001s
I20260811 06:16:58.416495 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_9a7b04bde68640deb63e6bdbd0f322d9 [id=7b85de4e62004d3bab802b1878b0722e]
I20260811 06:16:58.417073 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_3d5b15230b7540f29a0085d1018944fb [id=7bef46a8e8374c59b811e037981d997f]
I20260811 06:16:58.417253 11361 raft_consensus.cc:348] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.417431 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]
I20260811 06:16:58.417541 11361 raft_consensus.cc:374] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.417630 11361 raft_consensus.cc:729] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.418058 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]
I20260811 06:16:58.417924 11361 consensus_queue.cc:260] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.418542 11361 ts_tablet_manager.cc:1428] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:16:58.418954 11361 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.420873 11361 tablet_bootstrap.cc:654] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.434233 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]
I20260811 06:16:58.435014 11370 ts_tablet_manager.cc:1918] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.435173 11370 log.cc:1196] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/5b681f10c3de4bd798b9d519f10da103
I20260811 06:16:58.435611 11370 ts_tablet_manager.cc:1939] T 5b681f10c3de4bd798b9d519f10da103 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.435885 12094 raft_consensus.cc:2726] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.436873 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 243) took 5177 ms. Trace:
I20260811 06:16:58.437012 11370 rpcz_store.cc:276] 0811 06:16:53.259553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.259660 (+ 107us) service_pool.cc:227] Handling call
0811 06:16:58.246820 (+4987160us) ts_tablet_manager.cc:1145] Deleting tablet 5b681f10c3de4bd798b9d519f10da103
0811 06:16:58.246831 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.342109 (+ 95278us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.434843 (+ 92734us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.436832 (+ 1989us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":4986885}
I20260811 06:16:58.437466 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 257) took 4728 ms. Trace:
I20260811 06:16:58.437566 11370 rpcz_store.cc:276] 0811 06:16:53.709143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.711135 (+ 1992us) service_pool.cc:227] Handling call
0811 06:16:58.437296 (+4726161us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:16:58.437307 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.437436 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4710940}
I20260811 06:16:58.437947 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 254) took 4743 ms. Trace:
I20260811 06:16:58.438054 11370 rpcz_store.cc:276] 0811 06:16:53.694657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.694821 (+ 164us) service_pool.cc:227] Handling call
0811 06:16:58.437805 (+4742984us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:16:58.437816 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.437917 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4711021}
I20260811 06:16:58.438366 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 256) took 4730 ms. Trace:
I20260811 06:16:58.438494 11370 rpcz_store.cc:276] 0811 06:16:53.707558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.708697 (+ 1139us) service_pool.cc:227] Handling call
0811 06:16:58.438242 (+4729545us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:16:58.438251 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.438338 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4660369}
I20260811 06:16:58.438795 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 255) took 4743 ms. Trace:
I20260811 06:16:58.438884 11370 rpcz_store.cc:276] 0811 06:16:53.694948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.703981 (+ 9033us) service_pool.cc:227] Handling call
0811 06:16:58.438685 (+4734704us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:16:58.438694 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.438770 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4656870}
I20260811 06:16:58.439160 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 258) took 4637 ms. Trace:
I20260811 06:16:58.439265 11370 rpcz_store.cc:276] 0811 06:16:53.801483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.801556 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:58.439048 (+4637492us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:16:58.439056 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.439133 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4637063}
I20260811 06:16:58.439639 11370 tablet_replica.cc:330] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.439779 10915 raft_consensus.cc:2454] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:58.439877 11370 raft_consensus.cc:2229] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.440047 11370 pending_rounds.cc:62] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:58.440125 11370 pending_rounds.cc:68] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213245819498496 op_type: NO_OP noop_request { }
I20260811 06:16:58.440272 11370 raft_consensus.cc:2866] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:58.440402 11370 raft_consensus.cc:2258] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.440985 11370 ts_tablet_manager.cc:1905] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.441802 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]
I20260811 06:16:58.442809 11960 raft_consensus.cc:482] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.443001 11960 raft_consensus.cc:504] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.443717 11960 leader_election.cc:288] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.444602 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.444913 10662 raft_consensus.cc:2454] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.445353 11047 leader_election.cc:302] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.446045 12094 raft_consensus.cc:2781] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.446238 12094 raft_consensus.cc:686] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:58.446527 12094 consensus_queue.cc:237] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.447602 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]
I20260811 06:16:58.448304 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d7b23f45b7b14c719f98c5b359db7502 [id=8444a45079b34969a38481a4b00c1352]
I20260811 06:16:58.448427 12118 raft_consensus.cc:482] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.448681 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]
I20260811 06:16:58.448592 12118 raft_consensus.cc:504] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.449019 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]
I20260811 06:16:58.449304 12118 leader_election.cc:288] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.449512 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]
I20260811 06:16:58.450043 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:58.450730 10564 leader_election.cc:341] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.451557 10810 leader_election.cc:302] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:58.451881 12059 raft_consensus.cc:482] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.452052 12059 raft_consensus.cc:504] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.452749 12059 leader_election.cc:288] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.452909 12059 raft_consensus.cc:2781] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.453033 12059 raft_consensus.cc:482] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.453118 12059 raft_consensus.cc:3037] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:58.454394 10810 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a
I20260811 06:16:58.455178 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.455612 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bbf657cb27f4da9a4f595242864163a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.456257 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.456519 11158 raft_consensus.cc:2454] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:16:58.457439 10813 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.457602 10813 leader_election.cc:302] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:58.458170 10555 leader_election.cc:341] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.458382 10555 leader_election.cc:302] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.458846 12118 raft_consensus.cc:2726] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.459374 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e978aa9dd9f64a6396130a9ef90b76ba [id=88fcae658b144d79a96df7c2b30a26a2]
I20260811 06:16:58.459679 11960 raft_consensus.cc:2726] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.461448 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]
I20260811 06:16:58.461972 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_fa6e7eb493bf4dbb86702a219a388acb [id=8ae837e4085947f783acb33a801b60cf]
I20260811 06:16:58.462356 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]
I20260811 06:16:58.463230 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]
I20260811 06:16:58.463919 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_54ba1e15029743bf966febe3c88a4a0d [id=9529d1977a76475089aedc4f6b39d450]
I20260811 06:16:58.464335 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]
W20260811 06:16:58.464951 10072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.203.124:45045 timed out after 0.651s (SENT) [suppressed 10 similar messages]
I20260811 06:16:58.468412 11368 raft_consensus.cc:2229] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.469002 11368 raft_consensus.cc:2258] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.470042 11368 ts_tablet_manager.cc:1905] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.476109 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]
I20260811 06:16:58.477102 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]
I20260811 06:16:58.479550 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 [id=9fa071d93c0e4ff295700d3dd4f571ed]
I20260811 06:16:58.480254 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]
I20260811 06:16:58.482740 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_71704b455f8b486386183aea5444d3ef [id=a625b1c349294cf7b3f9e79803d7b1ef]
I20260811 06:16:58.483052 11365 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.483227 11365 ts_tablet_manager.cc:1397] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.202s user 0.051s sys 0.059s
I20260811 06:16:58.484068 11365 raft_consensus.cc:348] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.484310 11365 raft_consensus.cc:374] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.484402 11365 raft_consensus.cc:729] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:16:58.483515 11588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.203.124:45045 timed out after 0.536s (SENT)
I20260811 06:16:58.484655 11365 consensus_queue.cc:260] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.485427 11365 ts_tablet_manager.cc:1428] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:58.485836 11365 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.487901 11365 tablet_bootstrap.cc:654] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.496177 11365 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.496394 11365 ts_tablet_manager.cc:1397] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 06:16:58.497274 11365 raft_consensus.cc:348] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.497563 11365 raft_consensus.cc:374] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.497665 11365 raft_consensus.cc:729] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.497957 11365 consensus_queue.cc:260] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.498590 11365 ts_tablet_manager.cc:1428] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:16:58.499002 11365 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.500926 11365 tablet_bootstrap.cc:654] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.504201 11361 tablet_bootstrap.cc:492] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.504381 11361 ts_tablet_manager.cc:1397] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.011s
I20260811 06:16:58.505403 11361 raft_consensus.cc:348] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.483116 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ee1aab676e354fb484ae487d4316b261 [id=a66e3380ba3d46ca93a6f98468b36cc3]
I20260811 06:16:58.507067 11362 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.507867 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]
I20260811 06:16:58.508863 11362 ts_tablet_manager.cc:1397] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.117s user 0.010s sys 0.023s
W20260811 06:16:58.514598 10562 connection.cc:535] server connection from 127.0.0.1:38572 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.514649 10555 connection.cc:535] client connection to 127.9.203.124:45045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.514705 11255 connection.cc:535] client connection to 127.9.203.124:45045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.515735 10072 connection.cc:535] server connection from 127.0.0.1:45226 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.515841 11255 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.9.203.124:45045)
W20260811 06:16:58.515974 10072 connection.cc:535] client connection to 127.9.203.124:45045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.516091 10072 leader_election.cc:334] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:58.516248 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
W20260811 06:16:58.516680 11255 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.9.203.124:45045)
W20260811 06:16:58.516983 11255 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.9.203.124:45045)
W20260811 06:16:58.518867 11255 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.9.203.124:45045)
W20260811 06:16:58.520458 11588 connection.cc:535] client connection to 127.9.203.124:45045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 06:16:58.520778 11588 leader_election.cc:334] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:58.514009 11960 raft_consensus.cc:482] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.525483 11960 raft_consensus.cc:504] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.526353 11960 leader_election.cc:288] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.526321 11362 raft_consensus.cc:348] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.526609 11362 raft_consensus.cc:374] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.526684 11362 raft_consensus.cc:729] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.526918 11362 consensus_queue.cc:260] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.527114 12118 raft_consensus.cc:482] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.527298 12118 raft_consensus.cc:504] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.527508 11362 ts_tablet_manager.cc:1428] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:16:58.527851 11362 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.528010 12118 leader_election.cc:288] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.530390 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_dc4f0ade100c4b05b31b548c1abe130e [id=a7bdc41eb968426092e5114e57d46415]
I20260811 06:16:58.531307 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]
W20260811 06:16:58.515301 10811 connection.cc:535] server connection from 127.0.0.1:48778 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:58.532505 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]
I20260811 06:16:58.505695 11361 raft_consensus.cc:374] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:58.515519 11048 connection.cc:535] server connection from 127.0.0.1:34696 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:58.532920 11361 raft_consensus.cc:729] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.533615 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cac1c339574b1fa26555b18811539b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.533609 11361 consensus_queue.cc:260] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.534514 11361 ts_tablet_manager.cc:1428] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.030s user 0.002s sys 0.001s
W20260811 06:16:58.515607 11047 connection.cc:535] client connection to 127.9.203.124:45045 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 06:16:58.537217 11361 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:16:58.537222 10564 leader_election.cc:341] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.538048 11766 raft_consensus.cc:504] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.538862 11766 leader_election.cc:288] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.541296 11370 ts_tablet_manager.cc:1918] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.541417 11370 log.cc:1196] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/cb854704951e4a399267766fb5be40e2
I20260811 06:16:58.545913 11370 ts_tablet_manager.cc:1939] T cb854704951e4a399267766fb5be40e2 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.547596 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]
I20260811 06:16:58.548187 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]
I20260811 06:16:58.551947 12118 raft_consensus.cc:482] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.552176 12118 raft_consensus.cc:504] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.552888 12118 leader_election.cc:288] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.552894 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4417703678a641a18717b8d5d7b2e294 [id=b0d2e30d0a0348d8bf26a93b2aa577e6]
I20260811 06:16:58.553305 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_c3e1b3f8f6d84555b87c499a26cbc29c [id=b40af271c2bf4a079699e9a4e3aa9b07]
I20260811 06:16:58.553843 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.554164 11361 tablet_bootstrap.cc:654] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:58.554687 10564 leader_election.cc:341] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.556104 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]
I20260811 06:16:58.557430 11362 tablet_bootstrap.cc:654] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.560215 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659]
I20260811 06:16:58.560189 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cac1c339574b1fa26555b18811539b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.560465 10921 raft_consensus.cc:2454] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
W20260811 06:16:58.551247 11588 leader_election.cc:334] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
W20260811 06:16:58.561116 11588 consensus_peers.cc:487] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 -> Peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Couldn't send request to peer 29fb239be50c4171bdbc75e064555197. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:58.561563 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.561743 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_631427441c8845c392c4e107eaca71d8 [id=b8766a818b8a4ec6a618df0081a23c56]
I20260811 06:16:58.562407 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d0335bdbd99c4dcda7ebedcb066eff67 [id=bea424ee56274c99aba8c2defe26bc3d]
W20260811 06:16:58.563498 10810 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
W20260811 06:16:58.564800 10810 leader_election.cc:341] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 16674be53bd54f9395b650e19edd3cf4
I20260811 06:16:58.565156 10555 leader_election.cc:302] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.565517 12118 raft_consensus.cc:2781] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.565618 12118 raft_consensus.cc:482] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.565732 12118 raft_consensus.cc:3037] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.568264 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_28d17bc11c5147c785d93e4351465ea9 [id=bf45c731d6e4455d9873db38c9863033]
I20260811 06:16:58.568867 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 [id=bfdd1158b74746a9a4da2ac0e8bfc177]
W20260811 06:16:58.568898 10555 leader_election.cc:341] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.569063 10555 leader_election.cc:302] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.571772 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 [id=c0ef340b9da1418abb2a9831abc3cec5]
I20260811 06:16:58.573112 11362 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.575418 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_3b1ac4a64e764c4199189b7239086a89 [id=c15ad397c32d4fb9b3e64edcb9d35c89]
I20260811 06:16:58.575687 11362 ts_tablet_manager.cc:1397] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.000s
I20260811 06:16:58.576472 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_e00a80287d844b2eb51fe2cea5882336 [id=c1691f7e26814813a6e41eeca1a4ec83]
I20260811 06:16:58.577267 11362 raft_consensus.cc:348] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.580060 11362 raft_consensus.cc:374] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.580255 11362 raft_consensus.cc:729] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.580600 11362 consensus_queue.cc:260] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.582054 11361 tablet_bootstrap.cc:492] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.582333 11361 ts_tablet_manager.cc:1397] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.006s
I20260811 06:16:58.583350 11361 raft_consensus.cc:348] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.583724 11361 raft_consensus.cc:374] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.583856 11361 raft_consensus.cc:729] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.584196 11361 consensus_queue.cc:260] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.584682 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_cc937b90426f431999efcbb356bc29f8 [id=c1bef49596bf4827a27e6f2f6207d590]
I20260811 06:16:58.585336 11361 ts_tablet_manager.cc:1428] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:58.586834 11362 ts_tablet_manager.cc:1428] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260811 06:16:58.593263 12231 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260811 06:16:58.594154 11361 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.596163 11361 tablet_bootstrap.cc:654] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.590219 11960 raft_consensus.cc:482] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.597262 11960 raft_consensus.cc:504] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.598095 11960 leader_election.cc:288] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.599006 11362 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.599247 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]
I20260811 06:16:58.601356 11362 tablet_bootstrap.cc:654] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.602015 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]
I20260811 06:16:58.602599 12245 raft_consensus.cc:2726] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.603740 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1882451cbcfe432aa9188327086bf0e3 [id=c881b1976ebe40dd8dc819e98a1d0581]
I20260811 06:16:58.604360 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 [id=c967201f6db64a649b9c4d71e89222ff]
I20260811 06:16:58.604966 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]
I20260811 06:16:58.605515 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]
I20260811 06:16:58.606377 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d483af5774d842edb46c928a435727d5 [id=ced4cf520c4f4b848b51d365ebca8a19]
I20260811 06:16:58.606802 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]
I20260811 06:16:58.607199 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]
I20260811 06:16:58.607595 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]
I20260811 06:16:58.607944 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]
W20260811 06:16:58.608109 10072 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.124:45045, user_credentials={real_user=slave}} blocked reactor thread for 92018.6us
I20260811 06:16:58.609570 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]
I20260811 06:16:58.603287 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.609946 10662 raft_consensus.cc:2454] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.611042 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 259) took 4721 ms. Trace:
I20260811 06:16:58.611176 11370 rpcz_store.cc:276] 0811 06:16:53.889889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.889956 (+ 67us) service_pool.cc:227] Handling call
0811 06:16:58.439566 (+4549610us) ts_tablet_manager.cc:1145] Deleting tablet cb854704951e4a399267766fb5be40e2
0811 06:16:58.439577 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.537961 (+ 98384us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.541147 (+ 3186us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.610996 (+ 69849us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4549301}
I20260811 06:16:58.612310 11370 tablet_replica.cc:330] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.612560 11370 raft_consensus.cc:2229] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:58.612841 11370 pending_rounds.cc:62] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:58.612937 11370 pending_rounds.cc:68] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213244180496384 op_type: NO_OP noop_request { }
I20260811 06:16:58.613088 11370 raft_consensus.cc:2866] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:58.613206 11370 raft_consensus.cc:2258] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.613677 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16674be53bd54f9395b650e19edd3cf4" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.613991 11158 raft_consensus.cc:3037] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:58.613942 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 259) could send its response
I20260811 06:16:58.614269 11370 ts_tablet_manager.cc:1905] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:58.609452 10813 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
I20260811 06:16:58.618317 10813 leader_election.cc:302] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.618721 11960 raft_consensus.cc:2726] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.619141 12245 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.610507 10810 leader_election.cc:302] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:58.619627 11960 raft_consensus.cc:2781] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.619751 11960 raft_consensus.cc:482] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.619467 12245 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.619982 11960 raft_consensus.cc:3037] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.620539 11361 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.620801 11361 ts_tablet_manager.cc:1397] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.002s
I20260811 06:16:58.621778 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.622028 11361 raft_consensus.cc:348] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.622265 11361 raft_consensus.cc:374] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.622385 11361 raft_consensus.cc:729] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.622668 11361 consensus_queue.cc:260] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.622823 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.623324 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.623438 11361 ts_tablet_manager.cc:1428] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:16:58.623744 11361 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:16:58.623950 10564 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.625617 11361 tablet_bootstrap.cc:654] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.630318 12251 raft_consensus.cc:482] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:58.630672 10813 leader_election.cc:341] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.630736 12251 raft_consensus.cc:504] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.631770 11362 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.632007 11362 ts_tablet_manager.cc:1397] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20260811 06:16:58.632866 11362 raft_consensus.cc:348] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.633212 11362 raft_consensus.cc:374] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.633347 11362 raft_consensus.cc:729] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.633685 11362 consensus_queue.cc:260] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.635761 11362 ts_tablet_manager.cc:1428] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:16:58.636163 11362 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.637773 11368 ts_tablet_manager.cc:1918] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.637957 11368 log.cc:1196] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f88af70bbada49309a0e7cc7c333d6f0
I20260811 06:16:58.638439 11368 ts_tablet_manager.cc:1939] T f88af70bbada49309a0e7cc7c333d6f0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.639293 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 317) took 3547 ms. Trace:
I20260811 06:16:58.639418 11368 rpcz_store.cc:276] 0811 06:16:55.091671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.091919 (+ 248us) service_pool.cc:227] Handling call
0811 06:16:58.414293 (+3322374us) ts_tablet_manager.cc:1145] Deleting tablet f88af70bbada49309a0e7cc7c333d6f0
0811 06:16:58.414302 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.468862 (+ 54560us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x6150001b1324. stack: 00007f193bf4966e 00007f193bf49430 00007f193afd05ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f194748504d 00007f19487295ec 00007f194b0b82e6 00007f194b0ea404 00007f194b0cb870 00007f194b0cb5fd 00000000009edb7c 00007f193bf8f344 00007f193bf9291b 00007f193bf92798
0811 06:16:58.541890 (+ 73028us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.637603 (+ 95713us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.639232 (+ 1629us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":123716352,"tablet-delete.queue_time_us":3319731}
I20260811 06:16:58.640014 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 337) took 3181 ms. Trace:
I20260811 06:16:58.640107 11368 rpcz_store.cc:276] 0811 06:16:55.458859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.464292 (+ 5433us) service_pool.cc:227] Handling call
0811 06:16:58.639827 (+3175535us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:16:58.639837 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.639953 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3175191}
I20260811 06:16:58.640493 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 338) took 3175 ms. Trace:
I20260811 06:16:58.640578 11368 rpcz_store.cc:276] 0811 06:16:55.464967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.465017 (+ 50us) service_pool.cc:227] Handling call
0811 06:16:58.640307 (+3175290us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:16:58.640316 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.640413 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3174992}
I20260811 06:16:58.640740 11960 raft_consensus.cc:504] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.640908 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 332) took 3207 ms. Trace:
I20260811 06:16:58.641005 11368 rpcz_store.cc:276] 0811 06:16:55.433184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.433245 (+ 61us) service_pool.cc:227] Handling call
0811 06:16:58.640757 (+3207512us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:16:58.640765 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.640856 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3159371}
I20260811 06:16:58.641319 11368 tablet_replica.cc:330] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.641526 11368 raft_consensus.cc:2229] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.641788 12059 raft_consensus.cc:504] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.642390 12059 leader_election.cc:288] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.642675 11960 leader_election.cc:288] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.643394 11158 raft_consensus.cc:2454] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:16:58.645373 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 317) could send its response
W20260811 06:16:58.645743 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 337) could send its response
I20260811 06:16:58.622810 12245 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.632187 10555 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.642000 12118 raft_consensus.cc:504] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.648134 10555 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.648625 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fbdda840466420f8d67a8cb5868ba03" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.649233 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cac1c339574b1fa26555b18811539b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.650288 12118 leader_election.cc:288] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.650512 10564 leader_election.cc:341] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.650781 10564 leader_election.cc:341] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.650970 12245 raft_consensus.cc:2726] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.651512 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:58.651652 12245 raft_consensus.cc:482] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.651773 10662 raft_consensus.cc:3037] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.652280 12251 leader_election.cc:288] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.650149 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1e89b093b0db4f3e8d0d549e42069605 [id=dc58cc194d2c4782b6a2b5d80caf698a]
I20260811 06:16:58.652390 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:58.652614 10664 raft_consensus.cc:3037] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.653003 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_1eecfa20d58747f69101093c3f4c9443 [id=dcd0a85bedc24ef4b83da3f0786e87ff]
I20260811 06:16:58.653367 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_236938dbaef84b3a93b4166937bfe2ff [id=dd2d621af0154d738a53335123f0e01d]
I20260811 06:16:58.647162 11368 raft_consensus.cc:2258] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:58.654090 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 338) could send its response
I20260811 06:16:58.654537 11368 ts_tablet_manager.cc:1905] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.649434 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fbdda840466420f8d67a8cb5868ba03" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.650677 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22cac1c339574b1fa26555b18811539b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.647699 11960 raft_consensus.cc:482] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:58.654484 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 332) could send its response
I20260811 06:16:58.655489 10915 raft_consensus.cc:3037] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.655515 10921 raft_consensus.cc:2454] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:58.655578 11960 raft_consensus.cc:504] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.656252 11960 leader_election.cc:288] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.656544 12245 raft_consensus.cc:504] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.652164 11362 tablet_bootstrap.cc:654] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.657266 10555 leader_election.cc:302] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.658293 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:58.659060 10564 leader_election.cc:341] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.659109 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.659363 10665 raft_consensus.cc:2454] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.659480 12245 leader_election.cc:288] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.659945 10810 leader_election.cc:302] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:58.660211 12251 raft_consensus.cc:2781] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.660357 12251 raft_consensus.cc:482] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.660455 12251 raft_consensus.cc:3037] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.660780 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.661123 10813 leader_election.cc:302] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.661295 11960 raft_consensus.cc:2781] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.662457 12059 raft_consensus.cc:2781] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.662612 12059 raft_consensus.cc:686] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.662256 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf [id=e096c0390baa4a24a3d7609ba6df9985]
I20260811 06:16:58.663254 12059 consensus_queue.cc:237] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.664194 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7246e1f0cdb049c6855b8bdbd42936f6" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.664464 11960 raft_consensus.cc:482] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.664575 11960 raft_consensus.cc:3037] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.664549 11158 raft_consensus.cc:3037] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.666036 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]
I20260811 06:16:58.667021 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]
I20260811 06:16:58.667532 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb]
I20260811 06:16:58.668273 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.668776 11365 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.669001 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.669057 11365 ts_tablet_manager.cc:1397] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.170s user 0.038s sys 0.082s
W20260811 06:16:58.669647 10813 leader_election.cc:341] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.670132 10813 leader_election.cc:341] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.670651 11047 consensus_peers.cc:487] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c00b6bdfc8ac4b5db81de9f614fcf213. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:58.670871 11365 raft_consensus.cc:348] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.671289 11365 raft_consensus.cc:374] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.671489 11365 raft_consensus.cc:729] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.672001 11365 consensus_queue.cc:260] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.674221 10114 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Refusing update from remote peer a36d6d06a0cb4489b5014178b9973219: Log matching property violated. Preceding OpId in replica: term: 3 index: 564. Preceding OpId from leader: term: 4 index: 570. (index mismatch)
I20260811 06:16:58.675227 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_6592e2a580a042a1854bdf75d49a8851 [id=e7784bea62394467aaf754f81a66521c]
I20260811 06:16:58.675999 11365 ts_tablet_manager.cc:1428] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:16:58.676337 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]
I20260811 06:16:58.676842 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]
I20260811 06:16:58.677191 11365 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.677616 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]
I20260811 06:16:58.679679 12164 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 570, Last known committed idx: 564, Time since last communication: 0.000s
I20260811 06:16:58.679535 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]
I20260811 06:16:58.681102 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]
I20260811 06:16:58.681917 11365 tablet_bootstrap.cc:654] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.683264 12245 raft_consensus.cc:482] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.683424 12245 raft_consensus.cc:504] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.684999 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.685947 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 [id=f7cb75ea2c454129b47c41cbe2e5c488]
I20260811 06:16:58.686488 12168 catalog_manager.cc:669] Loaded metadata for table default.Table_364d018e0f034bee935a0a9ab1249f34 [id=f8872b7a8c2140e3acbb418a770173cc]
I20260811 06:16:58.686653 12245 leader_election.cc:288] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.687095 10564 leader_election.cc:341] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.688323 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.691426 10555 leader_election.cc:341] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.691605 10555 leader_election.cc:302] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.692301 12245 raft_consensus.cc:2726] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.699100 11362 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.699523 11362 ts_tablet_manager.cc:1397] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.005s
I20260811 06:16:58.701260 11362 raft_consensus.cc:348] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.701834 11362 raft_consensus.cc:374] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.701957 11361 tablet_bootstrap.cc:492] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.702145 11361 ts_tablet_manager.cc:1397] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.002s
I20260811 06:16:58.702145 11362 raft_consensus.cc:729] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.702819 11362 consensus_queue.cc:260] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.703094 11361 raft_consensus.cc:348] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.703339 11361 raft_consensus.cc:374] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.703433 11361 raft_consensus.cc:729] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.703686 11361 consensus_queue.cc:260] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.704247 11361 ts_tablet_manager.cc:1428] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:16:58.704567 11361 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.705895 12059 raft_consensus.cc:482] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.706070 12059 raft_consensus.cc:504] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.706398 11361 tablet_bootstrap.cc:654] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.706691 12059 leader_election.cc:288] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.709882 10810 leader_election.cc:341] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
I20260811 06:16:58.711609 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe5eea681072477ab52a822d721629cf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.711879 11156 raft_consensus.cc:2454] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.712481 10813 leader_election.cc:302] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.713030 12059 raft_consensus.cc:2781] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.713145 12059 raft_consensus.cc:482] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.713254 12059 raft_consensus.cc:3037] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.717299 11362 ts_tablet_manager.cc:1428] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20260811 06:16:58.719188 11362 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.721076 11365 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.721431 11365 ts_tablet_manager.cc:1397] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.023s
I20260811 06:16:58.723030 11365 raft_consensus.cc:348] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.723578 11365 raft_consensus.cc:374] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.723717 11365 raft_consensus.cc:729] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.724217 11365 consensus_queue.cc:260] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.726482 12168 tablet_loader.cc:96] loaded metadata for tablet 00206b4e8c99424c9f1c4ba39fe51c82 (table default.Table_631427441c8845c392c4e107eaca71d8 [id=b8766a818b8a4ec6a618df0081a23c56])
I20260811 06:16:58.726642 11362 tablet_bootstrap.cc:654] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.727450 11361 tablet_bootstrap.cc:492] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.727434 11365 ts_tablet_manager.cc:1428] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260811 06:16:58.727648 11361 ts_tablet_manager.cc:1397] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.002s
I20260811 06:16:58.727964 11365 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.728510 11361 raft_consensus.cc:348] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.728753 11361 raft_consensus.cc:374] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.728842 11361 raft_consensus.cc:729] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.729081 11361 consensus_queue.cc:260] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.729861 11361 ts_tablet_manager.cc:1428] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:16:58.734067 11361 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.735925 11370 ts_tablet_manager.cc:1918] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.736101 11370 log.cc:1196] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/1ff1ad74f2034ed9b24c9712bae14cd3
I20260811 06:16:58.736073 11365 tablet_bootstrap.cc:654] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.736519 11370 ts_tablet_manager.cc:1939] T 1ff1ad74f2034ed9b24c9712bae14cd3 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.736860 10662 raft_consensus.cc:2454] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.737486 10915 raft_consensus.cc:2454] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:16:58.741618 11158 raft_consensus.cc:2454] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.742367 10813 leader_election.cc:302] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.742807 11766 raft_consensus.cc:2781] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.745316 10810 leader_election.cc:302] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.745371 10555 leader_election.cc:302] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.745807 12246 raft_consensus.cc:2781] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.745972 12246 raft_consensus.cc:686] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:58.746331 12246 consensus_queue.cc:237] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.750015 11365 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.750303 11365 ts_tablet_manager.cc:1397] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.003s
I20260811 06:16:58.750979 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 260) took 4859 ms. Trace:
I20260811 06:16:58.751137 11370 rpcz_store.cc:276] 0811 06:16:53.891933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.891990 (+ 57us) service_pool.cc:227] Handling call
0811 06:16:58.612236 (+4720246us) ts_tablet_manager.cc:1145] Deleting tablet 1ff1ad74f2034ed9b24c9712bae14cd3
0811 06:16:58.612246 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.642971 (+ 30725us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.735763 (+ 92792us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.750928 (+ 15165us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4719990}
W20260811 06:16:58.751452 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 260) could send its response
I20260811 06:16:58.751729 11365 raft_consensus.cc:348] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.752259 11365 raft_consensus.cc:374] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.752313 11370 tablet_replica.cc:330] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.752417 11365 raft_consensus.cc:729] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.752671 11370 raft_consensus.cc:2229] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:58.753095 11370 pending_rounds.cc:62] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:58.752945 11365 consensus_queue.cc:260] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.753283 11370 pending_rounds.cc:68] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213246097592320 op_type: NO_OP noop_request { }
I20260811 06:16:58.754833 11370 raft_consensus.cc:2866] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:58.755048 11370 raft_consensus.cc:2258] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.755123 11365 ts_tablet_manager.cc:1428] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:16:58.755554 11362 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.755753 11370 ts_tablet_manager.cc:1905] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.755990 11362 ts_tablet_manager.cc:1397] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.005s
I20260811 06:16:58.756492 11365 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.757647 11362 raft_consensus.cc:348] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.758282 11362 raft_consensus.cc:374] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.758448 11362 raft_consensus.cc:729] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.759016 11362 consensus_queue.cc:260] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.759634 11365 tablet_bootstrap.cc:654] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.770645 11361 tablet_bootstrap.cc:654] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.772385 12168 tablet_loader.cc:96] loaded metadata for tablet 00483ba1f60c4db386e3a7f1d57b921c (table default.Table_b79dca0f63044a20901e066a9c52d07f [id=258a0da1203e4162b4d2f87e9f0e3c32])
I20260811 06:16:58.773185 12168 tablet_loader.cc:96] loaded metadata for tablet 00c91236a8304bf2a03e85a5864aa669 (table default.Table_6a9b87183c994b7d9e7879d511ebfb97 [id=58cc3c5fbc6e41a6acbad99baee36cd5])
I20260811 06:16:58.773494 11365 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.773787 12168 tablet_loader.cc:96] loaded metadata for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_8baf40088898402196034a63aa016e8b [id=4df7e577a0a9424f95a5009e534db476])
I20260811 06:16:58.773830 11365 ts_tablet_manager.cc:1397] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.004s
I20260811 06:16:58.774564 12168 tablet_loader.cc:96] loaded metadata for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd])
I20260811 06:16:58.774976 12168 tablet_loader.cc:96] loaded metadata for tablet 03f2bd25baf347f7a1ba1b50459d8a97 (table default.Table_0a7428e94c2a44059b7d8c83ce698701 [id=30b28c4b8cdd49589b876d657179b2b1])
I20260811 06:16:58.775310 11365 raft_consensus.cc:348] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.775790 12168 tablet_loader.cc:96] loaded metadata for tablet 0813b34919a14a2481857e9f87b217c8 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1])
I20260811 06:16:58.775794 11365 raft_consensus.cc:374] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.775933 11365 raft_consensus.cc:729] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.776298 12168 tablet_loader.cc:96] loaded metadata for tablet 085179a610734942b9dd050ce9cf56d4 (table default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34])
I20260811 06:16:58.776400 11365 consensus_queue.cc:260] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.778508 11365 ts_tablet_manager.cc:1428] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:58.779886 11365 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.782712 12094 raft_consensus.cc:482] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.782915 12094 raft_consensus.cc:504] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.783630 12094 leader_election.cc:288] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.784390 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bbf657cb27f4da9a4f595242864163a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.784668 10915 raft_consensus.cc:2454] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:58.784981 11046 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a
I20260811 06:16:58.785109 12245 raft_consensus.cc:482] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.785256 12245 raft_consensus.cc:504] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.785974 11365 tablet_bootstrap.cc:654] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.786720 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.786893 11047 leader_election.cc:302] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:58.787204 12094 raft_consensus.cc:2781] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.787328 12094 raft_consensus.cc:482] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.787427 12094 raft_consensus.cc:3037] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.787458 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.787555 10564 leader_election.cc:341] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:58.788019 10555 leader_election.cc:341] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.788156 10555 leader_election.cc:302] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.788419 12118 raft_consensus.cc:2726] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.786001 12245 leader_election.cc:288] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.776754 12168 tablet_loader.cc:96] loaded metadata for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658])
W20260811 06:16:58.798499 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 53171.2us
I20260811 06:16:58.798698 12168 tablet_loader.cc:96] loaded metadata for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016])
I20260811 06:16:58.799558 12168 tablet_loader.cc:96] loaded metadata for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da])
I20260811 06:16:58.799880 12272 raft_consensus.cc:2781] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.800652 11361 tablet_bootstrap.cc:492] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.800868 11361 ts_tablet_manager.cc:1397] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260811 06:16:58.800886 12272 raft_consensus.cc:686] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.801461 11365 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.801764 11365 ts_tablet_manager.cc:1397] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.001s
I20260811 06:16:58.802119 11361 raft_consensus.cc:348] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.802404 11361 raft_consensus.cc:374] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.802501 11361 raft_consensus.cc:729] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.802758 11361 consensus_queue.cc:260] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.803462 11361 ts_tablet_manager.cc:1428] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:16:58.803369 11365 raft_consensus.cc:348] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.803769 11365 raft_consensus.cc:374] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.804005 11365 raft_consensus.cc:729] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.804054 12168 tablet_loader.cc:96] loaded metadata for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628])
I20260811 06:16:58.804451 12168 tablet_loader.cc:96] loaded metadata for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b])
I20260811 06:16:58.804551 11365 consensus_queue.cc:260] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.802171 12272 consensus_queue.cc:237] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.804868 12168 tablet_loader.cc:96] loaded metadata for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a])
I20260811 06:16:58.805279 12168 tablet_loader.cc:96] loaded metadata for tablet 1168c63178174571907981d4a6ac165f (table default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 [id=485faa9398f8447398dbdc64b6ef2167])
I20260811 06:16:58.805759 11365 ts_tablet_manager.cc:1428] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:58.806197 11361 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.806434 11365 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.808099 11361 tablet_bootstrap.cc:654] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.809602 11365 tablet_bootstrap.cc:654] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.813190 11961 raft_consensus.cc:482] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.813369 11961 raft_consensus.cc:504] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.814195 11766 raft_consensus.cc:686] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.814258 11961 leader_election.cc:288] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.815050 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3025339a6c9e4e07bba4104006206bb8" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:58.815335 10915 raft_consensus.cc:2454] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:58.815922 11766 consensus_queue.cc:237] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.816457 11047 leader_election.cc:302] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:16:58.817826 11046 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:58.818214 11961 raft_consensus.cc:2781] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.818328 11961 raft_consensus.cc:482] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.818411 11961 raft_consensus.cc:3037] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.822206 12168 tablet_loader.cc:96] loaded metadata for tablet 1271c4ab028d4d45acfee370f13a02d3 (table default.Table_71704b455f8b486386183aea5444d3ef [id=a625b1c349294cf7b3f9e79803d7b1ef])
I20260811 06:16:58.822808 12168 tablet_loader.cc:96] loaded metadata for tablet 12971f852ea943b78d967f7672680cad (table default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e])
I20260811 06:16:58.823271 12168 tablet_loader.cc:96] loaded metadata for tablet 1349b0ea48b848398d4bdda528358c30 (table default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6])
I20260811 06:16:58.823710 12168 tablet_loader.cc:96] loaded metadata for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154])
I20260811 06:16:58.823868 11365 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.824198 11365 ts_tablet_manager.cc:1397] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.007s
I20260811 06:16:58.824254 12168 tablet_loader.cc:96] loaded metadata for tablet 152f7db9fc6241c8abfdafd3adc30d47 (table default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d])
I20260811 06:16:58.824132 12285 consensus_queue.cc:1035] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:58.824851 12168 tablet_loader.cc:96] loaded metadata for tablet 1649493bd0924ee48fd5044d7288932d (table default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039])
I20260811 06:16:58.825598 12168 tablet_loader.cc:96] loaded metadata for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab])
I20260811 06:16:58.825696 11365 raft_consensus.cc:348] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.826203 11365 raft_consensus.cc:374] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.826380 11365 raft_consensus.cc:729] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.826794 11365 consensus_queue.cc:260] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.827873 11365 ts_tablet_manager.cc:1428] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:58.828372 11365 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.830559 11362 ts_tablet_manager.cc:1428] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.074s user 0.028s sys 0.016s
I20260811 06:16:58.831295 11362 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.832231 11365 tablet_bootstrap.cc:654] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.834583 11362 tablet_bootstrap.cc:654] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.835798 11368 ts_tablet_manager.cc:1918] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.835945 11368 log.cc:1196] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:16:58.836319 11368 ts_tablet_manager.cc:1939] T 7a00b0b51f574bfb843b65c0876ab4fc P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.836601 10664 raft_consensus.cc:2454] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.837071 12094 raft_consensus.cc:504] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.837841 12094 leader_election.cc:288] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.837872 11960 raft_consensus.cc:504] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.838570 11960 leader_election.cc:288] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.840775 12251 raft_consensus.cc:504] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.841488 12059 raft_consensus.cc:504] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.841853 10921 raft_consensus.cc:2379] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24d29113b2454d9c93e23db3e3dac801 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:16:58.842180 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fbdda840466420f8d67a8cb5868ba03" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.843879 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bbf657cb27f4da9a4f595242864163a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.844100 10921 raft_consensus.cc:3037] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.844702 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 333) took 3410 ms. Trace:
I20260811 06:16:58.844841 11368 rpcz_store.cc:276] 0811 06:16:55.433922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.433975 (+ 53us) service_pool.cc:227] Handling call
0811 06:16:58.641238 (+3207263us) ts_tablet_manager.cc:1145] Deleting tablet 7a00b0b51f574bfb843b65c0876ab4fc
0811 06:16:58.641247 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.737888 (+ 96641us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.835636 (+ 97748us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.844658 (+ 9022us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3159806}
I20260811 06:16:58.845255 11368 tablet_replica.cc:330] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.845494 11368 raft_consensus.cc:2229] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.845664 11368 raft_consensus.cc:2258] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:58.846143 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 333) could send its response
I20260811 06:16:58.846633 11368 ts_tablet_manager.cc:1905] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.847061 10921 raft_consensus.cc:2454] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:58.849969 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.850226 11158 raft_consensus.cc:3037] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.852770 11158 raft_consensus.cc:2454] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.852993 12021 raft_consensus.cc:482] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.851830 11961 raft_consensus.cc:504] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.853197 12021 raft_consensus.cc:504] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.853700 12021 leader_election.cc:288] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.853940 11961 leader_election.cc:288] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.854225 12251 leader_election.cc:288] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:58.854192 10564 leader_election.cc:341] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.854183 10555 leader_election.cc:302] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.855257 11047 leader_election.cc:302] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.855355 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fbdda840466420f8d67a8cb5868ba03" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.855556 12094 raft_consensus.cc:2781] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.855577 10922 raft_consensus.cc:3037] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.855674 12094 raft_consensus.cc:686] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:58.855733 12251 raft_consensus.cc:3037] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.856003 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3025339a6c9e4e07bba4104006206bb8" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:58.855921 12094 consensus_queue.cc:237] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.855388 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb93dcd940a47e78c5458041c768e36" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.856470 10661 raft_consensus.cc:2454] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:58.857234 11046 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:58.857225 10813 leader_election.cc:302] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:16:58.857451 11046 leader_election.cc:341] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a
W20260811 06:16:58.857684 11047 consensus_peers.cc:487] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:58.857771 11046 leader_election.cc:302] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:16:58.857950 11047 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:16:58.858055 11047 leader_election.cc:302] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:58.858388 12021 raft_consensus.cc:2781] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.858537 12021 raft_consensus.cc:482] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.858640 12021 raft_consensus.cc:3037] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.858621 12059 leader_election.cc:288] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.858786 12059 raft_consensus.cc:2781] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.858942 12059 raft_consensus.cc:686] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.858942 12231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36d6d06a0cb4489b5014178b9973219. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:58.859239 12231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:58.859218 12059 consensus_queue.cc:237] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.861312 12021 raft_consensus.cc:504] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.861486 10922 raft_consensus.cc:2454] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
W20260811 06:16:58.862496 11047 leader_election.cc:341] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: cdb93dcd940a47e78c5458041c768e36
I20260811 06:16:58.862560 10555 leader_election.cc:302] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.862594 12251 raft_consensus.cc:2726] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.863054 12251 raft_consensus.cc:2781] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.863144 12016 raft_consensus.cc:2726] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.863330 12251 raft_consensus.cc:686] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:58.864274 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe5eea681072477ab52a822d721629cf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.864578 11158 raft_consensus.cc:3037] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.866873 11365 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:58.867197 11365 ts_tablet_manager.cc:1397] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.003s
I20260811 06:16:58.867779 11158 raft_consensus.cc:2454] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.868168 12021 leader_election.cc:288] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:58.868710 10813 leader_election.cc:302] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.869139 11960 raft_consensus.cc:2781] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.869282 11960 raft_consensus.cc:686] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.868944 11365 raft_consensus.cc:348] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.869421 11365 raft_consensus.cc:374] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.869625 11361 tablet_bootstrap.cc:492] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.869616 11365 raft_consensus.cc:729] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.869535 11960 consensus_queue.cc:237] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.869783 11361 ts_tablet_manager.cc:1397] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.001s
I20260811 06:16:58.870035 11365 consensus_queue.cc:260] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.864318 12251 consensus_queue.cc:237] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.870519 11361 raft_consensus.cc:348] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.870728 11361 raft_consensus.cc:374] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.870805 11361 raft_consensus.cc:729] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.870982 11361 consensus_queue.cc:260] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.871654 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdb93dcd940a47e78c5458041c768e36" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:58.871893 10661 raft_consensus.cc:3037] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.873205 11365 ts_tablet_manager.cc:1428] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:16:58.874838 10661 raft_consensus.cc:2454] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:58.875375 11046 leader_election.cc:302] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.875672 12094 raft_consensus.cc:2781] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.875842 12094 raft_consensus.cc:686] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:58.875830 11365 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:58.876050 11361 ts_tablet_manager.cc:1428] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:16:58.876286 12094 consensus_queue.cc:237] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.878708 11361 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.880103 11365 tablet_bootstrap.cc:654] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:58.880122 11047 leader_election.cc:341] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: cdb93dcd940a47e78c5458041c768e36
I20260811 06:16:58.880801 12168 tablet_loader.cc:96] loaded metadata for tablet 19e7d97649c94ef3a73a0ea9acc57ab2 (table default.Table_6972e78580ee49178a1c6ce6f017dc52 [id=696d50b178d4478d81d03a34a5ede1b4])
I20260811 06:16:58.881356 12168 tablet_loader.cc:96] loaded metadata for tablet 19f45416a7ae45b3a8b26dd98b672f36 (table default.Table_d0335bdbd99c4dcda7ebedcb066eff67 [id=bea424ee56274c99aba8c2defe26bc3d])
I20260811 06:16:58.882601 11361 tablet_bootstrap.cc:654] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.889019 12168 tablet_loader.cc:96] loaded metadata for tablet 1a0278945378465ea9d61180b5f539dd (table default.Table_54ba1e15029743bf966febe3c88a4a0d [id=9529d1977a76475089aedc4f6b39d450])
I20260811 06:16:58.895394 11370 ts_tablet_manager.cc:1918] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:58.895903 11370 log.cc:1196] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/b1d6641dd44340889879d3b92018b3f0
I20260811 06:16:58.896414 11370 ts_tablet_manager.cc:1939] T b1d6641dd44340889879d3b92018b3f0 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:58.897403 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 261) took 4973 ms. Trace:
I20260811 06:16:58.897562 11370 rpcz_store.cc:276] 0811 06:16:53.924259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.924322 (+ 63us) service_pool.cc:227] Handling call
0811 06:16:58.752241 (+4827919us) ts_tablet_manager.cc:1145] Deleting tablet b1d6641dd44340889879d3b92018b3f0
0811 06:16:58.752253 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.842924 (+ 90671us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.895200 (+ 52276us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.897356 (+ 2156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4827558}
I20260811 06:16:58.898417 11370 tablet_replica.cc:330] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.898674 11370 raft_consensus.cc:2229] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.898842 11370 raft_consensus.cc:2258] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:16:58.899132 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 261) could send its response
I20260811 06:16:58.901275 11370 ts_tablet_manager.cc:1905] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.906131 12285 raft_consensus.cc:482] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.908161 12168 tablet_loader.cc:96] loaded metadata for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2])
I20260811 06:16:58.908780 12094 consensus_queue.cc:1035] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:58.908468 12285 raft_consensus.cc:504] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.910130 12168 tablet_loader.cc:96] loaded metadata for tablet 1a7d05ec3851467dbf1ef9319b1c9462 (table default.Table_9ebd08dfe60a4b85aa8ad49b46d1a716 [id=9fa071d93c0e4ff295700d3dd4f571ed])
I20260811 06:16:58.911324 11370 ts_tablet_manager.cc:1918] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.911836 12168 tablet_loader.cc:96] loaded metadata for tablet 1c03ffd4a98a49258a0c0d72aa6fb6eb (table default.Table_04500ce2ab80444b9cafeaa864c9e65c [id=43248d68796b43e8b16d7ab6ce8f5507])
I20260811 06:16:58.912400 12285 leader_election.cc:288] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.913383 12251 raft_consensus.cc:482] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.913589 12251 raft_consensus.cc:504] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.914350 12251 leader_election.cc:288] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.914997 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.915690 10555 leader_election.cc:341] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.915808 12251 raft_consensus.cc:482] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:58.915930 12251 raft_consensus.cc:504] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.916517 12168 tablet_loader.cc:96] loaded metadata for tablet 1f48707b4fb746f49eaaf91b5b81e814 (table default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6])
I20260811 06:16:58.916560 12251 leader_election.cc:288] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.917544 12168 tablet_loader.cc:96] loaded metadata for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3])
I20260811 06:16:58.913131 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.916042 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.917303 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:58.917855 11158 raft_consensus.cc:2454] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.918354 11370 log.cc:1196] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/864c3bbf1e004579a4d0be809f83ca33
W20260811 06:16:58.918591 10564 leader_election.cc:341] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.918725 10564 leader_election.cc:302] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.919124 11370 ts_tablet_manager.cc:1939] T 864c3bbf1e004579a4d0be809f83ca33 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:16:58.919142 10564 leader_election.cc:341] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.919421 12251 raft_consensus.cc:2726] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.919930 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 262) took 4961 ms. Trace:
I20260811 06:16:58.919867 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:58.920380 10555 leader_election.cc:341] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:58.920521 10555 leader_election.cc:302] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:58.920980 12251 raft_consensus.cc:2726] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.921361 10813 leader_election.cc:302] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.921855 12285 raft_consensus.cc:2781] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:58.922053 12285 raft_consensus.cc:482] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:58.922106 12168 tablet_loader.cc:96] loaded metadata for tablet 231bbec61fa247ef97b090f6a180b737 (table default.Table_86ab15ee4d6b4e7c86036cbfb2968ec0 [id=5e9aaf8278a7448495ee4e3ada85919c])
I20260811 06:16:58.922216 12285 raft_consensus.cc:3037] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.922274 11370 rpcz_store.cc:276] 0811 06:16:53.958970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.959049 (+ 79us) service_pool.cc:227] Handling call
0811 06:16:58.898349 (+4939300us) ts_tablet_manager.cc:1145] Deleting tablet 864c3bbf1e004579a4d0be809f83ca33
0811 06:16:58.898363 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.904870 (+ 6507us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.911197 (+ 6327us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.919866 (+ 8669us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4925783}
W20260811 06:16:58.922966 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 262) could send its response
I20260811 06:16:58.923439 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 263) took 4961 ms. Trace:
I20260811 06:16:58.923815 12168 tablet_loader.cc:96] loaded metadata for tablet 2558f26ae7424ead9fb43883c81a02a0 (table default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf [id=e096c0390baa4a24a3d7609ba6df9985])
I20260811 06:16:58.923962 11370 rpcz_store.cc:276] 0811 06:16:53.961512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.961570 (+ 58us) service_pool.cc:227] Handling call
0811 06:16:58.923260 (+4961690us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:16:58.923273 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.923379 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37,"tablet-delete.queue_time_us":4950690}
I20260811 06:16:58.924942 12168 tablet_loader.cc:96] loaded metadata for tablet 2b0ae9a1d3b74c3985637439819b63ef (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc])
W20260811 06:16:58.925180 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 263) could send its response
I20260811 06:16:58.925398 12285 raft_consensus.cc:504] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:58.925944 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 264) took 4943 ms. Trace:
I20260811 06:16:58.926597 11368 ts_tablet_manager.cc:1918] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:58.926812 11368 log.cc:1196] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/3025339a6c9e4e07bba4104006206bb8
I20260811 06:16:58.927035 12285 leader_election.cc:288] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:58.927282 11368 ts_tablet_manager.cc:1939] T 3025339a6c9e4e07bba4104006206bb8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:58.930130 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 334) took 3495 ms. Trace:
I20260811 06:16:58.930312 11368 rpcz_store.cc:276] 0811 06:16:55.434324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.434373 (+ 49us) service_pool.cc:227] Handling call
0811 06:16:58.845163 (+3410790us) ts_tablet_manager.cc:1145] Deleting tablet 3025339a6c9e4e07bba4104006206bb8
0811 06:16:58.845175 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.849671 (+ 4496us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.926466 (+ 76795us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:58.929828 (+ 3362us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3363700}
W20260811 06:16:58.930835 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 334) could send its response
I20260811 06:16:58.931391 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 335) took 3496 ms. Trace:
I20260811 06:16:58.932169 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681736b44af04718b800d503ca645c1a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:58.933957 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:58.934199 10665 raft_consensus.cc:2454] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:58.934782 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:58.935041 10659 raft_consensus.cc:3037] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.935647 10662 raft_consensus.cc:2454] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.940824 10659 raft_consensus.cc:2454] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.926759 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39dfcd1a66b4241bc6f5c38e930f048" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:58.941425 11158 raft_consensus.cc:3037] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:58.941910 12168 tablet_loader.cc:96] loaded metadata for tablet 2be78c7877934f438ac52e8bf82d145b (table default.Table_53cb23e4e85049898ced77eaa6b01e32 [id=7618b959c1824d0882b7e71e27533462])
I20260811 06:16:58.942665 12168 tablet_loader.cc:96] loaded metadata for tablet 2df64ad168f341be899eba30e55b7f44 (table default.Table_ae32a31bc8f64e96a549037c0d65f64e [id=3577c42e6da543858c4f923ca3694893])
I20260811 06:16:58.942956 12168 tablet_loader.cc:96] loaded metadata for tablet 2e1460fe55fb48f890f31e1cc86d1d23 (table default.Table_d483af5774d842edb46c928a435727d5 [id=ced4cf520c4f4b848b51d365ebca8a19])
I20260811 06:16:58.943471 12168 tablet_loader.cc:96] loaded metadata for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85])
I20260811 06:16:58.944551 11158 raft_consensus.cc:2454] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:58.938788 11961 raft_consensus.cc:482] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:58.939692 11046 consensus_peers.cc:487] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4a46cec25944310a838d8323b119883. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:58.941335 11370 rpcz_store.cc:276] 0811 06:16:53.982492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:53.982564 (+ 72us) service_pool.cc:227] Handling call
0811 06:16:58.925764 (+4943200us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:16:58.925775 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.925894 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4931403}
I20260811 06:16:58.946290 11961 raft_consensus.cc:504] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:58.947026 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 264) could send its response
I20260811 06:16:58.948469 11961 leader_election.cc:288] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:58.948632 11046 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae
I20260811 06:16:58.947642 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 265) took 4940 ms. Trace:
I20260811 06:16:58.949136 11370 rpcz_store.cc:276] 0811 06:16:54.007211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.007281 (+ 70us) service_pool.cc:227] Handling call
0811 06:16:58.947446 (+4940165us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:16:58.947459 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.947578 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4939874}
W20260811 06:16:58.949414 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 265) could send its response
I20260811 06:16:58.950003 11370 tablet_replica.cc:330] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:58.950219 11370 raft_consensus.cc:2229] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.950959 11370 raft_consensus.cc:2258] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.951541 12231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:58.951897 12231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:16:58.952805 11370 ts_tablet_manager.cc:1905] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:58.954150 11361 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:58.954331 11361 ts_tablet_manager.cc:1397] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.000s
I20260811 06:16:58.955216 11361 raft_consensus.cc:348] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.955468 11361 raft_consensus.cc:374] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.955543 11361 raft_consensus.cc:729] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.955811 12168 tablet_loader.cc:96] loaded metadata for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b])
I20260811 06:16:58.955825 11361 consensus_queue.cc:260] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.956383 11361 ts_tablet_manager.cc:1428] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:16:58.936941 12285 consensus_queue.cc:1035] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:58.958590 11368 rpcz_store.cc:276] 0811 06:16:55.434774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.436770 (+ 1996us) service_pool.cc:227] Handling call
0811 06:16:58.931216 (+3494446us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:16:58.931228 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.931333 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3449703}
W20260811 06:16:58.958906 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 335) could send its response
I20260811 06:16:58.959115 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 336) took 3524 ms. Trace:
I20260811 06:16:58.959203 11368 rpcz_store.cc:276] 0811 06:16:55.435072 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.437092 (+ 2020us) service_pool.cc:227] Handling call
0811 06:16:58.958913 (+3521821us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:16:58.958926 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.959063 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3477358}
W20260811 06:16:58.959481 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 336) could send its response
I20260811 06:16:58.959599 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 339) took 3417 ms. Trace:
I20260811 06:16:58.959676 11368 rpcz_store.cc:276] 0811 06:16:55.542608 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.542681 (+ 73us) service_pool.cc:227] Handling call
0811 06:16:58.959446 (+3416765us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:16:58.959456 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.959547 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3406378}
I20260811 06:16:58.938048 11362 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:58.960253 11368 tablet_replica.cc:330] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:58.945308 10813 leader_election.cc:302] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:58.960417 11362 ts_tablet_manager.cc:1397] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.129s user 0.005s sys 0.000s
I20260811 06:16:58.960484 11368 raft_consensus.cc:2229] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:58.960577 12285 raft_consensus.cc:2781] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:58.960667 11368 raft_consensus.cc:2258] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:58.960711 12285 raft_consensus.cc:686] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:58.961007 12285 consensus_queue.cc:237] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:58.960184 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 339) could send its response
I20260811 06:16:58.961755 11368 ts_tablet_manager.cc:1905] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:58.961860 11047 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae
I20260811 06:16:58.962004 11047 leader_election.cc:302] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:58.962909 11961 raft_consensus.cc:2726] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:58.962934 11362 raft_consensus.cc:348] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.965096 11362 raft_consensus.cc:374] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:58.965515 11362 raft_consensus.cc:729] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:58.966189 11362 consensus_queue.cc:260] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:58.967764 11362 ts_tablet_manager.cc:1428] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:16:58.974013 11362 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:58.975900 11362 tablet_bootstrap.cc:654] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:58.976080 12168 tablet_loader.cc:96] loaded metadata for tablet 3210614ebacf45c89d63413c51c8f923 (table default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743])
I20260811 06:16:58.976485 12168 tablet_loader.cc:96] loaded metadata for tablet 32407c8872464da2b1470a8ae21c86fd (table default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a])
I20260811 06:16:58.976992 12168 tablet_loader.cc:96] loaded metadata for tablet 3410afec34ae469d9a07cc9d16cf082c (table default.Table_1e89b093b0db4f3e8d0d549e42069605 [id=dc58cc194d2c4782b6a2b5d80caf698a])
I20260811 06:16:58.977614 12168 tablet_loader.cc:96] loaded metadata for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd [id=2c17310139a841fab9f7e4aaed39cc98])
I20260811 06:16:58.977941 12168 tablet_loader.cc:96] loaded metadata for tablet 36e37f51b0b549b7a3e749f7fbe0d03a (table default.Table_cc937b90426f431999efcbb356bc29f8 [id=c1bef49596bf4827a27e6f2f6207d590])
I20260811 06:16:58.978282 12168 tablet_loader.cc:96] loaded metadata for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac])
I20260811 06:16:58.978845 12168 tablet_loader.cc:96] loaded metadata for tablet 3b5bb21784e34ad7addf144e0b10a444 (table default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a])
I20260811 06:16:58.992825 11361 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:58.995440 11361 tablet_bootstrap.cc:654] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:58.944272 10810 leader_election.cc:341] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
W20260811 06:16:58.998636 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 54347.7us
I20260811 06:16:58.999195 12168 tablet_loader.cc:96] loaded metadata for tablet 3b658d1cd9b74251981fe1ff3959033a (table default.Table_e00a80287d844b2eb51fe2cea5882336 [id=c1691f7e26814813a6e41eeca1a4ec83])
I20260811 06:16:58.999702 12168 tablet_loader.cc:96] loaded metadata for tablet 3c64c7100ccc4474bb895712f2d01b45 (table default.Table_236938dbaef84b3a93b4166937bfe2ff [id=dd2d621af0154d738a53335123f0e01d])
I20260811 06:16:59.000052 12168 tablet_loader.cc:96] loaded metadata for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_897ed62b321f47fb89a724e148c60031 [id=68f45e1274514ff2afe14bbb13d23867])
I20260811 06:16:59.000339 12168 tablet_loader.cc:96] loaded metadata for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f (table default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1])
I20260811 06:16:59.000687 12168 tablet_loader.cc:96] loaded metadata for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507])
I20260811 06:16:59.003199 11365 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.003372 11365 ts_tablet_manager.cc:1397] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.129s user 0.058s sys 0.036s
I20260811 06:16:59.004140 11365 raft_consensus.cc:348] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.004393 11365 raft_consensus.cc:374] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.004468 11365 raft_consensus.cc:729] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.004729 11365 consensus_queue.cc:260] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.005286 11365 ts_tablet_manager.cc:1428] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:16:59.005623 11365 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.011905 12251 raft_consensus.cc:482] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.012111 12251 raft_consensus.cc:504] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.012939 12251 leader_election.cc:288] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.013682 11365 tablet_bootstrap.cc:654] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.013667 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.014375 10555 leader_election.cc:341] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.001053 12168 tablet_loader.cc:96] loaded metadata for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_317717a9da1a41028e46bcebb073c694 [id=0fb1742233f640a8a51ca49d6be5191c])
I20260811 06:16:59.015280 12168 tablet_loader.cc:96] loaded metadata for tablet 4209fc7d2efb415e8794fb33e7f2e5ac (table default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5])
I20260811 06:16:59.015636 12168 tablet_loader.cc:96] loaded metadata for tablet 446112faf4374fa29fea8bb40666856e (table default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc])
I20260811 06:16:59.015904 12168 tablet_loader.cc:96] loaded metadata for tablet 4583024f1f79477886a7664a71eecb8a (table default.Table_2418f358fbab49a585c61348c4764570 [id=51128de8177d416cad485dbe668152ab])
I20260811 06:16:59.017060 12168 tablet_loader.cc:96] loaded metadata for tablet 478a5fbcc353475ba35a5b9f98654c33 (table default.Table_ef3697835c0e4cedbb64c0a58636d94b [id=2b588f0344cf48d5a6debfc5f8c53f05])
I20260811 06:16:59.017401 12168 tablet_loader.cc:96] loaded metadata for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd])
I20260811 06:16:59.020493 11368 ts_tablet_manager.cc:1918] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:59.020656 11368 log.cc:1196] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/9c5fa9633057485b917f117819d79398
I20260811 06:16:59.021173 11368 ts_tablet_manager.cc:1939] T 9c5fa9633057485b917f117819d79398 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:59.013495 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.027644 12168 tablet_loader.cc:96] loaded metadata for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_d6b851b238cc407c91a9e72f70ac3b5a [id=0f76cb2b3f154167b4fa6a056cdf6fc3])
W20260811 06:16:59.028002 10564 leader_election.cc:341] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.028198 10564 leader_election.cc:302] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.028548 12251 raft_consensus.cc:2726] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.028577 12168 tablet_loader.cc:96] loaded metadata for tablet 4d4d5c19d1aa486fa6415907628e6f57 (table default.Table_fc4b03d50c57434da608ba22b5e91522 [id=6145f219b330458381821a6aaeb0fa0b])
I20260811 06:16:59.028919 12168 tablet_loader.cc:96] loaded metadata for tablet 4e410cb11efc4813aabae68cb177a722 (table default.Table_63c67aa45e8b4160b1c2b2b838657879 [id=c16fd595d9ce45beb5732225129928cd])
I20260811 06:16:59.029321 12168 tablet_loader.cc:96] loaded metadata for tablet 4ef97b47809940f4bfee89cc0515edcf (table default.Table_1fb146978bd445a0b62f5c36e9ba593b [id=71a6e6e546cd44e3af189cbf486e121f])
I20260811 06:16:59.030079 12168 tablet_loader.cc:96] loaded metadata for tablet 511f08c3d4d642368805b6a89743b367 (table default.Table_7d0b3d7ac76e4032b8aed0fc18bd4668 [id=54ed6f7aa1874e0897b2b8583bc6f57d])
I20260811 06:16:59.022382 11370 ts_tablet_manager.cc:1918] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:59.030894 11362 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.031095 11362 ts_tablet_manager.cc:1397] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.002s
I20260811 06:16:59.031625 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 340) took 3447 ms. Trace:
I20260811 06:16:59.031765 11368 rpcz_store.cc:276] 0811 06:16:55.584296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.584350 (+ 54us) service_pool.cc:227] Handling call
0811 06:16:58.960158 (+3375808us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:16:58.960171 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.001460 (+ 41289us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.020328 (+ 18868us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.031576 (+ 11248us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3375522}
I20260811 06:16:59.030746 11370 log.cc:1196] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/681736b44af04718b800d503ca645c1a
I20260811 06:16:59.033116 11365 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.033260 11370 ts_tablet_manager.cc:1939] T 681736b44af04718b800d503ca645c1a P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.033294 11365 ts_tablet_manager.cc:1397] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
W20260811 06:16:59.033340 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 340) could send its response
I20260811 06:16:59.034579 11362 raft_consensus.cc:348] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.034628 11365 raft_consensus.cc:348] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.034860 11362 raft_consensus.cc:374] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.034871 11365 raft_consensus.cc:374] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.034967 11365 raft_consensus.cc:729] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.034950 11362 raft_consensus.cc:729] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.035199 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 347) took 3362 ms. Trace:
I20260811 06:16:59.035357 11368 rpcz_store.cc:276] 0811 06:16:55.686388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.686477 (+ 89us) service_pool.cc:227] Handling call
0811 06:16:59.033623 (+3347146us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:16:59.034916 (+ 1293us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.035158 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3339709}
W20260811 06:16:59.035662 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 347) could send its response
I20260811 06:16:59.036078 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 356) took 2868 ms. Trace:
I20260811 06:16:59.036242 11368 rpcz_store.cc:276] 0811 06:16:56.167439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.167492 (+ 53us) service_pool.cc:227] Handling call
0811 06:16:59.035926 (+2868434us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:16:59.035937 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.036043 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2868148}
W20260811 06:16:59.036617 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 356) could send its response
I20260811 06:16:59.036988 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 357) took 2868 ms. Trace:
I20260811 06:16:59.037127 11368 rpcz_store.cc:276] 0811 06:16:56.168117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.168165 (+ 48us) service_pool.cc:227] Handling call
0811 06:16:59.036863 (+2868698us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:16:59.036873 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.036952 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2863553}
W20260811 06:16:59.037384 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 357) could send its response
I20260811 06:16:59.037660 11368 tablet_replica.cc:330] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:59.037979 11368 raft_consensus.cc:2229] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:59.031169 12308 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:16:59.038689 12308 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: LEADER
I20260811 06:16:59.030803 12168 tablet_loader.cc:96] loaded metadata for tablet 52344eea7d3548feb9949beb09b34492 (table default.Table_dc4f0ade100c4b05b31b548c1abe130e [id=a7bdc41eb968426092e5114e57d46415])
I20260811 06:16:59.041165 11365 consensus_queue.cc:260] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.042083 11368 raft_consensus.cc:2258] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.042385 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 274) took 4946 ms. Trace:
I20260811 06:16:59.042542 11370 rpcz_store.cc:276] 0811 06:16:54.096013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.096071 (+ 58us) service_pool.cc:227] Handling call
0811 06:16:58.949920 (+4853849us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:16:58.949931 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:58.986328 (+ 36397us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.022222 (+ 35894us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.042333 (+ 20111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4744236}
W20260811 06:16:59.042835 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 274) could send its response
I20260811 06:16:59.043354 12168 tablet_loader.cc:96] loaded metadata for tablet 52ecffcf4a0e46428caed6f7d72199bd (table default.Table_ae798943d2514f6488c7ae50b11ef679 [id=6265dc35475144bd9f4b3348ed37447a])
I20260811 06:16:59.043435 11365 ts_tablet_manager.cc:1428] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260811 06:16:59.043769 11365 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.044065 11368 ts_tablet_manager.cc:1905] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.044435 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 284) took 4527 ms. Trace:
I20260811 06:16:59.044764 12168 tablet_loader.cc:96] loaded metadata for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d])
I20260811 06:16:59.043896 11362 consensus_queue.cc:260] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.045846 11370 rpcz_store.cc:276] 0811 06:16:54.517442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.517542 (+ 100us) service_pool.cc:227] Handling call
0811 06:16:59.044277 (+4526735us) ts_tablet_manager.cc:1145] Deleting tablet 11c50f909aad4bb991bfdeae8eab8455
0811 06:16:59.044291 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.044397 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4524434}
I20260811 06:16:59.046341 11362 ts_tablet_manager.cc:1428] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20260811 06:16:59.046634 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 284) could send its response
I20260811 06:16:59.047019 11370 tablet_replica.cc:330] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.047227 12168 tablet_loader.cc:96] loaded metadata for tablet 54249325b2fa462bbc476ea609ec5389 (table default.Table_1eecfa20d58747f69101093c3f4c9443 [id=dcd0a85bedc24ef4b83da3f0786e87ff])
I20260811 06:16:59.047389 11362 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.049813 11961 raft_consensus.cc:482] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.050917 11365 tablet_bootstrap.cc:654] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.051095 11370 raft_consensus.cc:2229] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:59.051437 11370 pending_rounds.cc:62] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:16:59.051592 11370 pending_rounds.cc:68] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213261320114176 op_type: NO_OP noop_request { }
I20260811 06:16:59.051409 11961 raft_consensus.cc:504] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.051910 11370 raft_consensus.cc:2866] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:59.052202 11370 raft_consensus.cc:2258] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.052318 12168 tablet_loader.cc:96] loaded metadata for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87])
I20260811 06:16:59.052984 12168 tablet_loader.cc:96] loaded metadata for tablet 5753a44d13f943c695497573b56eec6c (table default.Table_0166e10f1b2a47f4a4cc8d09cc7468b9 [id=bfdd1158b74746a9a4da2ac0e8bfc177])
I20260811 06:16:59.053417 12168 tablet_loader.cc:96] loaded metadata for tablet 576a3e27d5424e4b999a05beb898d4bb (table default.Table_4f975881a087493596aaab9db2522ada [id=1fed2747c71345a79e630cd6c7e94aac])
I20260811 06:16:59.053629 11362 tablet_bootstrap.cc:654] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:59.053604 11047 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 9c5fa9633057485b917f117819d79398
I20260811 06:16:59.054550 11370 ts_tablet_manager.cc:1905] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.054850 12168 tablet_loader.cc:96] loaded metadata for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86])
I20260811 06:16:59.052378 11961 leader_election.cc:288] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:16:59.057531 11046 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 9c5fa9633057485b917f117819d79398
I20260811 06:16:59.057689 11046 leader_election.cc:302] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:59.058288 11961 raft_consensus.cc:2726] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.060402 12168 tablet_loader.cc:96] loaded metadata for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63])
I20260811 06:16:59.061658 11362 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.062216 11362 ts_tablet_manager.cc:1397] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260811 06:16:59.063335 11362 raft_consensus.cc:348] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.066978 12168 tablet_loader.cc:96] loaded metadata for tablet 5afbfec0bdf34619bf492d6803c73308 (table default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 [id=c967201f6db64a649b9c4d71e89222ff])
I20260811 06:16:59.068006 11961 raft_consensus.cc:482] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.068266 11961 raft_consensus.cc:504] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:59.069202 11961 leader_election.cc:288] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.070128 12251 raft_consensus.cc:482] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.070475 12251 raft_consensus.cc:504] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.071239 11370 ts_tablet_manager.cc:1918] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:59.071393 12251 leader_election.cc:288] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.071435 11370 log.cc:1196] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/cdb93dcd940a47e78c5458041c768e36
I20260811 06:16:59.071234 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1e42440ff14857b297621ca6031835" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.072916 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.074913 12168 tablet_loader.cc:96] loaded metadata for tablet 5ca903ee846a4e5baf3dbb4302607c1f (table default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646])
W20260811 06:16:59.074991 10555 leader_election.cc:341] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.075392 11362 raft_consensus.cc:374] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.075922 11362 raft_consensus.cc:729] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.076303 11365 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.076843 11365 ts_tablet_manager.cc:1397] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.007s
I20260811 06:16:59.076785 11362 consensus_queue.cc:260] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.077672 11368 ts_tablet_manager.cc:1918] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:59.077989 12168 tablet_loader.cc:96] loaded metadata for tablet 5d64ea5000504cbd82ecedcf5f6b78a9 (table default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81 [id=f7cb75ea2c454129b47c41cbe2e5c488])
I20260811 06:16:59.078683 12168 tablet_loader.cc:96] loaded metadata for tablet 5e990aa374204f2b95c08b04121176bc (table default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8])
I20260811 06:16:59.079245 12168 tablet_loader.cc:96] loaded metadata for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1882451cbcfe432aa9188327086bf0e3 [id=c881b1976ebe40dd8dc819e98a1d0581])
I20260811 06:16:59.079939 11368 log.cc:1196] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e180cc2c38aa4a78897e264276e4c766
I20260811 06:16:59.081054 11362 ts_tablet_manager.cc:1428] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.018s user 0.002s sys 0.001s
I20260811 06:16:59.081941 12168 tablet_loader.cc:96] loaded metadata for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab])
I20260811 06:16:59.082139 11362 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.082396 11368 ts_tablet_manager.cc:1939] T e180cc2c38aa4a78897e264276e4c766 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:16:59.086378 11046 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ae1e42440ff14857b297621ca6031835
I20260811 06:16:59.087472 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 358) took 2910 ms. Trace:
I20260811 06:16:59.088829 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.089195 12168 tablet_loader.cc:96] loaded metadata for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31])
I20260811 06:16:59.089537 11368 rpcz_store.cc:276] 0811 06:16:56.176542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.176588 (+ 46us) service_pool.cc:227] Handling call
0811 06:16:59.037595 (+2861007us) ts_tablet_manager.cc:1145] Deleting tablet e180cc2c38aa4a78897e264276e4c766
0811 06:16:59.037605 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.058757 (+ 21152us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.077533 (+ 18776us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.087260 (+ 9727us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2859799}
W20260811 06:16:59.089607 11047 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.090114 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 358) could send its response
W20260811 06:16:59.090283 10564 leader_election.cc:341] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.090654 10564 leader_election.cc:302] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.091238 12251 raft_consensus.cc:2726] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.091296 11047 leader_election.cc:302] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:59.091427 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 355) took 2923 ms. Trace:
I20260811 06:16:59.091660 11370 ts_tablet_manager.cc:1939] T cdb93dcd940a47e78c5458041c768e36 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.091611 11368 rpcz_store.cc:276] 0811 06:16:56.167252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.169189 (+ 1937us) service_pool.cc:227] Handling call
0811 06:16:59.090432 (+2921243us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:16:59.090498 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.090652 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2894144}
I20260811 06:16:59.091833 11961 raft_consensus.cc:2726] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:16:59.091935 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 355) could send its response
I20260811 06:16:59.092450 11362 tablet_bootstrap.cc:654] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.093186 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 283) took 4582 ms. Trace:
I20260811 06:16:59.093374 11370 rpcz_store.cc:276] 0811 06:16:54.511023 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.511093 (+ 70us) service_pool.cc:227] Handling call
0811 06:16:59.046948 (+4535855us) ts_tablet_manager.cc:1145] Deleting tablet cdb93dcd940a47e78c5458041c768e36
0811 06:16:59.046962 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.062898 (+ 15936us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.071089 (+ 8191us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.093134 (+ 22045us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4524891}
W20260811 06:16:59.093784 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 283) could send its response
I20260811 06:16:59.093773 11365 raft_consensus.cc:348] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.094328 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 282) took 4588 ms. Trace:
I20260811 06:16:59.094558 11365 raft_consensus.cc:374] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.094818 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 363) took 2874 ms. Trace:
I20260811 06:16:59.094830 11365 raft_consensus.cc:729] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.095414 11368 rpcz_store.cc:276] 0811 06:16:56.220219 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.220267 (+ 48us) service_pool.cc:227] Handling call
0811 06:16:59.093427 (+2873160us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:16:59.093440 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.094630 (+ 1190us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2866356}
I20260811 06:16:59.095497 11365 consensus_queue.cc:260] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.096065 11370 rpcz_store.cc:276] 0811 06:16:54.505833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.507410 (+ 1577us) service_pool.cc:227] Handling call
0811 06:16:59.094019 (+4586609us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:16:59.094032 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.094167 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4525023}
I20260811 06:16:59.097350 11365 ts_tablet_manager.cc:1428] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.020s user 0.002s sys 0.002s
W20260811 06:16:59.097874 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 363) could send its response
I20260811 06:16:59.098203 11365 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.098717 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 374) took 2705 ms. Trace:
I20260811 06:16:59.099958 11368 rpcz_store.cc:276] 0811 06:16:56.393349 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.396043 (+ 2694us) service_pool.cc:227] Handling call
0811 06:16:59.098197 (+2702154us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:16:59.098356 (+ 159us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.098529 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2530109}
W20260811 06:16:59.100479 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 374) could send its response
I20260811 06:16:59.101155 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 380) took 2516 ms. Trace:
I20260811 06:16:59.105048 11365 tablet_bootstrap.cc:654] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.105286 11368 rpcz_store.cc:276] 0811 06:16:56.584274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.643684 (+ 59410us) service_pool.cc:227] Handling call
0811 06:16:59.100782 (+2457098us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:16:59.100794 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.100949 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2446500}
W20260811 06:16:59.105824 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 380) could send its response
I20260811 06:16:59.106093 12168 tablet_loader.cc:96] loaded metadata for tablet 61671753b0964b3987bd3f33226857b7 (table default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77])
I20260811 06:16:59.106422 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 382) took 2512 ms. Trace:
I20260811 06:16:59.106596 11368 rpcz_store.cc:276] 0811 06:16:56.594314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.644143 (+ 49829us) service_pool.cc:227] Handling call
0811 06:16:59.106170 (+2462027us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:16:59.106182 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.106361 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2450577}
W20260811 06:16:59.106964 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 382) could send its response
I20260811 06:16:59.107475 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 381) took 2519 ms. Trace:
I20260811 06:16:59.107576 12168 tablet_loader.cc:96] loaded metadata for tablet 67e2683156f8466b8d63b298c9da15c1 (table default.Table_525aee396dc64b5c8c61da99ad866f4a [id=53bd4127d81e4fb092a5943858c8ee51])
I20260811 06:16:59.107626 11368 rpcz_store.cc:276] 0811 06:16:56.587792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.644008 (+ 56216us) service_pool.cc:227] Handling call
0811 06:16:59.107282 (+2463274us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:16:59.107309 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.107415 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2447280}
W20260811 06:16:59.108042 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 381) could send its response
I20260811 06:16:59.108516 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 383) took 2490 ms. Trace:
I20260811 06:16:59.108665 11368 rpcz_store.cc:276] 0811 06:16:56.617610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.654338 (+ 36728us) service_pool.cc:227] Handling call
0811 06:16:59.108339 (+2454001us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:16:59.108350 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.108447 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2447371}
W20260811 06:16:59.108980 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 383) could send its response
I20260811 06:16:59.109367 11368 tablet_replica.cc:330] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:59.109658 11368 raft_consensus.cc:2229] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.110001 11368 raft_consensus.cc:2258] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.110563 12168 tablet_loader.cc:96] loaded metadata for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9])
I20260811 06:16:59.111299 12168 tablet_loader.cc:96] loaded metadata for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_9a7b04bde68640deb63e6bdbd0f322d9 [id=7b85de4e62004d3bab802b1878b0722e])
I20260811 06:16:59.111361 11368 ts_tablet_manager.cc:1905] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.112406 12168 tablet_loader.cc:96] loaded metadata for tablet 714247a11705421b9c012d99bdbf3d04 (table default.Table_ee1aab676e354fb484ae487d4316b261 [id=a66e3380ba3d46ca93a6f98468b36cc3])
I20260811 06:16:59.113189 12168 tablet_loader.cc:96] loaded metadata for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa])
I20260811 06:16:59.109413 11361 tablet_bootstrap.cc:492] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:16:59.113850 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 282) could send its response
I20260811 06:16:59.114039 11361 ts_tablet_manager.cc:1397] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.121s user 0.011s sys 0.004s
I20260811 06:16:59.115072 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 299) took 4422 ms. Trace:
I20260811 06:16:59.115933 12168 tablet_loader.cc:96] loaded metadata for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb])
I20260811 06:16:59.116423 12168 tablet_loader.cc:96] loaded metadata for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd])
I20260811 06:16:59.116871 12168 tablet_loader.cc:96] loaded metadata for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c])
I20260811 06:16:59.117316 12168 tablet_loader.cc:96] loaded metadata for tablet 7821b08482ed49ea8e90155805a88ae5 (table default.Table_2688b67c9243454f9fe9823b4e9c1318 [id=2f00a94a6f874331b2e6fbce027260bf])
I20260811 06:16:59.117983 12168 tablet_loader.cc:96] loaded metadata for tablet 79f307f50e044435be880079219170d8 (table default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b])
I20260811 06:16:59.118724 11362 tablet_bootstrap.cc:492] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.118736 12168 tablet_loader.cc:96] loaded metadata for tablet 7bcc463affbb4154877624aec28435bc (table default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf])
I20260811 06:16:59.119030 11362 ts_tablet_manager.cc:1397] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.003s
I20260811 06:16:59.119045 12168 tablet_loader.cc:96] loaded metadata for tablet 7c01d05b8769440d8c7a544c0e9d80b4 (table default.Table_4417703678a641a18717b8d5d7b2e294 [id=b0d2e30d0a0348d8bf26a93b2aa577e6])
I20260811 06:16:59.115293 11361 raft_consensus.cc:348] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.119910 12168 tablet_loader.cc:96] loaded metadata for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_364d018e0f034bee935a0a9ab1249f34 [id=f8872b7a8c2140e3acbb418a770173cc])
I20260811 06:16:59.120076 12251 raft_consensus.cc:482] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.120287 12251 raft_consensus.cc:504] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.120437 11362 raft_consensus.cc:348] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.120682 12168 tablet_loader.cc:96] loaded metadata for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb])
I20260811 06:16:59.120716 11362 raft_consensus.cc:374] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.120790 11362 raft_consensus.cc:729] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.121065 12251 leader_election.cc:288] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.121086 11362 consensus_queue.cc:260] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.121261 12168 tablet_loader.cc:96] loaded metadata for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1])
I20260811 06:16:59.119827 11370 rpcz_store.cc:276] 0811 06:16:54.692129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.694752 (+ 2623us) service_pool.cc:227] Handling call
0811 06:16:59.114838 (+4420086us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:16:59.114853 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.115017 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4415309}
W20260811 06:16:59.122614 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 299) could send its response
I20260811 06:16:59.122787 11362 ts_tablet_manager.cc:1428] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:16:59.123088 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 300) took 4428 ms. Trace:
I20260811 06:16:59.123216 11370 rpcz_store.cc:276] 0811 06:16:54.695032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.699544 (+ 4512us) service_pool.cc:227] Handling call
0811 06:16:59.122914 (+4423370us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:16:59.122926 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.123052 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4302510}
I20260811 06:16:59.123392 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.123467 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 300) could send its response
I20260811 06:16:59.124078 11362 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:16:59.125643 10555 leader_election.cc:341] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.127334 11362 tablet_bootstrap.cc:654] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.127277 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 301) took 4430 ms. Trace:
I20260811 06:16:59.127427 11370 rpcz_store.cc:276] 0811 06:16:54.696602 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.820445 (+123843us) service_pool.cc:227] Handling call
0811 06:16:59.127070 (+4306625us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:16:59.127084 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.127232 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4271593}
W20260811 06:16:59.127763 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 301) could send its response
I20260811 06:16:59.128192 12251 raft_consensus.cc:482] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.128396 12251 raft_consensus.cc:504] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.129117 12251 leader_election.cc:288] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.129923 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.130676 10564 leader_election.cc:341] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.131623 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.132508 10555 leader_election.cc:341] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.132697 10555 leader_election.cc:302] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.133358 12251 raft_consensus.cc:2726] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.134034 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 303) took 4293 ms. Trace:
I20260811 06:16:59.134233 11370 rpcz_store.cc:276] 0811 06:16:54.840264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:54.857398 (+ 17134us) service_pool.cc:227] Handling call
0811 06:16:59.133789 (+4276391us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:16:59.133806 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.133985 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4269849}
W20260811 06:16:59.134629 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 303) could send its response
I20260811 06:16:59.134984 11370 tablet_replica.cc:330] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.135284 11370 raft_consensus.cc:2229] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.135540 11370 raft_consensus.cc:2258] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.119864 11361 raft_consensus.cc:374] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.122010 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.136183 11361 raft_consensus.cc:729] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.136443 11361 consensus_queue.cc:260] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:59.136708 10564 leader_election.cc:341] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.136842 10564 leader_election.cc:302] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.137049 11361 ts_tablet_manager.cc:1428] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260811 06:16:59.137370 11361 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.137346 11368 ts_tablet_manager.cc:1918] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:59.137494 11368 log.cc:1196] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:16:59.138643 12251 raft_consensus.cc:2726] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.139462 11361 tablet_bootstrap.cc:654] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.139811 11362 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.139966 11362 ts_tablet_manager.cc:1397] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20260811 06:16:59.140863 11362 raft_consensus.cc:348] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.141321 11362 raft_consensus.cc:374] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.141484 12168 tablet_loader.cc:96] loaded metadata for tablet 866460b8d10a4cd1aed8a7a4e5511b29 (table default.Table_ae64cada77924676bd6d9731a89a7a6b [id=71b79ba7b26744d99e8d71863b12b5a5])
I20260811 06:16:59.141489 11362 raft_consensus.cc:729] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.141834 11362 consensus_queue.cc:260] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.143440 11362 ts_tablet_manager.cc:1428] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 06:16:59.144742 11368 ts_tablet_manager.cc:1939] T 516021603ee24b3f9bdffd1e30e5ea9d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:59.145071 11362 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.145987 11370 ts_tablet_manager.cc:1905] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.147601 11362 tablet_bootstrap.cc:654] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.148878 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 384) took 2197 ms. Trace:
I20260811 06:16:59.149031 11368 rpcz_store.cc:276] 0811 06:16:56.951904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.952606 (+ 702us) service_pool.cc:227] Handling call
0811 06:16:59.109270 (+2156664us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:16:59.109283 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.133999 (+ 24716us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.137198 (+ 3199us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.148840 (+ 11642us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141567}
W20260811 06:16:59.149320 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 384) could send its response
I20260811 06:16:59.149428 11365 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.151667 11365 ts_tablet_manager.cc:1397] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.013s
I20260811 06:16:59.152799 11365 raft_consensus.cc:348] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.153209 11365 raft_consensus.cc:374] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.153342 11365 raft_consensus.cc:729] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.153594 11365 consensus_queue.cc:260] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.154098 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 400) took 1972 ms. Trace:
I20260811 06:16:59.154261 11368 rpcz_store.cc:276] 0811 06:16:57.182026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.185808 (+ 3782us) service_pool.cc:227] Handling call
0811 06:16:59.153872 (+1968064us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:16:59.153889 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.154045 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1925230}
W20260811 06:16:59.154682 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 400) could send its response
I20260811 06:16:59.156059 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 404) took 1973 ms. Trace:
I20260811 06:16:59.156221 11368 rpcz_store.cc:276] 0811 06:16:57.182687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.375218 (+192531us) service_pool.cc:227] Handling call
0811 06:16:59.155873 (+1780655us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:16:59.155887 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.156022 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1780201}
W20260811 06:16:59.156497 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 404) could send its response
I20260811 06:16:59.156849 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 405) took 1973 ms. Trace:
I20260811 06:16:59.156999 11368 rpcz_store.cc:276] 0811 06:16:57.183061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.377315 (+194254us) service_pool.cc:227] Handling call
0811 06:16:59.156707 (+1779392us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:16:59.156719 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.156818 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9292,"tablet-delete.queue_time_us":1779061}
W20260811 06:16:59.157263 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 405) could send its response
I20260811 06:16:59.157637 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 408) took 1974 ms. Trace:
I20260811 06:16:59.157801 11368 rpcz_store.cc:276] 0811 06:16:57.183644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.388615 (+204971us) service_pool.cc:227] Handling call
0811 06:16:59.157509 (+1768894us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:16:59.157519 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.157606 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670060}
W20260811 06:16:59.158052 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 408) could send its response
I20260811 06:16:59.158313 11368 tablet_replica.cc:330] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:59.158586 11368 raft_consensus.cc:2229] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.159132 11368 raft_consensus.cc:2258] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.160130 11365 ts_tablet_manager.cc:1428] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260811 06:16:59.160816 11368 ts_tablet_manager.cc:1905] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.161149 11365 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.163847 11362 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.164196 11362 ts_tablet_manager.cc:1397] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260811 06:16:59.164522 11370 ts_tablet_manager.cc:1918] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:59.166188 11362 raft_consensus.cc:348] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.166527 11361 tablet_bootstrap.cc:492] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.166960 11361 ts_tablet_manager.cc:1397] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260811 06:16:59.166813 11362 raft_consensus.cc:374] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.167173 11370 log.cc:1196] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/b0d203f652b24b4897e62fc8c03d32df
I20260811 06:16:59.167237 11362 raft_consensus.cc:729] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.167743 11361 raft_consensus.cc:348] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.168280 11365 tablet_bootstrap.cc:654] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.168455 11361 raft_consensus.cc:374] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.168561 11361 raft_consensus.cc:729] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.168720 11370 ts_tablet_manager.cc:1939] T b0d203f652b24b4897e62fc8c03d32df P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.168866 11361 consensus_queue.cc:260] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.168869 11362 consensus_queue.cc:260] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.170569 11361 ts_tablet_manager.cc:1428] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:16:59.172039 11361 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.174736 11361 tablet_bootstrap.cc:654] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.175701 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 307) took 4147 ms. Trace:
I20260811 06:16:59.175714 11362 ts_tablet_manager.cc:1428] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:16:59.175999 11370 rpcz_store.cc:276] 0811 06:16:55.028433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.028500 (+ 67us) service_pool.cc:227] Handling call
0811 06:16:59.134918 (+4106418us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:16:59.134930 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.149942 (+ 15012us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.164291 (+ 14349us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.175628 (+ 11337us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4103825}
W20260811 06:16:59.176400 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 307) could send its response
I20260811 06:16:59.176756 11362 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.177070 11961 raft_consensus.cc:482] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.177258 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 306) took 4156 ms. Trace:
I20260811 06:16:59.177251 11961 raft_consensus.cc:504] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.177448 11370 rpcz_store.cc:276] 0811 06:16:55.020856 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.023901 (+ 3045us) service_pool.cc:227] Handling call
0811 06:16:59.176696 (+4152795us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:16:59.176708 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.177120 (+ 412us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4136837}
W20260811 06:16:59.177928 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 306) could send its response
I20260811 06:16:59.177989 11961 leader_election.cc:288] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.178431 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 323) took 3708 ms. Trace:
I20260811 06:16:59.178599 11370 rpcz_store.cc:276] 0811 06:16:55.470145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.471825 (+ 1680us) service_pool.cc:227] Handling call
0811 06:16:59.178256 (+3706431us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:16:59.178268 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.178379 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3696121}
I20260811 06:16:59.178664 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d668bcfbeff54181ba3b4407b1eb5704" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:16:59.178930 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 323) could send its response
I20260811 06:16:59.178979 10659 raft_consensus.cc:2454] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:59.179280 11370 tablet_replica.cc:330] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.179484 11046 leader_election.cc:302] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.179742 11370 raft_consensus.cc:2229] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.180016 11370 raft_consensus.cc:2258] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.180337 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d668bcfbeff54181ba3b4407b1eb5704" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.180604 10922 raft_consensus.cc:2454] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:59.180845 11370 ts_tablet_manager.cc:1905] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.180924 11362 tablet_bootstrap.cc:654] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.181099 12251 raft_consensus.cc:482] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.181289 11961 raft_consensus.cc:2781] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.181267 12251 raft_consensus.cc:504] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.181406 11961 raft_consensus.cc:482] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.181505 11961 raft_consensus.cc:3037] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.181964 12251 leader_election.cc:288] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.182955 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.183192 10922 raft_consensus.cc:2454] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:59.183640 10555 leader_election.cc:302] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.184330 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.184373 11961 raft_consensus.cc:504] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:59.185058 10564 leader_election.cc:341] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.185674 12251 raft_consensus.cc:2781] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.185649 12168 tablet_loader.cc:96] loaded metadata for tablet 8ad42cef6aad49a1932bf1e9b20e169c (table default.Table_c5d51bfe8d4f4ac084ad0692d3c334be [id=12b005d427d949009b95d8f8a203e5c3])
I20260811 06:16:59.185813 12251 raft_consensus.cc:482] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.185781 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d668bcfbeff54181ba3b4407b1eb5704" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.185931 12251 raft_consensus.cc:3037] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.186017 10659 raft_consensus.cc:3037] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.186203 12168 tablet_loader.cc:96] loaded metadata for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (table default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b])
I20260811 06:16:59.186589 12168 tablet_loader.cc:96] loaded metadata for tablet 8b8b12e80bc54e58a63d45bde8faac89 (table default.Table_41e1f2dfdfa04338a8cecda87d649f86 [id=06b4ac61ca8a41f788cc0949b6991ce2])
I20260811 06:16:59.186939 12168 tablet_loader.cc:96] loaded metadata for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387])
I20260811 06:16:59.187536 12168 tablet_loader.cc:96] loaded metadata for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990])
I20260811 06:16:59.187855 12168 tablet_loader.cc:96] loaded metadata for tablet 8fb4dba9d9bb4f278b5a43c124c7b509 (table default.Table_d619bfe299b14454abfe4a31106bb81d [id=426356f4c6f6426ab91d0dd3cd349304])
I20260811 06:16:59.188410 12168 tablet_loader.cc:96] loaded metadata for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c])
I20260811 06:16:59.188956 12251 raft_consensus.cc:504] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.189419 12168 tablet_loader.cc:96] loaded metadata for tablet 97886e07a36049b992a75d99081d32c4 (table default.Table_7704cd8b9ad742bd92383ed86acacc8c [id=7457527ea9f143f0a1d5ead22ee5b5d8])
I20260811 06:16:59.189379 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d668bcfbeff54181ba3b4407b1eb5704" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:59.189656 10922 raft_consensus.cc:3037] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.190012 12168 tablet_loader.cc:96] loaded metadata for tablet 99ecc0c0f0e5450abacd9da8fe5a19a7 (table default.Table_12c813de7c074af4a5f244b7b9c3d9aa [id=2ede34034a9a4280840d8e8e77773ad2])
I20260811 06:16:59.192589 10922 raft_consensus.cc:2454] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:59.193161 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.193125 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:59.193451 10921 raft_consensus.cc:3037] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:59.193918 10564 leader_election.cc:341] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.189065 10659 raft_consensus.cc:2454] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:59.194846 12251 leader_election.cc:288] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.196266 10921 raft_consensus.cc:2454] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:16:59.196979 10555 leader_election.cc:302] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.197537 11046 leader_election.cc:302] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.197870 12094 raft_consensus.cc:2781] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.198024 12094 raft_consensus.cc:686] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:59.198316 12094 consensus_queue.cc:237] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.201038 11961 leader_election.cc:288] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.201406 12251 raft_consensus.cc:2781] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.201664 12251 raft_consensus.cc:686] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:59.202934 12251 consensus_queue.cc:237] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.205088 12168 tablet_loader.cc:96] loaded metadata for tablet 9a79e23d311a447480c70393259cbfae (table default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 [id=c0ef340b9da1418abb2a9831abc3cec5])
I20260811 06:16:59.205948 12168 tablet_loader.cc:96] loaded metadata for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_d7b23f45b7b14c719f98c5b359db7502 [id=8444a45079b34969a38481a4b00c1352])
I20260811 06:16:59.206704 12168 tablet_loader.cc:96] loaded metadata for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99])
I20260811 06:16:59.207135 12168 tablet_loader.cc:96] loaded metadata for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89])
I20260811 06:16:59.207579 12168 tablet_loader.cc:96] loaded metadata for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd])
I20260811 06:16:59.208487 11368 ts_tablet_manager.cc:1918] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:59.208662 12168 tablet_loader.cc:96] loaded metadata for tablet a1da7a10783f4bb9aadb20668aee95c2 (table default.Table_f108c0e6821b45039886e052f9f9dba3 [id=5936fbf06baf4ab0b2e34f9997c81e3b])
I20260811 06:16:59.208669 11368 log.cc:1196] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a4a46cec25944310a838d8323b119883
I20260811 06:16:59.209101 11368 ts_tablet_manager.cc:1939] T a4a46cec25944310a838d8323b119883 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:59.209671 12168 tablet_loader.cc:96] loaded metadata for tablet a25398c10a134356ac21b8a356eba46c (table default.Table_3b1ac4a64e764c4199189b7239086a89 [id=c15ad397c32d4fb9b3e64edcb9d35c89])
I20260811 06:16:59.211143 12168 tablet_loader.cc:96] loaded metadata for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364])
I20260811 06:16:59.211627 12168 tablet_loader.cc:96] loaded metadata for tablet a2f8100e334a4fd1b3c9b059e3bdef3e (table default.Table_e37a4f07d9434d77a1a6ec7dfe022355 [id=1b9f2c3cb4854a7184b662f5ff2bad55])
W20260811 06:16:59.212082 11047 consensus_peers.cc:487] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.212378 12168 tablet_loader.cc:96] loaded metadata for tablet a33fc402d3084b458929d76b8fc22adb (table default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1])
I20260811 06:16:59.214517 12168 tablet_loader.cc:96] loaded metadata for tablet a5008449b09e43fba758a7edab4a5c48 (table default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd])
I20260811 06:16:59.214674 11361 tablet_bootstrap.cc:492] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.214787 11365 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.214932 11361 ts_tablet_manager.cc:1397] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.001s
I20260811 06:16:59.215086 11365 ts_tablet_manager.cc:1397] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.002s
I20260811 06:16:59.215809 12168 tablet_loader.cc:96] loaded metadata for tablet a8513fc279dc44f48c45e9dda40e5398 (table default.Table_3d5b15230b7540f29a0085d1018944fb [id=7bef46a8e8374c59b811e037981d997f])
I20260811 06:16:59.216523 11361 raft_consensus.cc:348] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.216846 11361 raft_consensus.cc:374] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.216596 11365 raft_consensus.cc:348] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.217092 11365 raft_consensus.cc:374] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.217098 11361 raft_consensus.cc:729] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.217280 11365 raft_consensus.cc:729] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.217705 11361 consensus_queue.cc:260] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.218779 11361 ts_tablet_manager.cc:1428] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 06:16:59.220779 11361 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.225337 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 410) took 1964 ms. Trace:
I20260811 06:16:59.227607 11361 tablet_bootstrap.cc:654] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.217885 11365 consensus_queue.cc:260] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.232751 11365 ts_tablet_manager.cc:1428] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.000s sys 0.003s
I20260811 06:16:59.233466 11365 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.225554 11368 rpcz_store.cc:276] 0811 06:16:57.261433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.487497 (+226064us) service_pool.cc:227] Handling call
0811 06:16:59.158254 (+1670757us) ts_tablet_manager.cc:1145] Deleting tablet a4a46cec25944310a838d8323b119883
0811 06:16:59.158263 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.204982 (+ 46719us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.208337 (+ 3355us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.225217 (+ 16880us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670528}
W20260811 06:16:59.235190 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 410) could send its response
I20260811 06:16:59.235893 11368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 409) took 2051 ms. Trace:
I20260811 06:16:59.236192 11370 ts_tablet_manager.cc:1918] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:16:59.236481 11370 log.cc:1196] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/5d0530ec053f47df800cf2abf549b068
I20260811 06:16:59.237111 11370 ts_tablet_manager.cc:1939] T 5d0530ec053f47df800cf2abf549b068 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.237269 11368 rpcz_store.cc:276] 0811 06:16:57.183831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.480471 (+296640us) service_pool.cc:227] Handling call
0811 06:16:59.234841 (+1754370us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:16:59.234856 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.235535 (+ 679us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688964}
W20260811 06:16:59.237879 10811 connection.cc:441] server connection from 127.0.0.1:48778 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48778 (request call id 409) could send its response
I20260811 06:16:59.238121 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 316) took 3834 ms. Trace:
I20260811 06:16:59.238379 11370 rpcz_store.cc:276] 0811 06:16:55.403264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.404551 (+ 1287us) service_pool.cc:227] Handling call
0811 06:16:59.179198 (+3774647us) ts_tablet_manager.cc:1145] Deleting tablet 5d0530ec053f47df800cf2abf549b068
0811 06:16:59.179209 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.207739 (+ 28530us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.235988 (+ 28249us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.238078 (+ 2090us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3696839}
W20260811 06:16:59.238909 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 316) could send its response
I20260811 06:16:59.240403 11362 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.240667 11362 ts_tablet_manager.cc:1397] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.064s user 0.013s sys 0.000s
I20260811 06:16:59.241971 11365 tablet_bootstrap.cc:654] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.242158 11362 raft_consensus.cc:348] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.242549 11362 raft_consensus.cc:374] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.242791 11362 raft_consensus.cc:729] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.232828 12168 tablet_loader.cc:96] loaded metadata for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd])
I20260811 06:16:59.245658 11362 consensus_queue.cc:260] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.247224 12168 tablet_loader.cc:96] loaded metadata for tablet b7409453e6e34172870dbb9fb3c5ac44 (table default.Table_f07dfeeb52d64d08811e3b22d8861f62 [id=5ba59e9fdaef4ce389c3495e99dd16e1])
I20260811 06:16:59.252157 12168 tablet_loader.cc:96] loaded metadata for tablet b8fefa0f4ed44b87825cc34f7ecafcbf (table default.Table_36da3a35575f40f6874a2055c8fc7faf [id=704fa680cec24a979014dbf21703f12b])
I20260811 06:16:59.253875 11362 ts_tablet_manager.cc:1428] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260811 06:16:59.256704 11361 tablet_bootstrap.cc:492] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.256920 11361 ts_tablet_manager.cc:1397] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.005s
I20260811 06:16:59.257843 11361 raft_consensus.cc:348] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.258178 11361 raft_consensus.cc:374] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.258356 11361 raft_consensus.cc:729] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.258798 11361 consensus_queue.cc:260] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.260135 12168 tablet_loader.cc:96] loaded metadata for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d])
I20260811 06:16:59.260751 11361 ts_tablet_manager.cc:1428] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:16:59.261073 11362 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.261963 11361 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:16:59.263761 11047 consensus_peers.cc:487] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.267144 12168 tablet_loader.cc:96] loaded metadata for tablet c03f18c65ada4b0b86534d29cd363d9a (table default.Table_4530e0ff64ae41b8a453e4be20673822 [id=3c39ffa2022447068fcc6f6f551a38a6])
I20260811 06:16:59.267362 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 324) took 3795 ms. Trace:
I20260811 06:16:59.267736 12272 raft_consensus.cc:482] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.268011 12272 raft_consensus.cc:504] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.268775 12168 tablet_loader.cc:96] loaded metadata for tablet c2c014c792fe4f309d15856f63f47cc9 (table default.Table_e978aa9dd9f64a6396130a9ef90b76ba [id=88fcae658b144d79a96df7c2b30a26a2])
I20260811 06:16:59.268797 12272 leader_election.cc:288] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.268887 11362 tablet_bootstrap.cc:654] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.269256 12168 tablet_loader.cc:96] loaded metadata for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_28d17bc11c5147c785d93e4351465ea9 [id=bf45c731d6e4455d9873db38c9863033])
I20260811 06:16:59.269585 12251 raft_consensus.cc:482] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.269757 12168 tablet_loader.cc:96] loaded metadata for tablet c42f153889c7490ea33002e3a857c631 (table default.Table_e1d6c05437784e07a5b7deefec230ae5 [id=47be197bbc8f46ea88c0436869954992])
I20260811 06:16:59.269899 12251 raft_consensus.cc:504] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.270303 12168 tablet_loader.cc:96] loaded metadata for tablet c5c3e243e72f4cffb3318246ab428bd6 (table default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5])
I20260811 06:16:59.270834 12168 tablet_loader.cc:96] loaded metadata for tablet c7b24ba5f0434f8b804ec6e8631095b6 (table default.Table_af483278f0004121a846ca38bec9d8d8 [id=101a0c8ac67443e8925b8770d0d105e2])
I20260811 06:16:59.271107 12251 leader_election.cc:288] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.271620 12168 tablet_loader.cc:96] loaded metadata for tablet cce9f8fd074348ffb60abcc086ac0519 (table default.Table_ab1832782184476f9e838bca820e45e5 [id=395d4cbde0114d879ead277a47184ce6])
I20260811 06:16:59.272234 12168 tablet_loader.cc:96] loaded metadata for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733])
I20260811 06:16:59.272980 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.273291 12168 tablet_loader.cc:96] loaded metadata for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273])
I20260811 06:16:59.273918 12168 tablet_loader.cc:96] loaded metadata for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b])
W20260811 06:16:59.274004 10555 leader_election.cc:341] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.274366 10810 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: b0d203f652b24b4897e62fc8c03d32df
I20260811 06:16:59.275967 11370 rpcz_store.cc:276] 0811 06:16:55.470329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.471846 (+ 1517us) service_pool.cc:227] Handling call
0811 06:16:59.264987 (+3793141us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:16:59.265992 (+ 1005us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.266154 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3771226}
W20260811 06:16:59.276394 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 324) could send its response
I20260811 06:16:59.276609 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.277114 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 327) took 3782 ms. Trace:
I20260811 06:16:59.277379 11370 rpcz_store.cc:276] 0811 06:16:55.494093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.494143 (+ 50us) service_pool.cc:227] Handling call
0811 06:16:59.276712 (+3782569us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:16:59.276852 (+ 140us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.276992 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3777187}
I20260811 06:16:59.277894 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 326) took 3786 ms. Trace:
I20260811 06:16:59.275477 12168 tablet_loader.cc:96] loaded metadata for tablet d45055341dab44089b2fc3fe25256073 (table default.Table_fa6e7eb493bf4dbb86702a219a388acb [id=8ae837e4085947f783acb33a801b60cf])
W20260811 06:16:59.278122 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 327) could send its response
W20260811 06:16:59.278170 10813 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: b0d203f652b24b4897e62fc8c03d32df
I20260811 06:16:59.278348 11370 rpcz_store.cc:276] 0811 06:16:55.491164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.491264 (+ 100us) service_pool.cc:227] Handling call
0811 06:16:59.277624 (+3786360us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:16:59.277634 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.277775 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3769978}
I20260811 06:16:59.278501 10813 leader_election.cc:302] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:16:59.278680 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 326) could send its response
I20260811 06:16:59.279217 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 325) took 3788 ms. Trace:
I20260811 06:16:59.279253 12272 raft_consensus.cc:2726] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.279276 12168 tablet_loader.cc:96] loaded metadata for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965])
I20260811 06:16:59.279492 11370 rpcz_store.cc:276] 0811 06:16:55.490565 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.490675 (+ 110us) service_pool.cc:227] Handling call
0811 06:16:59.278938 (+3788263us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:16:59.278948 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.279109 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3770573}
W20260811 06:16:59.280026 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 325) could send its response
I20260811 06:16:59.280239 12168 tablet_loader.cc:96] loaded metadata for tablet da30a4db5b334cf88b01648c336a7ade (table default.Table_03a56dbcc387459a9a6ae4fdfb454c6a [id=32c58f06cf094acdac22d9ca6fe36811])
W20260811 06:16:59.286098 10564 leader_election.cc:341] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.286188 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 328) took 3777 ms. Trace:
I20260811 06:16:59.286393 10564 leader_election.cc:302] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.286453 11370 rpcz_store.cc:276] 0811 06:16:55.512571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.512709 (+ 138us) service_pool.cc:227] Handling call
0811 06:16:59.280252 (+3767543us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:16:59.285829 (+ 5577us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.286069 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3766207}
W20260811 06:16:59.286895 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 328) could send its response
I20260811 06:16:59.286983 11370 tablet_replica.cc:330] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.287369 11370 raft_consensus.cc:2229] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:59.287354 12251 raft_consensus.cc:2726] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.287830 11370 raft_consensus.cc:2258] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.288619 11370 ts_tablet_manager.cc:1905] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:16:59.288655 11046 consensus_peers.cc:487] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.289000 11362 tablet_bootstrap.cc:492] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.288992 11365 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.289355 11361 tablet_bootstrap.cc:654] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.289369 11362 ts_tablet_manager.cc:1397] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260811 06:16:59.289340 11365 ts_tablet_manager.cc:1397] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.056s user 0.007s sys 0.025s
I20260811 06:16:59.290899 12168 tablet_loader.cc:96] loaded metadata for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (table default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0])
I20260811 06:16:59.291294 11362 raft_consensus.cc:348] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:59.292650 12168 tablet_loader.cc:96] loaded metadata for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3])
I20260811 06:16:59.292268 11365 raft_consensus.cc:348] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.293190 11365 raft_consensus.cc:374] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.293594 11365 raft_consensus.cc:729] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.293751 11362 raft_consensus.cc:374] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.294068 11362 raft_consensus.cc:729] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.294632 11362 consensus_queue.cc:260] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:59.294612 11365 consensus_queue.cc:260] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.296190 11365 ts_tablet_manager.cc:1428] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260811 06:16:59.297037 11365 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.297493 11362 ts_tablet_manager.cc:1428] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260811 06:16:59.296191 12168 tablet_loader.cc:96] loaded metadata for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377])
I20260811 06:16:59.298663 12168 tablet_loader.cc:96] loaded metadata for tablet e18f96539b76422ab3ae65bdfe2cf74d (table default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d])
I20260811 06:16:59.299299 11362 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.305029 11365 tablet_bootstrap.cc:654] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.306015 11362 tablet_bootstrap.cc:654] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.311986 12168 tablet_loader.cc:96] loaded metadata for tablet e1ee53b81b8a441d8f9186bceb61129c (table default.Table_a0997cec306c4b50b9124325c4c92376 [id=b6b38c2a8b4e41558cd3812425fed659])
I20260811 06:16:59.315347 12168 tablet_loader.cc:96] loaded metadata for tablet e4171d257dd6453a9159c59ae713b2e0 (table default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770])
I20260811 06:16:59.318758 12168 tablet_loader.cc:96] loaded metadata for tablet e7a707e7a6394e7a916001c0278a97bd (table default.Table_99ba61ba26854472b2956b8a4f61302b [id=0752fbfa69b24536ad4677ffe00d4032])
I20260811 06:16:59.319260 11365 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.319801 12168 tablet_loader.cc:96] loaded metadata for tablet e7dc9bfb0c444d799b18c3e647b186fa (table default.Table_1a6ec07940654e19aa7ab999ba7462cb [id=059f7292deab4fbcb4ba097aa1737fbe])
I20260811 06:16:59.319890 11365 ts_tablet_manager.cc:1397] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.003s
I20260811 06:16:59.321695 12168 tablet_loader.cc:96] loaded metadata for tablet e8dfa9eb84334e9e86434aa2d9593efd (table default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40])
I20260811 06:16:59.322785 11365 raft_consensus.cc:348] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.323850 11362 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.324055 11365 raft_consensus.cc:374] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.324242 11365 raft_consensus.cc:729] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.324602 12272 raft_consensus.cc:482] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.324734 11365 consensus_queue.cc:260] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.325124 12272 raft_consensus.cc:504] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:59.326002 12272 leader_election.cc:288] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:59.326077 11960 raft_consensus.cc:482] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.326036 11365 ts_tablet_manager.cc:1428] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:16:59.326378 11960 raft_consensus.cc:504] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.327122 11960 leader_election.cc:288] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.327140 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.327257 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.327657 10659 raft_consensus.cc:2454] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:16:59.328135 10813 leader_election.cc:341] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.328292 11362 ts_tablet_manager.cc:1397] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.006s
I20260811 06:16:59.328388 10810 leader_election.cc:302] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.328878 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.329149 10659 raft_consensus.cc:2454] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.329375 11365 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.329854 11362 raft_consensus.cc:348] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.330179 11362 raft_consensus.cc:374] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.330420 11362 raft_consensus.cc:729] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.330447 10810 leader_election.cc:302] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.331182 11960 raft_consensus.cc:2781] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.331365 11960 raft_consensus.cc:482] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.331389 12168 tablet_loader.cc:96] loaded metadata for tablet eb437660103845aa98af100aef1c3021 (table default.Table_60f9ff39184a401d92a346f88abbd7e3 [id=3d036ef0c0fb497ba15fe0468f792eab])
I20260811 06:16:59.331724 11960 raft_consensus.cc:3037] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.330744 11362 consensus_queue.cc:260] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.332723 11362 ts_tablet_manager.cc:1428] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:16:59.333261 12168 tablet_loader.cc:96] loaded metadata for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538])
I20260811 06:16:59.334069 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.336835 11362 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.337249 12168 tablet_loader.cc:96] loaded metadata for tablet ed52a1eb610e4e39bbdb69a494c3575c (table default.Table_6592e2a580a042a1854bdf75d49a8851 [id=e7784bea62394467aaf754f81a66521c])
I20260811 06:16:59.338155 12251 raft_consensus.cc:482] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.338325 12251 raft_consensus.cc:504] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.338649 12168 tablet_loader.cc:96] loaded metadata for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac [id=587929f897ff4559a8fc4f15e4346433])
I20260811 06:16:59.339099 12251 leader_election.cc:288] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.339246 11365 tablet_bootstrap.cc:654] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.339653 12272 raft_consensus.cc:2781] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.339917 12272 raft_consensus.cc:482] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.340291 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.341164 10564 leader_election.cc:341] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.341378 12168 tablet_loader.cc:96] loaded metadata for tablet f1276a6c043948529b7537081e34b257 (table default.Table_5940fa3078de423d855e54ba1af1597a [id=688e4024d52e40dd9e84aa7a08e8f33a])
I20260811 06:16:59.342320 12272 raft_consensus.cc:3037] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.342933 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.343910 10555 leader_election.cc:341] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.344219 10555 leader_election.cc:302] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.344858 12251 raft_consensus.cc:2726] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.346199 12168 tablet_loader.cc:96] loaded metadata for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd])
I20260811 06:16:59.346917 11370 ts_tablet_manager.cc:1918] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:59.347165 11158 raft_consensus.cc:2454] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.348779 11370 log.cc:1196] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c00b6bdfc8ac4b5db81de9f614fcf213
I20260811 06:16:59.349121 11362 tablet_bootstrap.cc:654] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.349249 12285 raft_consensus.cc:482] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.351353 12285 raft_consensus.cc:504] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:59.351526 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--webserver_interface=127.9.203.124
--webserver_port=39467
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260811 06:16:59.351794 12168 tablet_loader.cc:96] loaded metadata for tablet f5ff9b65fc804be9a686ad64a3d74ff0 (table default.Table_373a8a768dcc4de9bffd2c2488b003de [id=2b620a8250214aa2997083b1ab297b70])
I20260811 06:16:59.352178 12285 leader_election.cc:288] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.352293 12168 tablet_loader.cc:96] loaded metadata for tablet f6f682f675c344b6b5955e834f94091f (table default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf])
I20260811 06:16:59.352900 12168 tablet_loader.cc:96] loaded metadata for tablet f92a58686071449082f60d06b91b098c (table default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd])
I20260811 06:16:59.354386 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1e42440ff14857b297621ca6031835" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.354771 11158 raft_consensus.cc:2454] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.355517 10813 leader_election.cc:302] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.356067 12285 raft_consensus.cc:2781] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.356262 12285 raft_consensus.cc:482] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.356283 12168 tablet_loader.cc:96] loaded metadata for tablet fb185af613d14b53961dbf333a4ddb95 (table default.Table_987b68deeac64dd1b9aad386fc6ffaff [id=09583b2d1b314b72bb2511f52d0a0eae])
I20260811 06:16:59.356498 12285 raft_consensus.cc:3037] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.356863 12168 tablet_loader.cc:96] loaded metadata for tablet fb5484b422a843b7810dd3b68a178ffd (table default.Table_c3e1b3f8f6d84555b87c499a26cbc29c [id=b40af271c2bf4a079699e9a4e3aa9b07])
I20260811 06:16:59.357280 12168 tablet_loader.cc:96] loaded metadata for tablet fd91e4f85cc64de9a13c598a3695f8a1 (table default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3])
I20260811 06:16:59.357707 12168 tablet_loader.cc:96] loaded metadata for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0])
I20260811 06:16:59.359527 11961 raft_consensus.cc:482] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:16:59.359856 10810 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ae1e42440ff14857b297621ca6031835
I20260811 06:16:59.359760 11961 raft_consensus.cc:504] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.350147 11960 raft_consensus.cc:504] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:16:59.360800 11961 leader_election.cc:288] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.360919 12251 raft_consensus.cc:482] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.361227 12251 raft_consensus.cc:504] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.362550 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.362880 10659 raft_consensus.cc:2454] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:16:59.362911 12168 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Loading table and tablet metadata into memory: real 1.285s user 0.165s sys 0.077s
I20260811 06:16:59.363142 12168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 06:16:59.363415 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.364060 11715 raft_consensus.cc:1226] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [term 4 LEADER]: Rejecting Update request from peer 29fb239be50c4171bdbc75e064555197 for earlier term 3. Current term is 4. Ops: []
I20260811 06:16:59.364060 11046 leader_election.cc:302] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.364449 11715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52476 (request call id 115) took 1041 ms. Trace:
I20260811 06:16:59.364490 11961 raft_consensus.cc:2781] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.364765 11961 raft_consensus.cc:482] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.364780 12251 leader_election.cc:288] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.364701 11715 rpcz_store.cc:276] 0811 06:16:58.323101 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:58.323209 (+ 108us) service_pool.cc:227] Handling call
0811 06:16:59.363748 (+1040539us) raft_consensus.cc:1457] Updating replica for 0 ops
0811 06:16:59.364243 (+ 495us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 06:16:59.364342 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:16:59.364953 11961 raft_consensus.cc:3037] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:59.365226 11601 connection.cc:441] server connection from 127.0.0.1:52476 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52476 (request call id 115) could send its response
I20260811 06:16:59.366791 10922 raft_consensus.cc:2454] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:59.367630 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.369061 11046 consensus_peers.cc:487] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.368961 12285 raft_consensus.cc:504] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:16:59.369652 10555 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.370235 12272 raft_consensus.cc:504] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.370564 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1e42440ff14857b297621ca6031835" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.370999 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.371435 10810 leader_election.cc:341] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ae1e42440ff14857b297621ca6031835
I20260811 06:16:59.371649 11153 raft_consensus.cc:3037] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.372119 12285 leader_election.cc:288] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:59.373250 10564 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.373548 10564 leader_election.cc:302] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.373932 12272 leader_election.cc:288] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.374414 12251 raft_consensus.cc:2726] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.375260 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.375501 10659 raft_consensus.cc:3037] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.377266 11153 raft_consensus.cc:2454] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.377804 10813 leader_election.cc:302] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:16:59.378268 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e721083b8b2428bbea6b9e87a4a6e14" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.378541 11158 raft_consensus.cc:3037] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.379674 12272 raft_consensus.cc:2781] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.379863 12272 raft_consensus.cc:686] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.380954 12272 consensus_queue.cc:237] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:16:59.381870 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:16:59.382609 10813 leader_election.cc:341] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.384217 11960 leader_election.cc:288] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:59.384196 11961 raft_consensus.cc:504] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.384315 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d24d909b82640a386b612fba1f38fac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.384686 10661 raft_consensus.cc:3037] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.384815 10659 raft_consensus.cc:2454] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.385382 10810 leader_election.cc:302] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.385788 11960 raft_consensus.cc:2781] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.386164 11960 raft_consensus.cc:686] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.386826 11158 raft_consensus.cc:2454] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.388121 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.388659 10661 raft_consensus.cc:2454] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.386516 11960 consensus_queue.cc:237] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.388679 10659 raft_consensus.cc:3037] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.390955 11961 leader_election.cc:288] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.393800 11370 ts_tablet_manager.cc:1939] T c00b6bdfc8ac4b5db81de9f614fcf213 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.394165 12059 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.394440 12059 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.395309 11361 tablet_bootstrap.cc:492] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.395511 11361 ts_tablet_manager.cc:1397] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.134s user 0.007s sys 0.015s
I20260811 06:16:59.396613 12059 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.396577 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.397333 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97b348d30dc44fa383a27d9097c2e598" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:59.397732 10922 raft_consensus.cc:3037] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.398061 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 329) took 3877 ms. Trace:
I20260811 06:16:59.399076 11370 rpcz_store.cc:276] 0811 06:16:55.520202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.520868 (+ 666us) service_pool.cc:227] Handling call
0811 06:16:59.286802 (+3765934us) ts_tablet_manager.cc:1145] Deleting tablet c00b6bdfc8ac4b5db81de9f614fcf213
0811 06:16:59.286813 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.328054 (+ 41241us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.346702 (+ 18648us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.397878 (+ 51176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3751999}
W20260811 06:16:59.399578 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 329) could send its response
I20260811 06:16:59.400839 11361 raft_consensus.cc:348] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.401867 10810 leader_election.cc:302] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.402813 12059 raft_consensus.cc:2781] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.403230 12059 raft_consensus.cc:686] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.403621 12059 consensus_queue.cc:237] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:16:59.404958 10813 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.405031 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.405452 10661 raft_consensus.cc:2454] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:16:59.407061 11046 consensus_peers.cc:487] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.407256 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 337) took 3655 ms. Trace:
I20260811 06:16:59.407541 11370 rpcz_store.cc:276] 0811 06:16:55.746717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.747028 (+ 311us) service_pool.cc:227] Handling call
0811 06:16:59.401810 (+3654782us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:16:59.401825 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.401998 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636780}
W20260811 06:16:59.407934 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 337) could send its response
I20260811 06:16:59.408241 11361 raft_consensus.cc:374] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.408509 11361 raft_consensus.cc:729] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.408895 11361 consensus_queue.cc:260] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.409703 11370 tablet_replica.cc:330] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.410017 10659 raft_consensus.cc:2454] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:59.410681 11370 raft_consensus.cc:2229] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.410778 11046 leader_election.cc:302] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.412075 11961 raft_consensus.cc:2781] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.412897 11961 raft_consensus.cc:686] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:16:59.414245 11961 consensus_queue.cc:237] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.420710 10810 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.421509 11361 ts_tablet_manager.cc:1428] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.026s user 0.002s sys 0.002s
I20260811 06:16:59.421507 12285 raft_consensus.cc:2781] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.421855 11370 raft_consensus.cc:2258] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.422185 12285 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.422534 12285 raft_consensus.cc:3037] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.422787 11370 ts_tablet_manager.cc:1905] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.428746 11361 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.439421 12168 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:16:59.439639 12168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 06:16:59.446636 10922 raft_consensus.cc:2454] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:16:59.451490 11365 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.452193 11365 ts_tablet_manager.cc:1397] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.126s user 0.008s sys 0.007s
I20260811 06:16:59.453830 11365 raft_consensus.cc:348] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.447507 11362 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.454140 11365 raft_consensus.cc:374] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.454303 11362 ts_tablet_manager.cc:1397] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.118s user 0.019s sys 0.019s
I20260811 06:16:59.454394 11365 raft_consensus.cc:729] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.454758 11365 consensus_queue.cc:260] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.455971 12285 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.458258 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.458575 10659 raft_consensus.cc:3037] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.461946 12094 consensus_queue.cc:1035] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260811 06:16:59.463153 10659 raft_consensus.cc:2454] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.463830 12059 raft_consensus.cc:482] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.464043 10810 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.464097 12059 raft_consensus.cc:504] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.464391 12272 raft_consensus.cc:2781] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.464537 12272 raft_consensus.cc:686] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.464886 12272 consensus_queue.cc:237] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.465081 12059 leader_election.cc:288] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.466233 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.466459 11361 tablet_bootstrap.cc:654] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.466503 11158 raft_consensus.cc:2454] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.466534 12251 raft_consensus.cc:482] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.466748 12251 raft_consensus.cc:504] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.467094 10813 leader_election.cc:302] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.467561 11960 raft_consensus.cc:2781] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.467749 11960 raft_consensus.cc:482] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.467720 12251 leader_election.cc:288] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.467979 11960 raft_consensus.cc:3037] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.468823 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.469694 10564 leader_election.cc:341] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.470731 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.471128 10661 raft_consensus.cc:2454] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.472630 11365 ts_tablet_manager.cc:1428] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.020s user 0.000s sys 0.003s
I20260811 06:16:59.473210 11365 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.478809 11365 tablet_bootstrap.cc:654] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.490651 12168 catalog_manager.cc:1504] Loading token signing keys...
I20260811 06:16:59.492095 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.497153 11370 ts_tablet_manager.cc:1918] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:16:59.497669 11370 log.cc:1196] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e180cc2c38aa4a78897e264276e4c766
I20260811 06:16:59.499058 11370 ts_tablet_manager.cc:1939] T e180cc2c38aa4a78897e264276e4c766 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:16:59.500205 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 347) took 3669 ms. Trace:
I20260811 06:16:59.500550 11370 rpcz_store.cc:276] 0811 06:16:55.830493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.973869 (+143376us) service_pool.cc:227] Handling call
0811 06:16:59.409402 (+3435533us) ts_tablet_manager.cc:1145] Deleting tablet e180cc2c38aa4a78897e264276e4c766
0811 06:16:59.409418 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.476155 (+ 66737us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.496916 (+ 20761us) tablet_metadata.cc:641] Metadata flushed
0811 06:16:59.500161 (+ 3245us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3435147}
W20260811 06:16:59.501562 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 347) could send its response
I20260811 06:16:59.502295 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 344) took 3712 ms. Trace:
I20260811 06:16:59.503078 11370 rpcz_store.cc:276] 0811 06:16:55.789659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.968205 (+178546us) service_pool.cc:227] Handling call
0811 06:16:59.501974 (+3533769us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:16:59.501986 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.502196 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3524788}
W20260811 06:16:59.503878 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 344) could send its response
I20260811 06:16:59.504591 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 346) took 3676 ms. Trace:
I20260811 06:16:59.505288 11370 rpcz_store.cc:276] 0811 06:16:55.827837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.969659 (+141822us) service_pool.cc:227] Handling call
0811 06:16:59.504330 (+3534671us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:16:59.504342 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.504485 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3518366}
W20260811 06:16:59.506716 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 346) could send its response
I20260811 06:16:59.507385 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 345) took 3690 ms. Trace:
I20260811 06:16:59.508178 11370 rpcz_store.cc:276] 0811 06:16:55.816948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.969541 (+152593us) service_pool.cc:227] Handling call
0811 06:16:59.507069 (+3537528us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:16:59.507082 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.507226 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3494000}
W20260811 06:16:59.508894 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 345) could send its response
I20260811 06:16:59.509537 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 352) took 3645 ms. Trace:
I20260811 06:16:59.509783 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.510567 11370 rpcz_store.cc:276] 0811 06:16:55.863839 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:55.990492 (+126653us) service_pool.cc:227] Handling call
0811 06:16:59.509241 (+3518749us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:16:59.509252 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.509395 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3448727}
W20260811 06:16:59.511039 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 352) could send its response
I20260811 06:16:59.512257 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 364) took 3366 ms. Trace:
I20260811 06:16:59.512650 12285 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:59.512883 10813 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.513613 10555 leader_election.cc:341] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.513967 10555 leader_election.cc:302] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.514642 12251 raft_consensus.cc:2726] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.515594 11960 raft_consensus.cc:504] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.517252 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.517758 10659 raft_consensus.cc:3037] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.518558 11960 leader_election.cc:288] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.517982 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58fdb5920003438d983987ff242f6dce" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.518730 11361 tablet_bootstrap.cc:492] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.519986 11158 raft_consensus.cc:3037] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.518224 11362 raft_consensus.cc:348] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.520237 11362 raft_consensus.cc:374] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.520574 11362 raft_consensus.cc:729] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.521699 11362 consensus_queue.cc:260] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.523168 10659 raft_consensus.cc:2454] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.524565 11362 ts_tablet_manager.cc:1428] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.070s user 0.004s sys 0.000s
I20260811 06:16:59.530745 11158 raft_consensus.cc:2454] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.531646 11361 ts_tablet_manager.cc:1397] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.091s user 0.005s sys 0.005s
I20260811 06:16:59.531672 11370 rpcz_store.cc:276] 0811 06:16:56.145406 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.146686 (+ 1280us) service_pool.cc:227] Handling call
0811 06:16:59.511954 (+3365268us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:16:59.511967 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.512145 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3328872}
W20260811 06:16:59.532104 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 364) could send its response
I20260811 06:16:59.532598 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 370) took 3084 ms. Trace:
I20260811 06:16:59.533505 10810 leader_election.cc:302] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
W20260811 06:16:59.535086 10810 consensus_peers.cc:487] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16674be53bd54f9395b650e19edd3cf4. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.536659 11362 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.539021 11361 raft_consensus.cc:348] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.539608 11365 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.539806 11365 ts_tablet_manager.cc:1397] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.067s user 0.007s sys 0.034s
I20260811 06:16:59.539593 11370 rpcz_store.cc:276] 0811 06:16:56.448653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.449221 (+ 568us) service_pool.cc:227] Handling call
0811 06:16:59.532034 (+3082813us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:16:59.532051 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.532546 (+ 495us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075202}
W20260811 06:16:59.540351 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 370) could send its response
I20260811 06:16:59.540732 11361 raft_consensus.cc:374] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.540982 11365 raft_consensus.cc:348] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.541333 11361 raft_consensus.cc:729] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.541574 11365 raft_consensus.cc:374] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.541210 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 371) took 3074 ms. Trace:
I20260811 06:16:59.541795 11365 raft_consensus.cc:729] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.539041 12381 raft_consensus.cc:2781] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.542271 12168 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Loaded TSK: 0
I20260811 06:16:59.542297 11365 consensus_queue.cc:260] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.543188 11365 ts_tablet_manager.cc:1428] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:16:59.543881 11365 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.547420 11365 tablet_bootstrap.cc:654] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.542786 12381 raft_consensus.cc:686] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.554208 12381 consensus_queue.cc:237] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.555994 11362 tablet_bootstrap.cc:654] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.557895 11158 raft_consensus.cc:3037] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.559180 12168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 06:16:59.563707 11370 rpcz_store.cc:276] 0811 06:16:56.466845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.467033 (+ 188us) service_pool.cc:227] Handling call
0811 06:16:59.540960 (+3073927us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:16:59.540973 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.541140 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3068622}
W20260811 06:16:59.564126 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 371) could send its response
I20260811 06:16:59.563977 12251 consensus_queue.cc:1035] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:59.564385 11361 consensus_queue.cc:260] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.565178 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 372) took 3068 ms. Trace:
I20260811 06:16:59.575886 11370 rpcz_store.cc:276] 0811 06:16:56.497140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.497199 (+ 59us) service_pool.cc:227] Handling call
0811 06:16:59.564832 (+3067633us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:16:59.564845 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.565065 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064498}
W20260811 06:16:59.576488 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 372) could send its response
I20260811 06:16:59.576849 11361 ts_tablet_manager.cc:1428] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.045s user 0.002s sys 0.002s
I20260811 06:16:59.579504 11361 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.585599 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 373) took 3084 ms. Trace:
I20260811 06:16:59.586058 11370 rpcz_store.cc:276] 0811 06:16:56.501092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:56.501239 (+ 147us) service_pool.cc:227] Handling call
0811 06:16:59.576323 (+3075084us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:16:59.576336 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.585445 (+ 9109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3065687}
W20260811 06:16:59.586629 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 373) could send its response
I20260811 06:16:59.587236 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 389) took 2572 ms. Trace:
I20260811 06:16:59.587517 11370 rpcz_store.cc:276] 0811 06:16:57.014585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.015499 (+ 914us) service_pool.cc:227] Handling call
0811 06:16:59.586977 (+2571478us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:16:59.586990 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.587140 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2562991}
W20260811 06:16:59.588042 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 389) could send its response
I20260811 06:16:59.588742 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 393) took 2516 ms. Trace:
I20260811 06:16:59.589057 11370 rpcz_store.cc:276] 0811 06:16:57.071772 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.072149 (+ 377us) service_pool.cc:227] Handling call
0811 06:16:59.588399 (+2516250us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:16:59.588491 (+ 92us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.588630 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515913}
W20260811 06:16:59.589641 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 393) could send its response
I20260811 06:16:59.607187 11679 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c62cbef937a46dfbc4dbf934e887139 from {username='slave'} at 127.0.0.1:52508
I20260811 06:16:59.608777 11679 master_service.cc:946] ReplaceTablet: received request to replace tablet 1349b0ea48b848398d4bdda528358c30 from {username='slave'} at 127.0.0.1:52508
I20260811 06:16:59.609790 11960 raft_consensus.cc:482] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.610107 11960 raft_consensus.cc:504] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.610909 11960 leader_election.cc:288] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.615320 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.616425 10813 leader_election.cc:341] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.617666 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.618161 10659 raft_consensus.cc:2454] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.619207 10810 leader_election.cc:302] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.620863 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet 0813b34919a14a2481857e9f87b217c8 from {username='slave'} at 127.0.0.1:52508
I20260811 06:16:59.621366 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet 16674be53bd54f9395b650e19edd3cf4 from {username='slave'} at 127.0.0.1:52508
I20260811 06:16:59.622828 11960 raft_consensus.cc:2781] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.623075 11960 raft_consensus.cc:482] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.623359 11960 raft_consensus.cc:3037] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.629103 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:16:59.630992 11960 raft_consensus.cc:504] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.632710 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.633109 10659 raft_consensus.cc:3037] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.639194 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:16:59.651612 11960 leader_election.cc:288] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.654297 11960 consensus_queue.cc:1035] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:59.655051 10659 raft_consensus.cc:2454] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.655802 10810 leader_election.cc:302] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.656459 12285 raft_consensus.cc:2781] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.656705 12285 raft_consensus.cc:686] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.657114 12285 consensus_queue.cc:237] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.661532 11361 tablet_bootstrap.cc:654] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.663884 12246 consensus_queue.cc:1035] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:59.670656 12246 raft_consensus.cc:482] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.670995 12246 raft_consensus.cc:504] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.671936 12246 leader_election.cc:288] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.672168 12246 raft_consensus.cc:482] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.672406 12246 raft_consensus.cc:504] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.672897 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.673170 12246 leader_election.cc:288] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:59.673731 10555 leader_election.cc:341] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.674436 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.674875 10915 raft_consensus.cc:2454] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:16:59.675674 10555 leader_election.cc:302] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.676332 12251 raft_consensus.cc:2781] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.676620 12251 raft_consensus.cc:482] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.676853 12251 raft_consensus.cc:3037] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.681313 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.682273 10564 leader_election.cc:341] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.682545 10564 leader_election.cc:302] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.683975 12246 raft_consensus.cc:2726] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.685313 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:16:59.686523 10564 leader_election.cc:341] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.690173 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 394) took 2612 ms. Trace:
I20260811 06:16:59.690619 11370 rpcz_store.cc:276] 0811 06:16:57.077299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.077505 (+ 206us) service_pool.cc:227] Handling call
0811 06:16:59.589946 (+2512441us) ts_tablet_manager.cc:1145] Deleting tablet 94d04b025b1b45009260ddd9f1b0aabb
0811 06:16:59.589957 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.690021 (+100064us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2503273}
I20260811 06:16:59.692248 11362 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.692622 11362 ts_tablet_manager.cc:1397] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.168s user 0.009s sys 0.001s
I20260811 06:16:59.625422 11670 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_897ed62b321f47fb89a724e148c60031" } new_table_name: "default.Table_a761dcad0b3a477a8ee08606c1b45c40" modify_external_catalogs: true
I20260811 06:16:59.635371 11683 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_28705c2c84984e3cb45b2c26538fb2fb" } new_table_name: "default.Table_6746aea0013f4b1abca5aab77881fcee" modify_external_catalogs: true
I20260811 06:16:59.629216 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_aceab0ee137e421f840dc7340e6cb91b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:59.628264 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ebcbe00e3a0340d2a2911d4a5c73c393" } new_table_name: "default.Table_90ce61ad47934df68a1e8f9dda9ea09d" modify_external_catalogs: true
I20260811 06:16:59.712819 12251 raft_consensus.cc:504] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.713977 12251 leader_election.cc:288] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:59.705238 10813 consensus_peers.cc:487] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.623651 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_feebdfd01f0f465fb0b3022ca1daf517"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:59.705780 12285 consensus_queue.cc:1035] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:59.717830 12285 raft_consensus.cc:482] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.718082 12285 raft_consensus.cc:504] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.719005 12285 leader_election.cc:288] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.627271 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_f4f8f5c098d5406a8529fc0efccae4f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:59.719396 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:59.719774 10915 raft_consensus.cc:3037] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.626396 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_3991f735c6434abc80dec8d381869762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:59.628129 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_dac288843c414db3bbdf0877d0c4f6d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:16:59.722762 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.723186 10659 raft_consensus.cc:2454] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.724056 10810 leader_election.cc:302] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.724592 12285 raft_consensus.cc:2781] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.724874 12285 raft_consensus.cc:482] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.725085 12285 raft_consensus.cc:3037] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:59.728704 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_feebdfd01f0f465fb0b3022ca1daf517 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:59.729388 12285 raft_consensus.cc:504] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:16:59.731279 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dac288843c414db3bbdf0877d0c4f6d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:59.732038 10915 raft_consensus.cc:2454] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:16:59.732785 10555 leader_election.cc:302] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
W20260811 06:16:59.735913 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f8f5c098d5406a8529fc0efccae4f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:59.736347 12285 leader_election.cc:288] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.739341 11362 raft_consensus.cc:348] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.739852 11362 raft_consensus.cc:374] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.740124 11362 raft_consensus.cc:729] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.739483 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.740530 11362 consensus_queue.cc:260] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.740796 10659 raft_consensus.cc:3037] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:16:59.740778 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3991f735c6434abc80dec8d381869762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:16:59.742694 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 394) could send its response
I20260811 06:16:59.743356 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 395) took 2638 ms. Trace:
I20260811 06:16:59.743621 11370 rpcz_store.cc:276] 0811 06:16:57.104699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.105047 (+ 348us) service_pool.cc:227] Handling call
0811 06:16:59.743019 (+2637972us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:16:59.743082 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.743264 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2637602}
W20260811 06:16:59.743999 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 395) could send its response
I20260811 06:16:59.744515 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 397) took 2596 ms. Trace:
I20260811 06:16:59.744717 10659 raft_consensus.cc:2454] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.744768 11370 rpcz_store.cc:276] 0811 06:16:57.148533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.148945 (+ 412us) service_pool.cc:227] Handling call
0811 06:16:59.744238 (+2595293us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:16:59.744251 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.744403 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2349854}
W20260811 06:16:59.745185 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 397) could send its response
I20260811 06:16:59.745678 11370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 398) took 2596 ms. Trace:
I20260811 06:16:59.745862 10810 leader_election.cc:302] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.746004 11370 rpcz_store.cc:276] 0811 06:16:57.148748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:57.361463 (+212715us) service_pool.cc:227] Handling call
0811 06:16:59.745446 (+2383983us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:16:59.745457 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:16:59.745578 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2341492}
W20260811 06:16:59.746306 11048 connection.cc:441] server connection from 127.0.0.1:34696 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34696 (request call id 398) could send its response
W20260811 06:16:59.750311 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aceab0ee137e421f840dc7340e6cb91b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:16:59.754138 12285 raft_consensus.cc:2781] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.754489 12285 raft_consensus.cc:686] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.735523 12251 raft_consensus.cc:2781] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.758993 12251 raft_consensus.cc:686] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:16:59.756215 12285 consensus_queue.cc:237] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.760707 12251 consensus_queue.cc:237] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.741663 11362 ts_tablet_manager.cc:1428] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:16:59.770640 11362 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.774854 11361 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.775182 11361 ts_tablet_manager.cc:1397] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.197s user 0.005s sys 0.001s
I20260811 06:16:59.703402 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:16:59.704015 11046 consensus_peers.cc:487] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:16:59.777993 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 74040.2us
I20260811 06:16:59.715027 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.782845 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:51802
I20260811 06:16:59.783874 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:16:59.783900 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.784183 12447 tablet_replica.cc:330] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:59.784602 12447 raft_consensus.cc:2229] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:59.785374 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:16:59.785537 11361 raft_consensus.cc:348] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.785887 12447 pending_rounds.cc:62] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:16:59.786011 11361 raft_consensus.cc:374] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:16:59.787726 10564 leader_election.cc:341] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.789354 10813 leader_election.cc:341] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.790019 10813 leader_election.cc:341] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.790640 10813 leader_election.cc:341] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.791746 11365 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.792012 11365 ts_tablet_manager.cc:1397] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.248s user 0.081s sys 0.131s
W20260811 06:16:59.793162 10813 consensus_peers.cc:487] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 681736b44af04718b800d503ca645c1a. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.793391 11365 raft_consensus.cc:348] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.789400 11361 raft_consensus.cc:729] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.794205 11361 consensus_queue.cc:260] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.795045 11361 ts_tablet_manager.cc:1428] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260811 06:16:59.795442 11361 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:16:59.800415 11961 raft_consensus.cc:482] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.800751 11961 raft_consensus.cc:504] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.801759 11961 leader_election.cc:288] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:59.802865 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.802918 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.803246 10659 raft_consensus.cc:2454] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:16:59.804095 11046 leader_election.cc:302] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:16:59.805261 11362 tablet_bootstrap.cc:654] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.805540 11961 raft_consensus.cc:2781] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.805845 11961 raft_consensus.cc:482] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.806361 11961 raft_consensus.cc:3037] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.802812 11361 tablet_bootstrap.cc:654] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:16:59.809863 11047 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.811476 11961 raft_consensus.cc:504] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.814076 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:16:59.814586 11047 consensus_peers.cc:487] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4a46cec25944310a838d8323b119883. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.815742 11370 tablet_replica.cc:330] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:16:59.816138 11370 raft_consensus.cc:2229] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.817400 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:16:59.817548 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.818060 10659 raft_consensus.cc:3037] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.786381 12447 pending_rounds.cc:68] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213263730638848 op_type: NO_OP noop_request { }
I20260811 06:16:59.818408 12447 raft_consensus.cc:2866] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:16:59.818509 11365 raft_consensus.cc:374] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.818634 12447 raft_consensus.cc:2258] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.818753 11365 raft_consensus.cc:729] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.819064 11365 consensus_queue.cc:260] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.820464 11365 ts_tablet_manager.cc:1428] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.028s user 0.000s sys 0.004s
I20260811 06:16:59.820580 12251 raft_consensus.cc:482] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.821228 11370 raft_consensus.cc:2258] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.822206 11370 ts_tablet_manager.cc:1905] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.822824 11163 raft_consensus.cc:3037] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.828243 11365 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.828320 12251 raft_consensus.cc:504] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.830287 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.831580 11961 leader_election.cc:288] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:16:59.833472 12251 leader_election.cc:288] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:16:59.835565 10564 leader_election.cc:341] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.835758 12246 consensus_queue.cc:1035] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 06:16:59.837985 12285 consensus_queue.cc:1035] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260811 06:16:59.839725 11365 tablet_bootstrap.cc:654] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.849987 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:16:59.853073 10659 raft_consensus.cc:2454] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:16:59.854303 10555 leader_election.cc:341] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.854542 10555 leader_election.cc:302] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:16:59.854940 12251 raft_consensus.cc:2726] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:16:59.855249 12251 consensus_queue.cc:1035] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:16:59.856042 11960 consensus_queue.cc:1035] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:16:59.856704 12447 ts_tablet_manager.cc:1905] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.879688 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 0813b34919a14a2481857e9f87b217c8
I20260811 06:16:59.882032 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:16:59.882123 11676 catalog_manager.cc:6565] ReplaceTablet: tablet 0813b34919a14a2481857e9f87b217c8 deleted and replaced by tablet 0a67f283a7a6447daaecc9c03703b977
I20260811 06:16:59.884588 11362 tablet_bootstrap.cc:492] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.892016 12246 raft_consensus.cc:482] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.892225 12246 raft_consensus.cc:504] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.892911 12246 leader_election.cc:288] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.893492 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:16:59.901775 11362 ts_tablet_manager.cc:1397] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.114s user 0.003s sys 0.004s
I20260811 06:16:59.902819 11362 raft_consensus.cc:348] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.903112 11362 raft_consensus.cc:374] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.903190 11362 raft_consensus.cc:729] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.903425 11362 consensus_queue.cc:260] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.907250 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.908342 10555 leader_election.cc:341] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.912541 11365 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:16:59.921774 10810 consensus_peers.cc:487] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe5eea681072477ab52a822d721629cf. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:16:59.922343 11362 ts_tablet_manager.cc:1428] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260811 06:16:59.922739 11362 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.924880 11362 tablet_bootstrap.cc:654] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.901641 12447 ts_tablet_manager.cc:1918] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:59.927543 12447 log.cc:1196] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/adc2d99019384c33840f16cbe98d336c
I20260811 06:16:59.928962 12447 ts_tablet_manager.cc:1939] T adc2d99019384c33840f16cbe98d336c P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:59.930581 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet adc2d99019384c33840f16cbe98d336c (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:16:59.933389 12447 tablet_replica.cc:330] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:16:59.915979 12246 raft_consensus.cc:482] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.936067 12447 raft_consensus.cc:2229] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:16:59.935969 12246 raft_consensus.cc:504] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.936728 12246 leader_election.cc:288] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.937011 11365 ts_tablet_manager.cc:1397] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.116s user 0.006s sys 0.003s
I20260811 06:16:59.938207 11365 raft_consensus.cc:348] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.938511 11365 raft_consensus.cc:374] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.938606 11365 raft_consensus.cc:729] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.939268 11365 consensus_queue.cc:260] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.939728 12381 raft_consensus.cc:482] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.941810 12381 raft_consensus.cc:504] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.942505 12381 leader_election.cc:288] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.940495 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:16:59.943933 10555 leader_election.cc:341] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:16:59.944043 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:16:59.944303 10661 raft_consensus.cc:2454] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:16:59.944901 10810 leader_election.cc:302] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.945502 12381 raft_consensus.cc:2781] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:16:59.945611 12381 raft_consensus.cc:482] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:16:59.945741 12381 raft_consensus.cc:3037] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.948982 12381 raft_consensus.cc:504] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.950464 12381 leader_election.cc:288] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:16:59.950577 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:16:59.950706 12447 raft_consensus.cc:2258] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:16:59.950815 10661 raft_consensus.cc:3037] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:16:59.951767 12447 ts_tablet_manager.cc:1905] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:16:59.954177 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:16:59.954208 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:36594
I20260811 06:16:59.955382 10661 raft_consensus.cc:2454] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:16:59.956502 10810 leader_election.cc:302] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:16:59.956923 12381 raft_consensus.cc:2781] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.958945 12381 raft_consensus.cc:686] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:16:59.959299 12381 consensus_queue.cc:237] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.960892 11365 ts_tablet_manager.cc:1428] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260811 06:16:59.962296 11362 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.962478 11362 ts_tablet_manager.cc:1397] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260811 06:16:59.962790 12447 ts_tablet_manager.cc:1918] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:16:59.963496 11362 raft_consensus.cc:348] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.964327 11362 raft_consensus.cc:374] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.964497 11362 raft_consensus.cc:729] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.964886 11362 consensus_queue.cc:260] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.965921 11362 ts_tablet_manager.cc:1428] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:16:59.965946 11365 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:16:59.966333 11362 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:16:59.967921 11365 tablet_bootstrap.cc:654] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.968816 11362 tablet_bootstrap.cc:654] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:16:59.972936 12447 log.cc:1196] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/67f458dba9444bfa8841a84cdb798588
I20260811 06:16:59.974259 12447 ts_tablet_manager.cc:1939] T 67f458dba9444bfa8841a84cdb798588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:16:59.977272 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 67f458dba9444bfa8841a84cdb798588 (table default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]) successfully deleted
W20260811 06:16:59.980193 11047 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:16:59.986462 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
W20260811 06:16:59.989420 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 167713us
I20260811 06:16:59.991272 11961 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:16:59.993530 11046 leader_election.cc:302] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:16:59.994045 12094 raft_consensus.cc:2781] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:16:59.994295 12468 tablet_replica.cc:330] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:16:59.994659 12468 raft_consensus.cc:2229] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:16:59.995487 11961 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.996197 11961 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:16:59.997771 11362 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:16:59.997833 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.998458 11365 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:16:59.998623 11365 ts_tablet_manager.cc:1397] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260811 06:16:59.998870 11361 tablet_bootstrap.cc:492] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:16:59.998864 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:16:59.999377 11365 raft_consensus.cc:348] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:16:59.999590 11365 raft_consensus.cc:374] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:16:59.999670 11365 raft_consensus.cc:729] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:16:59.996251 12468 raft_consensus.cc:2258] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:00.000178 11362 ts_tablet_manager.cc:1397] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.007s
I20260811 06:17:00.005384 11370 ts_tablet_manager.cc:1918] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:00.005573 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:00.006332 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 128512us
I20260811 06:17:00.007419 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.007459 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.007759 10661 raft_consensus.cc:2379] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:00.007797 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.008524 11370 log.cc:1196] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/22cac1c339574b1fa26555b18811539b
I20260811 06:17:00.009148 11370 ts_tablet_manager.cc:1939] T 22cac1c339574b1fa26555b18811539b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:00.011288 11047 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
I20260811 06:17:00.011246 11361 ts_tablet_manager.cc:1397] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.204s user 0.015s sys 0.044s
I20260811 06:17:00.011461 11047 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:00.012110 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 22cac1c339574b1fa26555b18811539b (table default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]) successfully deleted
I20260811 06:17:00.012217 11361 raft_consensus.cc:348] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.012751 11361 raft_consensus.cc:374] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.012835 11361 raft_consensus.cc:729] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.004592 12059 consensus_queue.cc:1035] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.013276 11361 consensus_queue.cc:260] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.004834 11960 consensus_queue.cc:1035] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.014254 11361 ts_tablet_manager.cc:1428] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:00.014438 12468 ts_tablet_manager.cc:1905] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:00.014923 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:00.015095 11362 raft_consensus.cc:348] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.015295 11361 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.015352 11362 raft_consensus.cc:374] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.015424 11362 raft_consensus.cc:729] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
W20260811 06:17:00.017287 10813 leader_election.cc:341] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:00.017644 10813 leader_election.cc:341] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.018016 11960 consensus_queue.cc:1035] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.020057 11365 consensus_queue.cc:260] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.020527 11362 consensus_queue.cc:260] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.024024 11365 ts_tablet_manager.cc:1428] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.025s user 0.002s sys 0.001s
I20260811 06:17:00.025882 11362 ts_tablet_manager.cc:1428] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260811 06:17:00.028115 12246 raft_consensus.cc:482] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.028280 12246 raft_consensus.cc:504] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.028971 12246 leader_election.cc:288] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.029812 11365 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.028002 11362 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.029358 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.030053 11960 consensus_queue.cc:1035] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 06:17:00.034236 11362 tablet_bootstrap.cc:654] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:00.037833 10555 leader_election.cc:341] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.043596 11365 tablet_bootstrap.cc:654] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.064867 11365 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.065099 11365 ts_tablet_manager.cc:1397] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.003s
I20260811 06:17:00.065965 12468 ts_tablet_manager.cc:1918] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:00.069626 12468 log.cc:1196] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/22cac1c339574b1fa26555b18811539b
I20260811 06:17:00.070261 12468 ts_tablet_manager.cc:1939] T 22cac1c339574b1fa26555b18811539b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:00.074548 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 22cac1c339574b1fa26555b18811539b (table default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]) successfully deleted
I20260811 06:17:00.075198 11365 raft_consensus.cc:348] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.075524 11365 raft_consensus.cc:374] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:00.076462 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:00.075623 11365 raft_consensus.cc:729] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.077140 11365 consensus_queue.cc:260] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.019200 11961 raft_consensus.cc:3037] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.084230 11365 ts_tablet_manager.cc:1428] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260811 06:17:00.086050 11365 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.088137 11365 tablet_bootstrap.cc:654] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.085676 11961 raft_consensus.cc:2726] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.017076 11361 tablet_bootstrap.cc:654] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.069413 12491 consensus_queue.cc:1035] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260811 06:17:00.100099 12094 raft_consensus.cc:686] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:00.100514 12094 consensus_queue.cc:237] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:00.104067 10564 leader_election.cc:341] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.104390 10564 leader_election.cc:302] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:00.104578 11670 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3de77019fc074a55ab741db336a9fc60 has no consensus state
I20260811 06:17:00.104837 12246 raft_consensus.cc:2726] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:00.107086 10564 leader_election.cc:341] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.107270 10564 leader_election.cc:302] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.107721 12246 raft_consensus.cc:2726] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.111006 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.111888 11684 master_service.cc:946] ReplaceTablet: received request to replace tablet 2b0ae9a1d3b74c3985637439819b63ef from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:00.114019 11663 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_5940fa3078de423d855e54ba1af1597a" } new_table_name: "default.Table_94e9469041254852be2c820b5ca5ab2f" modify_external_catalogs: true
I20260811 06:17:00.114516 11679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 1349b0ea48b848398d4bdda528358c30
W20260811 06:17:00.114837 10564 leader_election.cc:341] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.115012 10564 leader_election.cc:302] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.115091 11679 catalog_manager.cc:6565] ReplaceTablet: tablet 1349b0ea48b848398d4bdda528358c30 deleted and replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3
I20260811 06:17:00.115592 11679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ae798943d2514f6488c7ae50b11ef679" } modify_external_catalogs: true
I20260811 06:17:00.115836 11679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ae798943d2514f6488c7ae50b11ef679" } modify_external_catalogs: true
I20260811 06:17:00.116202 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:00.116825 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:00.119772 11362 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.119956 11362 ts_tablet_manager.cc:1397] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.092s user 0.005s sys 0.008s
I20260811 06:17:00.120810 11362 raft_consensus.cc:348] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.121060 11362 raft_consensus.cc:374] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.121165 11362 raft_consensus.cc:729] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.121479 11362 consensus_queue.cc:260] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.121978 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:00.122031 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:00.122257 11362 ts_tablet_manager.cc:1428] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:00.122742 11362 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:00.122949 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:00.115749 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b5d5d6495d27470c8dbd0a542a792a7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:00.123416 12517 raft_consensus.cc:2726] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:00.123526 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
W20260811 06:17:00.124554 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5d5d6495d27470c8dbd0a542a792a7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:00.125378 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:00.126164 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:00.132843 11362 tablet_bootstrap.cc:654] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.137578 12381 raft_consensus.cc:482] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.137784 12381 raft_consensus.cc:504] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.138528 12381 leader_election.cc:288] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.139537 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.139835 10661 raft_consensus.cc:2454] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.140416 10810 leader_election.cc:302] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.141023 12381 raft_consensus.cc:2781] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.141144 12381 raft_consensus.cc:482] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.141227 12381 raft_consensus.cc:3037] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.144259 12381 raft_consensus.cc:504] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.144941 12381 leader_election.cc:288] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.145668 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.145951 10661 raft_consensus.cc:3037] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.148692 10661 raft_consensus.cc:2454] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:00.154316 10810 leader_election.cc:302] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.154706 12381 raft_consensus.cc:482] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.154896 12381 raft_consensus.cc:504] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.155624 12381 leader_election.cc:288] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.156023 12381 raft_consensus.cc:2781] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:00.156337 12381 raft_consensus.cc:686] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:00.157141 12381 consensus_queue.cc:237] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.160053 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.160082 12094 consensus_queue.cc:1035] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.160156 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c0c8c3cafad748299fdc39d29c90a58f" } modify_external_catalogs: true
I20260811 06:17:00.160395 10661 raft_consensus.cc:2379] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:00.160418 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c0c8c3cafad748299fdc39d29c90a58f" } modify_external_catalogs: true
I20260811 06:17:00.164125 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d118a4eb489941a6a06cd47e966d09a4" } modify_external_catalogs: true
I20260811 06:17:00.164449 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d118a4eb489941a6a06cd47e966d09a4" } modify_external_catalogs: true
W20260811 06:17:00.165786 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3de77019fc074a55ab741db336a9fc60 has no consensus state
I20260811 06:17:00.167322 12517 consensus_queue.cc:1035] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.167536 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.168881 10813 leader_election.cc:341] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.169139 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2875318863584e659e2b76ad2a72ca45" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.169688 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1a22b6d2b4e9fb29860a4fa3a5045" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.170258 10813 leader_election.cc:341] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:00.170859 10810 consensus_peers.cc:487] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae1e42440ff14857b297621ca6031835. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:00.174149 10813 leader_election.cc:302] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.175871 12272 raft_consensus.cc:3037] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.179473 12272 raft_consensus.cc:2726] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.179817 12272 consensus_queue.cc:1035] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.193137 11362 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.193353 11362 ts_tablet_manager.cc:1397] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.001s
I20260811 06:17:00.195093 11362 raft_consensus.cc:348] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.195370 11362 raft_consensus.cc:374] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.195465 11362 raft_consensus.cc:729] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.195703 11362 consensus_queue.cc:260] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.196280 11362 ts_tablet_manager.cc:1428] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 06:17:00.197477 11362 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.199369 11362 tablet_bootstrap.cc:654] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.214525 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:00.215034 11684 catalog_manager.cc:6565] ReplaceTablet: tablet 2b0ae9a1d3b74c3985637439819b63ef deleted and replaced by tablet 30cffba93ad74e84812e5879b851119f
I20260811 06:17:00.215397 11684 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_a78aa76e7c2c4be2a021e44457b7091a" } modify_external_catalogs: true
I20260811 06:17:00.215617 11684 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_a78aa76e7c2c4be2a021e44457b7091a" } modify_external_catalogs: true
I20260811 06:17:00.217324 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:00.218248 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:00.220677 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:00.221428 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:00.231477 10855 tablet_service.cc:1467] Processing CreateTablet for tablet ed52a1eb610e4e39bbdb69a494c3575c (DEFAULT_TABLE table=default.Table_6592e2a580a042a1854bdf75d49a8851 [id=e7784bea62394467aaf754f81a66521c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.232029 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed52a1eb610e4e39bbdb69a494c3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.238844 11153 raft_consensus.cc:3037] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.241077 10604 tablet_service.cc:1467] Processing CreateTablet for tablet ed52a1eb610e4e39bbdb69a494c3575c (DEFAULT_TABLE table=default.Table_6592e2a580a042a1854bdf75d49a8851 [id=e7784bea62394467aaf754f81a66521c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.241598 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed52a1eb610e4e39bbdb69a494c3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.242599 12517 consensus_queue.cc:1035] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.252015 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 2558f26ae7424ead9fb43883c81a02a0 (DEFAULT_TABLE table=default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf [id=e096c0390baa4a24a3d7609ba6df9985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.252537 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2558f26ae7424ead9fb43883c81a02a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.260592 11365 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.260807 11365 ts_tablet_manager.cc:1397] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.175s user 0.016s sys 0.051s
I20260811 06:17:00.261647 11365 raft_consensus.cc:348] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.261955 11365 raft_consensus.cc:374] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.262169 11365 raft_consensus.cc:729] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.262473 11365 consensus_queue.cc:260] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.263352 11365 ts_tablet_manager.cc:1428] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:00.263958 11365 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.266075 11365 tablet_bootstrap.cc:654] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.270669 12484 raft_consensus.cc:482] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.271267 12484 raft_consensus.cc:504] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.273749 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.275066 12484 leader_election.cc:288] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:00.277274 11365 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.277489 11365 ts_tablet_manager.cc:1397] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.002s
I20260811 06:17:00.278342 11365 raft_consensus.cc:348] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.278607 11365 raft_consensus.cc:374] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.278692 11365 raft_consensus.cc:729] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.278959 11365 consensus_queue.cc:260] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.280022 11365 ts_tablet_manager.cc:1428] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 06:17:00.280627 11365 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.281201 11361 tablet_bootstrap.cc:492] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.282775 11365 tablet_bootstrap.cc:654] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.285090 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107bf6921c6e40f2a337dccc302c8856" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.290621 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 2558f26ae7424ead9fb43883c81a02a0 (DEFAULT_TABLE table=default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf [id=e096c0390baa4a24a3d7609ba6df9985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.290886 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 36e37f51b0b549b7a3e749f7fbe0d03a (DEFAULT_TABLE table=default.Table_cc937b90426f431999efcbb356bc29f8 [id=c1bef49596bf4827a27e6f2f6207d590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.291139 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2558f26ae7424ead9fb43883c81a02a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.291322 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e37f51b0b549b7a3e749f7fbe0d03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.294353 11365 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.294523 11365 ts_tablet_manager.cc:1397] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260811 06:17:00.295348 11365 raft_consensus.cc:348] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.295603 11365 raft_consensus.cc:374] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.295701 11365 raft_consensus.cc:729] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.296098 11365 consensus_queue.cc:260] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.296958 11365 ts_tablet_manager.cc:1428] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:00.297511 11365 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.299793 11365 tablet_bootstrap.cc:654] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.284083 11117 tablet_service.cc:1467] Processing CreateTablet for tablet ed52a1eb610e4e39bbdb69a494c3575c (DEFAULT_TABLE table=default.Table_6592e2a580a042a1854bdf75d49a8851 [id=e7784bea62394467aaf754f81a66521c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.300916 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed52a1eb610e4e39bbdb69a494c3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.284583 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:00.284960 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 2558f26ae7424ead9fb43883c81a02a0 (DEFAULT_TABLE table=default.Table_4a6e7dbea3054a0f8066a3c9b5551fcf [id=e096c0390baa4a24a3d7609ba6df9985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.306191 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2558f26ae7424ead9fb43883c81a02a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.315729 11365 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.316004 11365 ts_tablet_manager.cc:1397] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260811 06:17:00.293927 12484 consensus_queue.cc:1035] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.317015 11365 raft_consensus.cc:348] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.319486 11361 ts_tablet_manager.cc:1397] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.304s user 0.012s sys 0.015s
I20260811 06:17:00.319973 11365 raft_consensus.cc:374] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.320132 11365 raft_consensus.cc:729] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.320595 11365 consensus_queue.cc:260] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.321309 11365 ts_tablet_manager.cc:1428] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260811 06:17:00.321192 11361 raft_consensus.cc:348] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.321698 11361 raft_consensus.cc:374] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.321825 11365 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.321971 11361 raft_consensus.cc:729] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.322350 11361 consensus_queue.cc:260] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.323757 11365 tablet_bootstrap.cc:654] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.324262 11361 ts_tablet_manager.cc:1428] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:00.324651 11361 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.328554 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 36e37f51b0b549b7a3e749f7fbe0d03a (DEFAULT_TABLE table=default.Table_cc937b90426f431999efcbb356bc29f8 [id=c1bef49596bf4827a27e6f2f6207d590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.329195 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 7c01d05b8769440d8c7a544c0e9d80b4 (DEFAULT_TABLE table=default.Table_4417703678a641a18717b8d5d7b2e294 [id=b0d2e30d0a0348d8bf26a93b2aa577e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.329634 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 7c01d05b8769440d8c7a544c0e9d80b4 (DEFAULT_TABLE table=default.Table_4417703678a641a18717b8d5d7b2e294 [id=b0d2e30d0a0348d8bf26a93b2aa577e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.330112 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c01d05b8769440d8c7a544c0e9d80b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.330312 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e37f51b0b549b7a3e749f7fbe0d03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.330426 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c01d05b8769440d8c7a544c0e9d80b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.339076 11365 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.339291 11365 ts_tablet_manager.cc:1397] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260811 06:17:00.340313 11365 raft_consensus.cc:348] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.340816 11365 raft_consensus.cc:374] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.340942 11365 raft_consensus.cc:729] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.341290 11365 consensus_queue.cc:260] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.341562 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:00.342393 11365 ts_tablet_manager.cc:1428] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 06:17:00.342816 11365 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.343788 12517 raft_consensus.cc:482] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.344017 12517 raft_consensus.cc:504] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.344808 12517 leader_election.cc:288] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.346351 11365 tablet_bootstrap.cc:654] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.346967 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:00.347601 10555 leader_election.cc:341] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.350766 12285 consensus_queue.cc:1035] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.372551 11365 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.372808 11365 ts_tablet_manager.cc:1397] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.000s
I20260811 06:17:00.373745 11365 raft_consensus.cc:348] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.374064 11365 raft_consensus.cc:374] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.374136 11365 raft_consensus.cc:729] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.374397 11365 consensus_queue.cc:260] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.375003 11365 ts_tablet_manager.cc:1428] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:00.375370 11365 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.377168 11365 tablet_bootstrap.cc:654] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.382428 11365 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.382611 11365 ts_tablet_manager.cc:1397] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260811 06:17:00.383478 11365 raft_consensus.cc:348] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.383780 11365 raft_consensus.cc:374] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.383863 11365 raft_consensus.cc:729] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.384109 11365 consensus_queue.cc:260] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.384730 11365 ts_tablet_manager.cc:1428] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:00.385046 11365 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.387084 11365 tablet_bootstrap.cc:654] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.394218 12485 raft_consensus.cc:482] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.394544 12485 raft_consensus.cc:504] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.396016 12485 leader_election.cc:288] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.396155 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.396507 10661 raft_consensus.cc:2454] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.397040 10810 leader_election.cc:302] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.397589 12381 raft_consensus.cc:2781] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.397828 12381 raft_consensus.cc:482] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.398027 12381 raft_consensus.cc:3037] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.399961 12485 raft_consensus.cc:482] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.400218 12485 raft_consensus.cc:504] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.401522 12485 leader_election.cc:288] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.403606 12251 raft_consensus.cc:482] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.403777 12251 raft_consensus.cc:504] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.404609 12251 leader_election.cc:288] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.405575 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 52344eea7d3548feb9949beb09b34492 (DEFAULT_TABLE table=default.Table_dc4f0ade100c4b05b31b548c1abe130e [id=a7bdc41eb968426092e5114e57d46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.406185 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52344eea7d3548feb9949beb09b34492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.418538 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.419904 10661 raft_consensus.cc:2454] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.420543 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:00.421356 10555 leader_election.cc:341] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.425938 10810 leader_election.cc:302] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.429903 11960 raft_consensus.cc:2781] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.430451 11960 raft_consensus.cc:482] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.430701 11960 raft_consensus.cc:3037] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.434406 11960 raft_consensus.cc:504] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.435734 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.436060 10661 raft_consensus.cc:3037] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.436726 12381 raft_consensus.cc:504] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.439286 10661 raft_consensus.cc:2454] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:00.443395 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 52344eea7d3548feb9949beb09b34492 (DEFAULT_TABLE table=default.Table_dc4f0ade100c4b05b31b548c1abe130e [id=a7bdc41eb968426092e5114e57d46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.444015 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52344eea7d3548feb9949beb09b34492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.445138 10620 tablet_service.cc:1467] Processing CreateTablet for tablet c7b24ba5f0434f8b804ec6e8631095b6 (DEFAULT_TABLE table=default.Table_af483278f0004121a846ca38bec9d8d8 [id=101a0c8ac67443e8925b8770d0d105e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.445587 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b24ba5f0434f8b804ec6e8631095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.439900 10810 leader_election.cc:302] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.444056 10858 tablet_service.cc:1467] Processing CreateTablet for tablet c7b24ba5f0434f8b804ec6e8631095b6 (DEFAULT_TABLE table=default.Table_af483278f0004121a846ca38bec9d8d8 [id=101a0c8ac67443e8925b8770d0d105e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.449642 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b24ba5f0434f8b804ec6e8631095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.453490 12059 raft_consensus.cc:2781] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:00.453660 12059 raft_consensus.cc:686] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:00.454260 12059 consensus_queue.cc:237] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.346312 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.456694 10564 leader_election.cc:341] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.456930 10564 leader_election.cc:302] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.457778 11361 tablet_bootstrap.cc:654] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.349107 11047 leader_election.cc:302] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:00.458933 12094 raft_consensus.cc:2726] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:17:00.459242 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 110145us
I20260811 06:17:00.416607 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.460090 10564 leader_election.cc:341] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.460280 10564 leader_election.cc:302] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.460484 12285 raft_consensus.cc:482] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.460673 12285 raft_consensus.cc:504] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.461440 12285 leader_election.cc:288] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.461865 12246 raft_consensus.cc:2726] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.462093 12246 raft_consensus.cc:2726] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.463173 11362 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.463349 11362 ts_tablet_manager.cc:1397] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.267s user 0.108s sys 0.098s
I20260811 06:17:00.464160 11362 raft_consensus.cc:348] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.464406 11362 raft_consensus.cc:374] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.464507 11362 raft_consensus.cc:729] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.464781 11362 consensus_queue.cc:260] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.466395 11362 ts_tablet_manager.cc:1428] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:00.466696 11362 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.468674 11362 tablet_bootstrap.cc:654] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.470103 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 36e37f51b0b549b7a3e749f7fbe0d03a (DEFAULT_TABLE table=default.Table_cc937b90426f431999efcbb356bc29f8 [id=c1bef49596bf4827a27e6f2f6207d590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.470634 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36e37f51b0b549b7a3e749f7fbe0d03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.471925 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.472167 10659 raft_consensus.cc:3037] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.475178 10659 raft_consensus.cc:2454] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:00.475926 10810 leader_election.cc:302] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.477921 12285 raft_consensus.cc:2781] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:00.478777 12285 raft_consensus.cc:686] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:00.479647 12285 consensus_queue.cc:237] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.482592 10608 tablet_service.cc:1467] Processing CreateTablet for tablet f92a58686071449082f60d06b91b098c (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.483187 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92a58686071449082f60d06b91b098c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.483467 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.347553 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:00.486210 10632 tablet_service.cc:1467] Processing CreateTablet for tablet fb185af613d14b53961dbf333a4ddb95 (DEFAULT_TABLE table=default.Table_987b68deeac64dd1b9aad386fc6ffaff [id=09583b2d1b314b72bb2511f52d0a0eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.486676 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb185af613d14b53961dbf333a4ddb95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:00.486485 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 138914us
I20260811 06:17:00.487948 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:00.488351 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:00.488651 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:00.488885 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:00.489156 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:00.489303 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:00.489480 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:00.490031 11960 leader_election.cc:288] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.490139 10634 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff9b65fc804be9a686ad64a3d74ff0 (DEFAULT_TABLE table=default.Table_373a8a768dcc4de9bffd2c2488b003de [id=2b620a8250214aa2997083b1ab297b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.490588 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ff9b65fc804be9a686ad64a3d74ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.491200 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:00.491426 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:00.491680 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:00.491947 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:00.492096 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:00.492254 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:00.492588 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:00.493230 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:00.494172 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 7c01d05b8769440d8c7a544c0e9d80b4 (DEFAULT_TABLE table=default.Table_4417703678a641a18717b8d5d7b2e294 [id=b0d2e30d0a0348d8bf26a93b2aa577e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.495059 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c01d05b8769440d8c7a544c0e9d80b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.496783 10880 tablet_service.cc:1467] Processing CreateTablet for tablet f92a58686071449082f60d06b91b098c (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.497301 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92a58686071449082f60d06b91b098c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.498353 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.499030 12094 consensus_queue.cc:1035] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.499722 12094 consensus_queue.cc:1035] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.501971 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 52344eea7d3548feb9949beb09b34492 (DEFAULT_TABLE table=default.Table_dc4f0ade100c4b05b31b548c1abe130e [id=a7bdc41eb968426092e5114e57d46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.502576 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52344eea7d3548feb9949beb09b34492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.502725 10854 tablet_service.cc:1467] Processing CreateTablet for tablet fb185af613d14b53961dbf333a4ddb95 (DEFAULT_TABLE table=default.Table_987b68deeac64dd1b9aad386fc6ffaff [id=09583b2d1b314b72bb2511f52d0a0eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.503203 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb185af613d14b53961dbf333a4ddb95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.506426 10879 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff9b65fc804be9a686ad64a3d74ff0 (DEFAULT_TABLE table=default.Table_373a8a768dcc4de9bffd2c2488b003de [id=2b620a8250214aa2997083b1ab297b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.506891 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ff9b65fc804be9a686ad64a3d74ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.509646 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 5afbfec0bdf34619bf492d6803c73308 (DEFAULT_TABLE table=default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 [id=c967201f6db64a649b9c4d71e89222ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.510145 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afbfec0bdf34619bf492d6803c73308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.510354 12094 raft_consensus.cc:482] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.510514 12094 raft_consensus.cc:504] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.511271 12094 leader_election.cc:288] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:00.518189 11100 tablet_service.cc:1467] Processing CreateTablet for tablet fb185af613d14b53961dbf333a4ddb95 (DEFAULT_TABLE table=default.Table_987b68deeac64dd1b9aad386fc6ffaff [id=09583b2d1b314b72bb2511f52d0a0eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.518618 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.518771 11096 tablet_service.cc:1467] Processing CreateTablet for tablet f92a58686071449082f60d06b91b098c (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.519182 11094 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff9b65fc804be9a686ad64a3d74ff0 (DEFAULT_TABLE table=default.Table_373a8a768dcc4de9bffd2c2488b003de [id=2b620a8250214aa2997083b1ab297b70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.519598 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb185af613d14b53961dbf333a4ddb95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.521703 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92a58686071449082f60d06b91b098c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.525931 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ff9b65fc804be9a686ad64a3d74ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.526144 11117 tablet_service.cc:1467] Processing CreateTablet for tablet c7b24ba5f0434f8b804ec6e8631095b6 (DEFAULT_TABLE table=default.Table_af483278f0004121a846ca38bec9d8d8 [id=101a0c8ac67443e8925b8770d0d105e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.526590 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b24ba5f0434f8b804ec6e8631095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.529697 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 5afbfec0bdf34619bf492d6803c73308 (DEFAULT_TABLE table=default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 [id=c967201f6db64a649b9c4d71e89222ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.530205 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afbfec0bdf34619bf492d6803c73308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.532084 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 9a79e23d311a447480c70393259cbfae (DEFAULT_TABLE table=default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 [id=c0ef340b9da1418abb2a9831abc3cec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.532569 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a79e23d311a447480c70393259cbfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.533433 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6254bf781740019c3f71b26179f25d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.534207 11361 tablet_bootstrap.cc:492] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.534411 11361 ts_tablet_manager.cc:1397] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.210s user 0.003s sys 0.000s
I20260811 06:17:00.535243 11361 raft_consensus.cc:348] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:00.535519 11361 raft_consensus.cc:374] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.535634 11361 raft_consensus.cc:729] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.535873 11361 consensus_queue.cc:260] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:17:00.536214 10813 leader_election.cc:341] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.536899 11361 ts_tablet_manager.cc:1428] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:00.537240 11361 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.539033 11361 tablet_bootstrap.cc:654] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.539934 12517 raft_consensus.cc:482] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.540122 12517 raft_consensus.cc:504] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.541092 11365 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.541502 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.542222 10564 leader_election.cc:341] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.542687 12517 leader_election.cc:288] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:00.543144 10813 leader_election.cc:341] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.543180 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.543704 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.546463 12517 raft_consensus.cc:482] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.547947 11365 ts_tablet_manager.cc:1397] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.156s user 0.022s sys 0.033s
I20260811 06:17:00.546648 12517 raft_consensus.cc:504] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.553297 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 9a79e23d311a447480c70393259cbfae (DEFAULT_TABLE table=default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 [id=c0ef340b9da1418abb2a9831abc3cec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.553861 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a79e23d311a447480c70393259cbfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.554778 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.555831 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.556429 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.558501 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.558962 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.559391 11153 raft_consensus.cc:3037] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.562974 11361 tablet_bootstrap.cc:492] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.563161 11361 ts_tablet_manager.cc:1397] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260811 06:17:00.563984 11361 raft_consensus.cc:348] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.564217 11361 raft_consensus.cc:374] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.564314 11361 raft_consensus.cc:729] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.564924 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 5afbfec0bdf34619bf492d6803c73308 (DEFAULT_TABLE table=default.Table_d8fcc3aefc2943a8a87dc2cc7d4301c9 [id=c967201f6db64a649b9c4d71e89222ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.565454 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5afbfec0bdf34619bf492d6803c73308. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:00.567440 10555 leader_election.cc:341] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.493511 11676 catalog_manager.cc:5495] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } }
W20260811 06:17:00.568158 10813 leader_election.cc:341] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:00.568550 10813 leader_election.cc:341] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.573997 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 1168c63178174571907981d4a6ac165f (DEFAULT_TABLE table=default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 [id=485faa9398f8447398dbdc64b6ef2167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.574579 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1168c63178174571907981d4a6ac165f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.574851 11362 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.575044 11362 ts_tablet_manager.cc:1397] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.108s user 0.003s sys 0.000s
I20260811 06:17:00.575174 11960 raft_consensus.cc:482] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.575395 11960 raft_consensus.cc:504] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.575902 11362 raft_consensus.cc:348] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.576153 11362 raft_consensus.cc:374] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.576241 11362 raft_consensus.cc:729] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.576453 11960 leader_election.cc:288] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.576515 11362 consensus_queue.cc:260] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.576767 11960 consensus_queue.cc:1035] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.577154 11362 ts_tablet_manager.cc:1428] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:00.577509 11362 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.578049 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:00.567129 11047 leader_election.cc:302] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:00.580948 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:00.581676 12094 raft_consensus.cc:2726] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.582618 12485 consensus_queue.cc:1035] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.582839 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.583285 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.583427 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:00.583616 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:00.583649 12485 consensus_queue.cc:1035] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.584039 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:00.584218 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:00.584594 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:00.584710 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:00.585021 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:00.585450 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:00.586079 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 97886e07a36049b992a75d99081d32c4 (DEFAULT_TABLE table=default.Table_7704cd8b9ad742bd92383ed86acacc8c [id=7457527ea9f143f0a1d5ead22ee5b5d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.586483 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97886e07a36049b992a75d99081d32c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.588546 12381 leader_election.cc:288] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.592243 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 1168c63178174571907981d4a6ac165f (DEFAULT_TABLE table=default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 [id=485faa9398f8447398dbdc64b6ef2167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.592769 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1168c63178174571907981d4a6ac165f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.594717 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 9a79e23d311a447480c70393259cbfae (DEFAULT_TABLE table=default.Table_6e61e223c12c4b6ebc75c0d5d04491c0 [id=c0ef340b9da1418abb2a9831abc3cec5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.595463 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a79e23d311a447480c70393259cbfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.598956 11102 tablet_service.cc:1467] Processing CreateTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.599458 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd91e4f85cc64de9a13c598a3695f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.608361 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 4583024f1f79477886a7664a71eecb8a (DEFAULT_TABLE table=default.Table_2418f358fbab49a585c61348c4764570 [id=51128de8177d416cad485dbe668152ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.608984 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4583024f1f79477886a7664a71eecb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.611553 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 4583024f1f79477886a7664a71eecb8a (DEFAULT_TABLE table=default.Table_2418f358fbab49a585c61348c4764570 [id=51128de8177d416cad485dbe668152ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.612044 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4583024f1f79477886a7664a71eecb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.614722 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 0a67f283a7a6447daaecc9c03703b977 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.615216 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a67f283a7a6447daaecc9c03703b977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.620728 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 0a67f283a7a6447daaecc9c03703b977 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.621440 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a67f283a7a6447daaecc9c03703b977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.585698 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:00.622431 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:00.622675 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:00.622954 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 2 got 0
I20260811 06:17:00.623140 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:00.623287 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:00.623514 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:00.623745 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:00.623996 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:00.624248 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:00.624567 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:00.624861 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:00.625066 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:00.625345 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:00.625546 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:00.626245 11117 tablet_service.cc:1467] Processing CreateTablet for tablet a25398c10a134356ac21b8a356eba46c (DEFAULT_TABLE table=default.Table_3b1ac4a64e764c4199189b7239086a89 [id=c15ad397c32d4fb9b3e64edcb9d35c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.627157 10871 tablet_service.cc:1467] Processing CreateTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.627871 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd91e4f85cc64de9a13c598a3695f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.634528 10854 tablet_service.cc:1467] Processing CreateTablet for tablet a25398c10a134356ac21b8a356eba46c (DEFAULT_TABLE table=default.Table_3b1ac4a64e764c4199189b7239086a89 [id=c15ad397c32d4fb9b3e64edcb9d35c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.635113 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25398c10a134356ac21b8a356eba46c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:00.635607 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 66630.1us
I20260811 06:17:00.636938 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.637422 11362 tablet_bootstrap.cc:654] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:00.638634 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 97101.8us
I20260811 06:17:00.643785 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 3de77019fc074a55ab741db336a9fc60 (DEFAULT_TABLE table=default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.644332 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de77019fc074a55ab741db336a9fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.644146 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 97886e07a36049b992a75d99081d32c4 (DEFAULT_TABLE table=default.Table_7704cd8b9ad742bd92383ed86acacc8c [id=7457527ea9f143f0a1d5ead22ee5b5d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.644387 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 478a5fbcc353475ba35a5b9f98654c33 (DEFAULT_TABLE table=default.Table_ef3697835c0e4cedbb64c0a58636d94b [id=2b588f0344cf48d5a6debfc5f8c53f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.643785 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 446112faf4374fa29fea8bb40666856e (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.644724 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97886e07a36049b992a75d99081d32c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.644906 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478a5fbcc353475ba35a5b9f98654c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.645334 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446112faf4374fa29fea8bb40666856e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.646443 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:00.646757 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:00.647825 12517 leader_election.cc:288] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.648343 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.648550 11365 raft_consensus.cc:348] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.649307 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016]). Expected version 1 got 0
I20260811 06:17:00.649308 11361 consensus_queue.cc:260] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.649547 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 1168c63178174571907981d4a6ac165f (DEFAULT_TABLE table=default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38 [id=485faa9398f8447398dbdc64b6ef2167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.651202 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:00.652211 11361 ts_tablet_manager.cc:1428] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.089s user 0.003s sys 0.000s
I20260811 06:17:00.652613 11365 raft_consensus.cc:374] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.652738 11365 raft_consensus.cc:729] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.653023 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 5f040a4545164a75a1cfe2a203a867d6 (DEFAULT_TABLE table=default.Table_1882451cbcfe432aa9188327086bf0e3 [id=c881b1976ebe40dd8dc819e98a1d0581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.653441 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.653991 11365 consensus_queue.cc:260] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.654352 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 3de77019fc074a55ab741db336a9fc60 (DEFAULT_TABLE table=default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:17:00.655541 10564 leader_election.cc:341] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.655591 11365 ts_tablet_manager.cc:1428] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.107s user 0.001s sys 0.001s
I20260811 06:17:00.655722 10609 tablet_service.cc:1467] Processing CreateTablet for tablet a25398c10a134356ac21b8a356eba46c (DEFAULT_TABLE table=default.Table_3b1ac4a64e764c4199189b7239086a89 [id=c15ad397c32d4fb9b3e64edcb9d35c89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.656221 10555 leader_election.cc:302] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.656993 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.657112 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f040a4545164a75a1cfe2a203a867d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.656597 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 97886e07a36049b992a75d99081d32c4 (DEFAULT_TABLE table=default.Table_7704cd8b9ad742bd92383ed86acacc8c [id=7457527ea9f143f0a1d5ead22ee5b5d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.661595 11365 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:00.661855 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 95584us
I20260811 06:17:00.663064 12517 raft_consensus.cc:2726] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.663301 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 4583024f1f79477886a7664a71eecb8a (DEFAULT_TABLE table=default.Table_2418f358fbab49a585c61348c4764570 [id=51128de8177d416cad485dbe668152ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.663739 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1168c63178174571907981d4a6ac165f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.664352 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de77019fc074a55ab741db336a9fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.664564 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25398c10a134356ac21b8a356eba46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.664685 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a25398c10a134356ac21b8a356eba46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.665786 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4583024f1f79477886a7664a71eecb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.667171 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 5f040a4545164a75a1cfe2a203a867d6 (DEFAULT_TABLE table=default.Table_1882451cbcfe432aa9188327086bf0e3 [id=c881b1976ebe40dd8dc819e98a1d0581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.667631 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f040a4545164a75a1cfe2a203a867d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.669035 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 478a5fbcc353475ba35a5b9f98654c33 (DEFAULT_TABLE table=default.Table_ef3697835c0e4cedbb64c0a58636d94b [id=2b588f0344cf48d5a6debfc5f8c53f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.670580 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.671442 11361 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.671530 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 5f040a4545164a75a1cfe2a203a867d6 (DEFAULT_TABLE table=default.Table_1882451cbcfe432aa9188327086bf0e3 [id=c881b1976ebe40dd8dc819e98a1d0581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.671763 11365 tablet_bootstrap.cc:654] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.672106 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f040a4545164a75a1cfe2a203a867d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.673532 11361 tablet_bootstrap.cc:654] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.675151 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478a5fbcc353475ba35a5b9f98654c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.666791 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:00.678566 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 3de77019fc074a55ab741db336a9fc60 (DEFAULT_TABLE table=default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.679065 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3de77019fc074a55ab741db336a9fc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.679262 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97886e07a36049b992a75d99081d32c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.684860 10659 raft_consensus.cc:2454] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.685137 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 478a5fbcc353475ba35a5b9f98654c33 (DEFAULT_TABLE table=default.Table_ef3697835c0e4cedbb64c0a58636d94b [id=2b588f0344cf48d5a6debfc5f8c53f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.686115 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478a5fbcc353475ba35a5b9f98654c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.690717 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 446112faf4374fa29fea8bb40666856e (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.691601 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446112faf4374fa29fea8bb40666856e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.698467 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 446112faf4374fa29fea8bb40666856e (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.699353 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446112faf4374fa29fea8bb40666856e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:00.700121 10555 leader_election.cc:341] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.700332 11362 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.700490 11362 ts_tablet_manager.cc:1397] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.002s
I20260811 06:17:00.701275 11362 raft_consensus.cc:348] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.701506 11362 raft_consensus.cc:374] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.701593 11362 raft_consensus.cc:729] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.701874 11362 consensus_queue.cc:260] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.703112 11365 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.703075 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 0a67f283a7a6447daaecc9c03703b977 (DEFAULT_TABLE table=default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.703279 11362 ts_tablet_manager.cc:1428] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:00.703295 11365 ts_tablet_manager.cc:1397] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.009s
I20260811 06:17:00.703558 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a67f283a7a6447daaecc9c03703b977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.704120 11365 raft_consensus.cc:348] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.704321 11362 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.704378 11365 raft_consensus.cc:374] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.704497 11365 raft_consensus.cc:729] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.704777 11365 consensus_queue.cc:260] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.705399 11365 ts_tablet_manager.cc:1428] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:00.705749 11365 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.706079 11362 tablet_bootstrap.cc:654] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.707460 11365 tablet_bootstrap.cc:654] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.708525 10555 leader_election.cc:302] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.710987 10632 tablet_service.cc:1467] Processing CreateTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:00.712795 12517 raft_consensus.cc:2726] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.723985 10661 raft_consensus.cc:2454] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.726176 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:00.727464 11365 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.727659 11365 ts_tablet_manager.cc:1397] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.009s
I20260811 06:17:00.728791 11365 raft_consensus.cc:348] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.729099 11365 raft_consensus.cc:374] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.729175 11365 raft_consensus.cc:729] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.729450 11365 consensus_queue.cc:260] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.730087 11365 ts_tablet_manager.cc:1428] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 06:17:00.732370 12517 raft_consensus.cc:482] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.732510 12517 raft_consensus.cc:504] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.733093 12517 leader_election.cc:288] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.733495 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:00.733604 12517 raft_consensus.cc:482] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.733845 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52543aa31a1749d1a0fd5e48cbe30889" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.733796 12517 raft_consensus.cc:504] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.734419 12517 leader_election.cc:288] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:00.734524 10564 leader_election.cc:341] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.735265 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.735889 10564 leader_election.cc:341] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.745149 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd91e4f85cc64de9a13c598a3695f8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:00.748944 11361 tablet_bootstrap.cc:492] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.749155 11361 ts_tablet_manager.cc:1397] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.000s
I20260811 06:17:00.750110 11361 raft_consensus.cc:348] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.750372 11361 raft_consensus.cc:374] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.750453 11361 raft_consensus.cc:729] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.750751 11361 consensus_queue.cc:260] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.750875 11365 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.752604 12517 raft_consensus.cc:482] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.752779 12517 raft_consensus.cc:504] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.753101 11365 tablet_bootstrap.cc:654] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.753494 12517 leader_election.cc:288] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.754174 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:00.754926 10564 leader_election.cc:341] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.755550 11361 ts_tablet_manager.cc:1428] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:00.759979 11361 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.761996 12571 consensus_queue.cc:1035] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.762813 10810 leader_election.cc:302] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.763211 12571 raft_consensus.cc:2781] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.763329 12571 raft_consensus.cc:482] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.763413 12571 raft_consensus.cc:3037] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.764386 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:00.764662 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:00.764878 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:00.765332 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:00.766287 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:00.766597 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:00.766635 12571 raft_consensus.cc:504] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.767331 12571 leader_election.cc:288] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.767392 11365 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.767567 11365 ts_tablet_manager.cc:1397] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.007s
I20260811 06:17:00.767791 12571 consensus_queue.cc:1035] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.768445 11365 raft_consensus.cc:348] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.768687 11365 raft_consensus.cc:374] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.768782 11365 raft_consensus.cc:729] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.769373 11365 consensus_queue.cc:260] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.769584 11362 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.769793 11362 ts_tablet_manager.cc:1397] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.000s
I20260811 06:17:00.770524 11365 ts_tablet_manager.cc:1428] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 06:17:00.771346 11365 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.773025 11361 tablet_bootstrap.cc:654] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.773325 11365 tablet_bootstrap.cc:654] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.774096 11362 raft_consensus.cc:348] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.774382 11362 raft_consensus.cc:374] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.774463 11362 raft_consensus.cc:729] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.776063 11362 consensus_queue.cc:260] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.776643 11362 ts_tablet_manager.cc:1428] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:00.781394 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:00.783782 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:00.784544 11362 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.788611 11362 tablet_bootstrap.cc:654] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.784246 11672 catalog_manager.cc:5495] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:00.790251 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:00.790719 11672 catalog_manager.cc:5495] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:00.791357 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:00.792155 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:00.793805 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:00.794142 12517 raft_consensus.cc:482] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.794349 12517 raft_consensus.cc:504] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.795024 12517 leader_election.cc:288] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.796052 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:00.796072 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.796351 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:00.796568 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:00.796742 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
W20260811 06:17:00.796942 10564 leader_election.cc:341] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.797084 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:00.797236 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:00.797461 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:00.797636 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:00.797992 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:00.798370 11672 catalog_manager.cc:5495] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:00.798945 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:00.799263 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:00.799578 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:00.799808 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:00.800062 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:00.800246 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:00.800410 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 2 got 0
I20260811 06:17:00.800616 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:00.800743 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:00.800993 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:00.801155 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:00.801369 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:00.805480 10810 leader_election.cc:302] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:00.806169 11047 consensus_peers.cc:487] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:00.815308 12272 raft_consensus.cc:2781] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.815255 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.815459 12272 raft_consensus.cc:482] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.815573 12272 raft_consensus.cc:3037] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:00.817617 10813 leader_election.cc:341] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:00.818174 10813 leader_election.cc:341] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.818924 12272 raft_consensus.cc:504] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.820689 12272 leader_election.cc:288] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:00.818910 10813 consensus_peers.cc:487] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:00.823140 10813 consensus_peers.cc:487] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:00.801669 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:00.824465 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
W20260811 06:17:00.825023 10813 leader_election.cc:341] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.826797 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:00.828238 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:00.829833 12578 consensus_queue.cc:1035] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.830425 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:00.830765 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.831009 10659 raft_consensus.cc:3037] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.832357 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:00.832542 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:00.832767 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:00.833452 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52543aa31a1749d1a0fd5e48cbe30889" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.834455 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.835286 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.835850 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.836067 10664 raft_consensus.cc:3037] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.836076 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.837168 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016]). Expected version 1 got 0
I20260811 06:17:00.837440 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:00.837682 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:00.837942 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:00.840307 11157 raft_consensus.cc:3037] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.840703 10659 raft_consensus.cc:2454] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:00.844043 10664 raft_consensus.cc:2454] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:17:00.850598 10564 consensus_peers.cc:487] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:00.860061 10810 leader_election.cc:302] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.860695 12272 raft_consensus.cc:2781] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:00.861083 12272 raft_consensus.cc:686] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:00.861570 12272 consensus_queue.cc:237] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.869369 11361 tablet_bootstrap.cc:492] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.873891 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e73b8798b2455baf642abc532a5d8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.874233 11153 raft_consensus.cc:3037] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.875772 10810 leader_election.cc:302] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.876207 12059 raft_consensus.cc:2781] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:00.879555 12059 raft_consensus.cc:686] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
W20260811 06:17:00.879675 10555 leader_election.cc:341] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.879873 10555 leader_election.cc:302] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.880214 12059 consensus_queue.cc:237] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.880520 12251 consensus_queue.cc:1035] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:00.880939 12517 raft_consensus.cc:2726] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:00.898679 10555 leader_election.cc:341] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.899084 10555 leader_election.cc:302] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.899521 12246 raft_consensus.cc:2726] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:00.900103 10555 leader_election.cc:341] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.900358 10555 leader_election.cc:302] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.900758 12246 raft_consensus.cc:2726] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:00.901428 10555 leader_election.cc:341] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.901743 10555 leader_election.cc:302] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.902086 12246 raft_consensus.cc:2726] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.904122 11362 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:00.904448 11362 ts_tablet_manager.cc:1397] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.127s user 0.008s sys 0.005s
I20260811 06:17:00.914188 11361 ts_tablet_manager.cc:1397] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.119s user 0.017s sys 0.000s
I20260811 06:17:00.917043 11361 raft_consensus.cc:348] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.917490 11361 raft_consensus.cc:374] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.917776 11361 raft_consensus.cc:729] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.918181 11361 consensus_queue.cc:260] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.926940 11362 raft_consensus.cc:348] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.927397 11362 raft_consensus.cc:374] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.927573 11362 raft_consensus.cc:729] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.928171 11361 ts_tablet_manager.cc:1428] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260811 06:17:00.928144 12246 raft_consensus.cc:482] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.928486 11361 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.928568 12272 raft_consensus.cc:482] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.928369 12246 raft_consensus.cc:504] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.928797 12272 raft_consensus.cc:504] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.929929 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.930707 12272 leader_election.cc:288] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.931708 11361 tablet_bootstrap.cc:654] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.938794 12246 leader_election.cc:288] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:00.939759 10564 leader_election.cc:341] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.942759 11365 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:00.943029 11365 ts_tablet_manager.cc:1397] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.172s user 0.012s sys 0.033s
I20260811 06:17:00.944417 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:00.945112 11365 raft_consensus.cc:348] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.945464 11365 raft_consensus.cc:374] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.945609 11365 raft_consensus.cc:729] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.947518 11153 raft_consensus.cc:2454] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:00.948411 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:00.948568 12620 log.cc:924] Time spent T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20260811 06:17:00.948873 10664 raft_consensus.cc:2454] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:00.949612 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:00.954257 10555 leader_election.cc:341] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.954522 10555 leader_election.cc:302] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:00.955047 12246 raft_consensus.cc:2726] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:00.956446 11361 tablet_bootstrap.cc:492] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.956768 11361 ts_tablet_manager.cc:1397] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260811 06:17:00.958127 11361 raft_consensus.cc:348] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.958680 11361 raft_consensus.cc:374] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:00.958840 11361 raft_consensus.cc:729] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:00.959651 11365 consensus_queue.cc:260] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.960387 11365 ts_tablet_manager.cc:1428] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260811 06:17:00.959229 11361 consensus_queue.cc:260] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.962203 11361 ts_tablet_manager.cc:1428] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 06:17:00.962581 11361 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:00.964325 11365 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:00.968695 11365 tablet_bootstrap.cc:654] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.973361 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:00.975062 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:00.981961 11361 tablet_bootstrap.cc:654] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:00.983309 10810 leader_election.cc:302] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:00.983819 12272 raft_consensus.cc:2781] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:00.984107 12272 raft_consensus.cc:482] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:00.984355 12272 raft_consensus.cc:3037] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.988180 12272 raft_consensus.cc:504] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:00.989595 10813 leader_election.cc:341] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.990365 11362 consensus_queue.cc:260] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.991662 12272 leader_election.cc:288] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:00.992048 12484 raft_consensus.cc:482] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:00.992302 12484 raft_consensus.cc:504] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:00.992552 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:00.992903 10664 raft_consensus.cc:3037] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:00.993166 12484 leader_election.cc:288] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:00.994338 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:00.995460 11362 ts_tablet_manager.cc:1428] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.091s user 0.000s sys 0.004s
I20260811 06:17:00.996642 11362 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:00.998415 11361 tablet_bootstrap.cc:492] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:00.998677 11361 ts_tablet_manager.cc:1397] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.003s
W20260811 06:17:00.995957 10813 leader_election.cc:341] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:00.999320 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:00.999958 11361 raft_consensus.cc:348] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.000305 11361 raft_consensus.cc:374] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.000540 11361 raft_consensus.cc:729] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.000852 11361 consensus_queue.cc:260] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.001525 11361 ts_tablet_manager.cc:1428] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260811 06:17:01.005191 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:01.005509 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:01.005926 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:01.006728 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:01.006979 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:01.007359 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:01.007772 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:01.007887 12251 raft_consensus.cc:482] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.008311 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:01.008669 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:01.008980 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:01.009013 12272 consensus_queue.cc:1035] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.009243 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:01.009608 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:01.009972 11365 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.009915 12251 raft_consensus.cc:504] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.010234 11365 ts_tablet_manager.cc:1397] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.008s
I20260811 06:17:01.010820 11361 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.011618 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2bdb349406a46629e6c307e1ebfd9dc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.011950 10662 raft_consensus.cc:2379] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:01.012490 11046 leader_election.cc:302] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.013871 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52ecffcf4a0e46428caed6f7d72199bd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:01.014868 10564 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.015607 12484 raft_consensus.cc:3037] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.015924 11365 raft_consensus.cc:348] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.016225 11365 raft_consensus.cc:374] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.016605 11365 raft_consensus.cc:729] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.018018 11365 consensus_queue.cc:260] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.018515 10664 raft_consensus.cc:2454] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.019029 11365 ts_tablet_manager.cc:1428] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260811 06:17:01.019407 11365 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.019903 11362 tablet_bootstrap.cc:654] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.014876 12251 leader_election.cc:288] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.022194 10810 leader_election.cc:302] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.022563 11361 tablet_bootstrap.cc:654] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.022751 12272 raft_consensus.cc:2781] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
W20260811 06:17:01.023238 11588 consensus_peers.cc:487] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 -> Peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Couldn't send request to peer 29fb239be50c4171bdbc75e064555197. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 06:17:01.023988 12272 raft_consensus.cc:686] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.024297 12272 consensus_queue.cc:237] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.026381 11365 tablet_bootstrap.cc:654] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.033672 12484 raft_consensus.cc:2726] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.035513 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52ecffcf4a0e46428caed6f7d72199bd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:01.036697 10555 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.036880 10555 leader_election.cc:302] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.037469 12251 raft_consensus.cc:2726] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.043757 11361 tablet_bootstrap.cc:492] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.044041 11361 ts_tablet_manager.cc:1397] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.003s
I20260811 06:17:01.045348 11361 raft_consensus.cc:348] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.045696 11361 raft_consensus.cc:374] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.045832 11361 raft_consensus.cc:729] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.046226 11361 consensus_queue.cc:260] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.049237 12251 raft_consensus.cc:482] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.049618 12251 raft_consensus.cc:504] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.050510 12251 leader_election.cc:288] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.051532 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.051857 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:01.052454 10564 leader_election.cc:341] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:01.052747 10555 leader_election.cc:341] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.052906 10555 leader_election.cc:302] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.053268 11361 ts_tablet_manager.cc:1428] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260811 06:17:01.053251 12251 raft_consensus.cc:2726] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.053788 11361 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.064265 11361 tablet_bootstrap.cc:654] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.072758 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:01.073848 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:01.074262 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:01.074785 11655 catalog_manager.cc:5495] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:01.075471 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:01.075811 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:01.076122 11655 catalog_manager.cc:5495] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:01.076802 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:01.077245 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:01.077729 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:01.079641 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:01.080135 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:01.080987 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:01.081575 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:01.083010 11365 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.083653 11362 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:01.083859 11365 ts_tablet_manager.cc:1397] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.004s
I20260811 06:17:01.084391 12059 consensus_queue.cc:1035] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.084968 11362 ts_tablet_manager.cc:1397] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.019s
I20260811 06:17:01.085335 11365 raft_consensus.cc:348] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.085659 12059 raft_consensus.cc:482] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.085832 11365 raft_consensus.cc:374] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.085976 11365 raft_consensus.cc:729] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.086028 12059 raft_consensus.cc:504] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.086153 11362 raft_consensus.cc:348] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.086449 11362 raft_consensus.cc:374] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.086318 11365 consensus_queue.cc:260] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.086560 11362 raft_consensus.cc:729] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.086987 11365 ts_tablet_manager.cc:1428] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:01.087085 12059 leader_election.cc:288] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.087638 11365 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.087687 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.088099 11362 consensus_queue.cc:260] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.090346 10813 leader_election.cc:341] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.090735 11362 ts_tablet_manager.cc:1428] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 06:17:01.092041 11362 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:01.100963 11361 tablet_bootstrap.cc:492] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.101163 11361 ts_tablet_manager.cc:1397] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.006s
I20260811 06:17:01.101624 11362 tablet_bootstrap.cc:654] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.101810 12483 consensus_queue.cc:1035] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.102375 11361 raft_consensus.cc:348] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.102617 11361 raft_consensus.cc:374] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.102782 11361 raft_consensus.cc:729] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.103119 11361 consensus_queue.cc:260] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.104058 11361 ts_tablet_manager.cc:1428] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:01.104491 11361 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.109298 11361 tablet_bootstrap.cc:654] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.089409 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.116559 10662 raft_consensus.cc:2454] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:01.117450 10810 leader_election.cc:302] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.118243 12059 raft_consensus.cc:2781] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.118496 12059 raft_consensus.cc:482] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.118707 12059 raft_consensus.cc:3037] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.121596 11361 tablet_bootstrap.cc:492] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.121980 11361 ts_tablet_manager.cc:1397] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
I20260811 06:17:01.122560 12642 raft_consensus.cc:482] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.122933 12642 raft_consensus.cc:504] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.123319 11361 raft_consensus.cc:348] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.123661 11361 raft_consensus.cc:374] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.123771 11361 raft_consensus.cc:729] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.126688 11361 consensus_queue.cc:260] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.129248 11365 tablet_bootstrap.cc:654] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.128718 12059 raft_consensus.cc:504] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.130983 11361 ts_tablet_manager.cc:1428] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260811 06:17:01.131100 12059 leader_election.cc:288] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.131487 11361 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.131665 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:01.132495 10813 leader_election.cc:341] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.135708 11361 tablet_bootstrap.cc:654] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.140269 12642 leader_election.cc:288] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.140784 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e873e2f7b3d34988856b3be044de1ed7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:01.142784 10564 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.143620 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e873e2f7b3d34988856b3be044de1ed7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:01.144744 10555 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.145628 10555 leader_election.cc:302] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.145287 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.146334 10662 raft_consensus.cc:3037] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.150146 12642 raft_consensus.cc:2726] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.152140 10662 raft_consensus.cc:2454] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.153132 10810 leader_election.cc:302] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.154337 12272 raft_consensus.cc:2781] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.155063 11365 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.155323 11365 ts_tablet_manager.cc:1397] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.007s
I20260811 06:17:01.156631 11365 raft_consensus.cc:348] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.157074 11365 raft_consensus.cc:374] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.157455 12272 raft_consensus.cc:686] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.157945 12272 consensus_queue.cc:237] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.158243 11365 raft_consensus.cc:729] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.158522 11365 consensus_queue.cc:260] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.159323 11365 ts_tablet_manager.cc:1428] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:17:01.159696 11365 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.163385 11365 tablet_bootstrap.cc:654] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.163595 12483 raft_consensus.cc:482] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.163975 12483 raft_consensus.cc:504] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.164886 12483 leader_election.cc:288] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.166342 11361 tablet_bootstrap.cc:492] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.166606 11361 ts_tablet_manager.cc:1397] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.014s
I20260811 06:17:01.166605 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.168720 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca9ef015de946548a39e661d0ce3fa9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.169243 12059 consensus_queue.cc:1035] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.169389 11361 raft_consensus.cc:348] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.169581 11046 leader_election.cc:302] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.169651 11361 raft_consensus.cc:374] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.169866 11361 raft_consensus.cc:729] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.170168 12483 raft_consensus.cc:2726] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.170233 11361 consensus_queue.cc:260] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.170486 11365 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.170987 11361 ts_tablet_manager.cc:1428] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:17:01.172626 11365 ts_tablet_manager.cc:1397] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s
I20260811 06:17:01.174608 11361 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.178586 11361 tablet_bootstrap.cc:654] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.188512 11365 raft_consensus.cc:348] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.193846 11365 raft_consensus.cc:374] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.194020 11365 raft_consensus.cc:729] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.194453 11365 consensus_queue.cc:260] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.195335 11365 ts_tablet_manager.cc:1428] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260811 06:17:01.195818 11365 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.198414 11365 tablet_bootstrap.cc:654] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.203161 11361 tablet_bootstrap.cc:492] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.203540 11361 ts_tablet_manager.cc:1397] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.004s
I20260811 06:17:01.204661 11361 raft_consensus.cc:348] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.205056 11361 raft_consensus.cc:374] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:01.204824 12363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260811 06:17:01.205231 11361 raft_consensus.cc:729] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.205555 12642 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.205825 11361 consensus_queue.cc:260] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.206053 12363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 06:17:01.206202 12363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 06:17:01.205927 12642 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.207567 11361 ts_tablet_manager.cc:1428] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 06:17:01.207506 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.207969 11361 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:01.208295 10564 leader_election.cc:341] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.212258 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:01.212821 12642 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.214085 12642 raft_consensus.cc:482] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.214561 12642 raft_consensus.cc:504] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.216199 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:01.216890 10564 leader_election.cc:341] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.217240 12642 leader_election.cc:288] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.218678 11365 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.218899 11365 ts_tablet_manager.cc:1397] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20260811 06:17:01.220098 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.220527 11361 tablet_bootstrap.cc:654] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.221197 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.223667 11365 raft_consensus.cc:348] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.223977 11365 raft_consensus.cc:374] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.224143 11365 raft_consensus.cc:729] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.224045 12578 consensus_queue.cc:1035] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.224455 11365 consensus_queue.cc:260] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.225183 11365 ts_tablet_manager.cc:1428] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:01.225381 12517 raft_consensus.cc:482] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.225881 12517 raft_consensus.cc:504] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.226819 12517 leader_election.cc:288] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.227803 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.227993 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.230986 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 2 got 0
I20260811 06:17:01.231509 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:01.232057 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:01.232648 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:01.233064 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:01.233362 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:01.233925 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:01.234331 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
W20260811 06:17:01.235549 12363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260811 06:17:01.236308 11361 tablet_bootstrap.cc:492] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.236588 11361 ts_tablet_manager.cc:1397] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.008s
W20260811 06:17:01.237488 12363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:17:01.237630 12363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:17:01.237895 12363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:17:01.238209 11361 raft_consensus.cc:348] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.238732 11361 raft_consensus.cc:374] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.239065 11361 raft_consensus.cc:729] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.239446 11361 consensus_queue.cc:260] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.240329 11361 ts_tablet_manager.cc:1428] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 06:17:01.240962 11361 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.244428 11361 tablet_bootstrap.cc:654] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.256337 11361 tablet_bootstrap.cc:492] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.256705 11361 ts_tablet_manager.cc:1397] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260811 06:17:01.258121 11361 raft_consensus.cc:348] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.258594 11361 raft_consensus.cc:374] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.258782 11361 raft_consensus.cc:729] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.259177 11361 consensus_queue.cc:260] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.260087 11361 ts_tablet_manager.cc:1428] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:01.260607 11361 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.266724 11365 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:01.267324 10555 leader_election.cc:341] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.268508 12363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.203.124
--webserver_port=39467
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:17:01.269898 12642 raft_consensus.cc:482] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.270097 12642 raft_consensus.cc:504] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.270684 12363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260811 06:17:01.268250 10564 leader_election.cc:341] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.273178 12642 leader_election.cc:288] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.274092 12363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 06:17:01.276878 11361 tablet_bootstrap.cc:654] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.278734 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.280118 10555 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.283311 11365 tablet_bootstrap.cc:654] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.283596 12272 raft_consensus.cc:482] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.283890 12272 raft_consensus.cc:504] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.285458 11361 tablet_bootstrap.cc:492] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.285802 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.286048 12272 leader_election.cc:288] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.285789 11361 ts_tablet_manager.cc:1397] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
W20260811 06:17:01.286526 10813 leader_election.cc:341] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.287760 11361 raft_consensus.cc:348] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.288288 11361 raft_consensus.cc:374] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.288578 11361 raft_consensus.cc:729] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.288838 11361 consensus_queue.cc:260] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.289794 10564 leader_election.cc:341] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.290102 12642 raft_consensus.cc:2726] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.290323 11361 ts_tablet_manager.cc:1428] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260811 06:17:01.291059 11361 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.294255 11361 tablet_bootstrap.cc:654] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.295868 11157 raft_consensus.cc:3037] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.298825 12484 consensus_queue.cc:1035] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:01.305071 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 52056.9us
I20260811 06:17:01.307503 12272 consensus_queue.cc:1035] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:01.310190 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:01.311587 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:01.313465 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:01.314558 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016]). Expected version 1 got 0
I20260811 06:17:01.316545 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:01.318142 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:01.319351 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:01.319527 11361 tablet_bootstrap.cc:492] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.319857 11361 ts_tablet_manager.cc:1397] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.010s
I20260811 06:17:01.320331 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:01.321408 11361 raft_consensus.cc:348] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.321862 11361 raft_consensus.cc:374] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.322048 11361 raft_consensus.cc:729] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.324810 11362 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:01.325071 11362 ts_tablet_manager.cc:1397] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.233s user 0.012s sys 0.026s
I20260811 06:17:01.325219 11361 consensus_queue.cc:260] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.326102 12704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:17:01.326586 11361 ts_tablet_manager.cc:1428] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260811 06:17:01.326575 11362 raft_consensus.cc:348] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.326925 11361 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.326941 11362 raft_consensus.cc:374] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.327229 11362 raft_consensus.cc:729] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
W20260811 06:17:01.327476 12703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:17:01.327946 12713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:17:01.328645 11365 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.329030 11362 consensus_queue.cc:260] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.331122 12363 server_base.cc:1034] running on GCE node
I20260811 06:17:01.333204 12363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:17:01.333452 11365 ts_tablet_manager.cc:1397] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.004s
I20260811 06:17:01.333618 11361 tablet_bootstrap.cc:654] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:01.334801 10555 leader_election.cc:341] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.336544 10555 leader_election.cc:302] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.337056 12642 raft_consensus.cc:2726] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:01.337697 10555 leader_election.cc:341] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.338050 10555 leader_election.cc:302] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.338502 12642 raft_consensus.cc:2726] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.339406 11362 ts_tablet_manager.cc:1428] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 06:17:01.339785 11362 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:01.340304 12363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:17:01.339561 12272 raft_consensus.cc:482] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.342703 12363 hybrid_clock.cc:648] HybridClock initialized: now 1786429021341788 us; error 68 us; skew 500 ppm
I20260811 06:17:01.343452 12363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260811 06:17:01.323752 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3de77019fc074a55ab741db336a9fc60 consensus state has no leader
I20260811 06:17:01.344923 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:01.345168 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.345355 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:01.345844 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:01.341244 12272 raft_consensus.cc:504] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.347489 12272 leader_election.cc:288] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.348199 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.349287 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 5e990aa374204f2b95c08b04121176bc
I20260811 06:17:01.350193 11670 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 31) took 1720 ms. Trace:
W20260811 06:17:01.350371 10813 leader_election.cc:341] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.350623 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:01.351014 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:01.350360 11670 rpcz_store.cc:276] 0811 06:16:59.629238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.142778 (+513540us) service_pool.cc:227] Handling call
0811 06:17:00.160066 (+ 17288us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:00.160562 (+ 496us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:00.160690 (+ 128us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:00.160754 (+ 64us) catalog_manager.cc:2761] Locking tablets
0811 06:17:00.209810 (+ 49056us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:00.222293 (+ 12483us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:00.222395 (+ 102us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:01.349094 (+1126699us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:01.350126 (+ 1032us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.210598 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.210699 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.210705 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:00.210707 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:00.210864 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.210874 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.210879 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:00.210998 (+ 119us) tablet.cc:699] Row locks acquired
0811 06:17:00.211000 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:00.211036 (+ 36us) write_op.cc:270] Start()
0811 06:17:00.211070 (+ 34us) write_op.cc:276] Timestamp: P: 1786429020211018 usec, L: 0
0811 06:17:00.211074 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.211231 (+ 157us) log.cc:842] Serialized 728 byte log entry
0811 06:17:00.220919 (+ 9688us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.221103 (+ 184us) write_op.cc:301] APPLY: starting
0811 06:17:00.221118 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.221164 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.221229 (+ 65us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.221384 (+ 155us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.221426 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:00.221432 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:00.221551 (+ 119us) log.cc:842] Serialized 29 byte log entry
0811 06:17:00.221644 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.221664 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:00.221670 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.222466 (+ 796us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.222471 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":38979328,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":748,"apply.run_wall_time_us":1423,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":747,"prepare.run_wall_time_us":747,"raft.queue_time_us":535,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":9821}]]}
I20260811 06:17:01.351162 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:01.360198 12272 raft_consensus.cc:482] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.360556 12272 raft_consensus.cc:504] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.361181 11365 raft_consensus.cc:348] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.362211 12272 leader_election.cc:288] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.362322 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:01.363191 10813 leader_election.cc:341] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.364497 11362 tablet_bootstrap.cc:654] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.368223 11365 raft_consensus.cc:374] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.368162 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.368379 11365 raft_consensus.cc:729] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.369859 10662 raft_consensus.cc:2454] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:01.371636 11365 consensus_queue.cc:260] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.374027 11365 ts_tablet_manager.cc:1428] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.040s user 0.000s sys 0.003s
I20260811 06:17:01.377005 12483 raft_consensus.cc:482] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.377286 12483 raft_consensus.cc:504] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.378120 12483 leader_election.cc:288] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.382604 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:01.382776 10555 leader_election.cc:341] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.383411 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c706bf0455341a0a953d937f9778b5f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.387933 12484 raft_consensus.cc:482] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.388132 12484 raft_consensus.cc:504] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.388835 12484 leader_election.cc:288] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:01.390573 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.399817 12484 raft_consensus.cc:482] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.400134 12484 raft_consensus.cc:504] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.400861 12484 leader_election.cc:288] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.402077 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.405932 10555 leader_election.cc:302] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.406484 12642 raft_consensus.cc:2726] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.407058 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.407311 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.407436 10662 raft_consensus.cc:2454] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:01.407982 10810 leader_election.cc:302] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.408190 10658 raft_consensus.cc:2379] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:01.408716 12251 raft_consensus.cc:482] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.410406 11046 leader_election.cc:302] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.411100 12094 raft_consensus.cc:3037] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.411403 11361 tablet_bootstrap.cc:492] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.411592 11361 ts_tablet_manager.cc:1397] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.085s user 0.009s sys 0.006s
I20260811 06:17:01.411700 12363 webserver.cc:460] Webserver started at http://127.9.203.124:39467/ using document root <none> and password file <none>
I20260811 06:17:01.411800 10810 leader_election.cc:302] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.413096 12363 fs_manager.cc:359] Metadata directory not provided
I20260811 06:17:01.413606 10664 raft_consensus.cc:2454] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:01.413609 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:01.414002 12363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:17:01.414695 12579 raft_consensus.cc:2781] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.414894 12579 raft_consensus.cc:482] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.415225 12579 raft_consensus.cc:3037] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.415633 12272 raft_consensus.cc:2781] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.415872 12272 raft_consensus.cc:482] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.416121 12272 raft_consensus.cc:3037] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.416152 11365 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.408951 12251 raft_consensus.cc:504] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.416307 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c42b5ef0fc84627908200331f53b1a3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:01.417690 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:01.418183 11361 raft_consensus.cc:348] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.418545 11361 raft_consensus.cc:374] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.418792 11361 raft_consensus.cc:729] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.419505 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.419888 11046 leader_election.cc:302] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.420341 12484 raft_consensus.cc:2726] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.420403 12251 leader_election.cc:288] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.420658 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ac8c5daeb3249e38d863ee94f1267b1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.421250 12094 raft_consensus.cc:2726] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:01.421802 10564 leader_election.cc:341] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.423007 12272 raft_consensus.cc:504] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.423345 11046 leader_election.cc:302] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.424079 12094 raft_consensus.cc:2726] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.426779 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.427834 10810 leader_election.cc:302] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.428514 12578 raft_consensus.cc:2781] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.428717 12578 raft_consensus.cc:482] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.428821 12272 leader_election.cc:288] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.428990 12578 raft_consensus.cc:3037] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.429088 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:01.426964 12579 raft_consensus.cc:504] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.427654 11361 consensus_queue.cc:260] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.429603 11157 raft_consensus.cc:3037] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.430948 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:01.431234 11153 raft_consensus.cc:3037] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.434132 12578 raft_consensus.cc:504] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.435081 11153 raft_consensus.cc:2454] T 8b8b12e80bc54e58a63d45bde8faac89 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.435310 12579 leader_election.cc:288] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.435959 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:01.437775 12578 leader_election.cc:288] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.439595 11157 raft_consensus.cc:2454] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.439919 10813 leader_election.cc:302] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:17:01.440375 10813 leader_election.cc:341] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:01.444510 10555 leader_election.cc:341] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.447929 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b8b12e80bc54e58a63d45bde8faac89" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.448184 10661 raft_consensus.cc:3037] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.448474 11361 ts_tablet_manager.cc:1428] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.037s user 0.004s sys 0.000s
I20260811 06:17:01.452010 11361 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.452304 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.452960 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6063a34ee55495584ed5623215a130f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.453018 10664 raft_consensus.cc:3037] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.453200 10658 raft_consensus.cc:3037] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.452745 10555 leader_election.cc:302] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.456449 12251 raft_consensus.cc:2726] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.456902 12363 fs_manager.cc:709] Time spent opening directory manager: real 0.034s user 0.023s sys 0.007s
I20260811 06:17:01.459658 11361 tablet_bootstrap.cc:654] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:01.462018 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:01.462568 12251 raft_consensus.cc:482] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.462756 12251 raft_consensus.cc:504] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.464131 12094 raft_consensus.cc:482] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.464427 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.464761 12094 raft_consensus.cc:504] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.465292 12251 leader_election.cc:288] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:01.465469 10564 leader_election.cc:341] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.465648 12094 leader_election.cc:288] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.467384 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.467971 10659 raft_consensus.cc:2379] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:01.469273 10661 raft_consensus.cc:2454] T 8b8b12e80bc54e58a63d45bde8faac89 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.469959 10664 raft_consensus.cc:2454] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.470896 10658 raft_consensus.cc:2454] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.471060 12736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:17:01.473436 12363 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.003s sys 0.004s
I20260811 06:17:01.473694 12363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
uuid: "29fb239be50c4171bdbc75e064555197"
format_stamp: "Formatted at 2026-08-11 06:16:43 on dist-test-slave-cvwc"
I20260811 06:17:01.477047 12363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:17:01.481290 11365 tablet_bootstrap.cc:654] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.484812 11361 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.485040 11361 ts_tablet_manager.cc:1397] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.007s
I20260811 06:17:01.486150 11361 raft_consensus.cc:348] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.486541 11361 raft_consensus.cc:374] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.486717 11361 raft_consensus.cc:729] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.487214 11361 consensus_queue.cc:260] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.490688 11361 ts_tablet_manager.cc:1428] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:17:01.491312 11361 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.497141 11361 tablet_bootstrap.cc:654] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.507146 11094 tablet_service.cc:1467] Processing CreateTablet for tablet fa4734a689aa4eeca4c0bbbab7efd1d0 (DEFAULT_TABLE table=default.Table_aceab0ee137e421f840dc7340e6cb91b [id=a12a0c83c0154833a27163973b825bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.507640 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4734a689aa4eeca4c0bbbab7efd1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.515838 11361 tablet_bootstrap.cc:492] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.516045 11361 ts_tablet_manager.cc:1397] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.007s
I20260811 06:17:01.520380 11361 raft_consensus.cc:348] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.520807 11361 raft_consensus.cc:374] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.521235 11361 raft_consensus.cc:729] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.521615 11361 consensus_queue.cc:260] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.522572 11361 ts_tablet_manager.cc:1428] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:17:01.523093 11361 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.527647 11361 tablet_bootstrap.cc:654] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.546693 11361 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.547079 11361 ts_tablet_manager.cc:1397] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.003s
I20260811 06:17:01.548055 11361 raft_consensus.cc:348] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.548365 11361 raft_consensus.cc:374] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.548462 11361 raft_consensus.cc:729] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.548826 11361 consensus_queue.cc:260] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.549647 11361 ts_tablet_manager.cc:1428] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:01.550122 11361 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.553174 11361 tablet_bootstrap.cc:654] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.553503 10634 tablet_service.cc:1467] Processing CreateTablet for tablet fa4734a689aa4eeca4c0bbbab7efd1d0 (DEFAULT_TABLE table=default.Table_aceab0ee137e421f840dc7340e6cb91b [id=a12a0c83c0154833a27163973b825bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.554165 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4734a689aa4eeca4c0bbbab7efd1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.565748 12578 raft_consensus.cc:2781] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.568146 12363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:17:01.568735 10855 tablet_service.cc:1467] Processing CreateTablet for tablet fa4734a689aa4eeca4c0bbbab7efd1d0 (DEFAULT_TABLE table=default.Table_aceab0ee137e421f840dc7340e6cb91b [id=a12a0c83c0154833a27163973b825bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.569526 12578 raft_consensus.cc:686] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.568662 10813 leader_election.cc:302] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:01.570308 10810 leader_election.cc:302] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.571561 12579 raft_consensus.cc:2781] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.572464 12059 raft_consensus.cc:2781] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.572732 12059 raft_consensus.cc:686] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
W20260811 06:17:01.573385 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 129575us
I20260811 06:17:01.574462 11362 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:01.575043 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8123e24a8bbf4bd6a9344a83ca2163fc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.576716 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa4734a689aa4eeca4c0bbbab7efd1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.578069 11047 leader_election.cc:302] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:01.578886 12483 raft_consensus.cc:3037] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.580029 12363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:17:01.580072 11365 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.580755 12363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:17:01.581892 11365 ts_tablet_manager.cc:1397] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.208s user 0.000s sys 0.008s
I20260811 06:17:01.583240 12483 raft_consensus.cc:2726] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.583328 11365 raft_consensus.cc:348] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.584946 11365 raft_consensus.cc:374] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.586776 11365 raft_consensus.cc:729] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.587222 11365 consensus_queue.cc:260] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.589897 11365 ts_tablet_manager.cc:1428] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260811 06:17:01.592479 11157 raft_consensus.cc:3037] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.589151 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:01.593168 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:01.593741 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:01.594192 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:01.594528 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:01.595028 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:01.595326 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:01.595738 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:01.596310 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:01.596606 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_ebcbe00e3a0340d2a2911d4a5c73c393 [id=1e600dca3e674ce18101f1005808f016]). Expected version 1 got 0
I20260811 06:17:01.596825 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:01.597036 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:01.597220 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:01.597477 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:01.597798 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:01.598354 11365 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.607610 11365 tablet_bootstrap.cc:654] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.610251 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:01.610842 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:01.611346 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:01.611716 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:01.612115 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:01.612531 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:01.613785 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:01.614674 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:01.617081 12483 raft_consensus.cc:482] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.617890 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:01.618400 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:01.617648 12483 raft_consensus.cc:504] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.619978 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:01.620379 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:01.621703 11365 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.621804 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.622032 11365 ts_tablet_manager.cc:1397] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.007s
I20260811 06:17:01.622089 10658 raft_consensus.cc:2454] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:01.622728 11046 leader_election.cc:302] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:01.622953 11365 raft_consensus.cc:348] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.623239 12094 raft_consensus.cc:2781] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.623359 11365 raft_consensus.cc:374] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.623435 12094 raft_consensus.cc:482] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.623536 11365 raft_consensus.cc:729] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.623688 12094 raft_consensus.cc:3037] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.623941 11365 consensus_queue.cc:260] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.624818 11365 ts_tablet_manager.cc:1428] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:01.625422 11365 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:01.628154 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:01.628630 11365 tablet_bootstrap.cc:654] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.629324 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:01.630815 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:01.631134 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:01.631484 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:01.632208 12251 raft_consensus.cc:482] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.632447 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:01.632884 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:01.633292 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:01.633814 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:01.633998 12094 raft_consensus.cc:504] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.634256 12251 raft_consensus.cc:504] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.576452 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 100412us
I20260811 06:17:01.635115 12251 leader_election.cc:288] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.635797 12579 raft_consensus.cc:686] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.636214 12579 consensus_queue.cc:237] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.637604 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_28705c2c84984e3cb45b2c26538fb2fb [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 2 got 0
I20260811 06:17:01.638754 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:01.639442 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:01.640324 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:01.640725 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:01.641150 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:01.641494 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:01.641996 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:01.642589 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:01.643069 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:01.643446 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
W20260811 06:17:01.644243 11656 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cec2c3e143a4834a07aef7a31340d9c consensus state has no leader
I20260811 06:17:01.644586 11656 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 21) took 2019 ms. Trace:
I20260811 06:17:01.645533 12484 raft_consensus.cc:482] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.644760 11656 rpcz_store.cc:276] 0811 06:16:59.625454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:59.625530 (+ 76us) service_pool.cc:227] Handling call
0811 06:16:59.711639 (+ 86109us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:16:59.719773 (+ 8134us) catalog_manager.cc:3616] Apply alter schema
0811 06:16:59.731961 (+ 12188us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:16:59.734547 (+ 2586us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:00.107278 (+372731us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:01.644425 (+1537147us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:59.813933 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:16:59.814054 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:16:59.814062 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:16:59.814065 (+ 3us) tablet.cc:660] Decoding operations
0811 06:16:59.814171 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:16:59.814182 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:16:59.814187 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:16:59.814256 (+ 69us) tablet.cc:699] Row locks acquired
0811 06:16:59.814259 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:16:59.814298 (+ 39us) write_op.cc:270] Start()
0811 06:16:59.814334 (+ 36us) write_op.cc:276] Timestamp: P: 1786429019814253 usec, L: 0
0811 06:16:59.814338 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:16:59.814535 (+ 197us) log.cc:842] Serialized 405 byte log entry
0811 06:17:00.106590 (+292055us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.106694 (+ 104us) write_op.cc:301] APPLY: starting
0811 06:17:00.106714 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.106762 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.106801 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.106867 (+ 66us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.106903 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:00.106910 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.107009 (+ 99us) log.cc:842] Serialized 23 byte log entry
0811 06:17:00.107073 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.107094 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:00.107102 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.107155 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.107159 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":44,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":515,"num_ops":1,"prepare.queue_time_us":74334,"prepare.run_cpu_time_us":811,"prepare.run_wall_time_us":7414,"raft.queue_time_us":190,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":292219}]]}
I20260811 06:17:01.650992 12484 raft_consensus.cc:504] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.658104 12059 consensus_queue.cc:237] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.635407 12578 consensus_queue.cc:237] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.660677 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:01.661474 11653 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 32) took 2031 ms. Trace:
I20260811 06:17:01.662238 12484 leader_election.cc:288] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.663092 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.662360 11653 rpcz_store.cc:276] 0811 06:16:59.629491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.163906 (+534415us) service_pool.cc:227] Handling call
0811 06:17:00.164564 (+ 658us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:00.164721 (+ 157us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:00.164785 (+ 64us) catalog_manager.cc:2761] Locking tablets
0811 06:17:00.209922 (+ 45137us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:00.222666 (+ 12744us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:00.222734 (+ 68us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:01.660487 (+1437753us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:01.661338 (+ 851us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.211356 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.211472 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.211476 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:00.211479 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:00.211574 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.211582 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.211586 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:00.211681 (+ 95us) tablet.cc:699] Row locks acquired
0811 06:17:00.211684 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:00.211711 (+ 27us) write_op.cc:270] Start()
0811 06:17:00.211744 (+ 33us) write_op.cc:276] Timestamp: P: 1786429020211695 usec, L: 0
0811 06:17:00.211748 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.211897 (+ 149us) log.cc:842] Serialized 728 byte log entry
0811 06:17:00.220983 (+ 9086us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.221789 (+ 806us) write_op.cc:301] APPLY: starting
0811 06:17:00.221803 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.221846 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.221879 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.221938 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.221965 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:00.221970 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:00.222030 (+ 60us) log.cc:842] Serialized 29 byte log entry
0811 06:17:00.222070 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.222085 (+ 15us) write_op.cc:454] Released schema lock
0811 06:17:00.222091 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.222572 (+ 481us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.222576 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":761,"apply.run_cpu_time_us":461,"apply.run_wall_time_us":828,"num_ops":2,"prepare.queue_time_us":575,"prepare.run_cpu_time_us":669,"prepare.run_wall_time_us":669,"raft.queue_time_us":138,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":9222,"spinlock_wait_cycles":1041664}]]}
I20260811 06:17:01.664996 12094 leader_election.cc:288] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.666078 12483 leader_election.cc:288] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.669940 12272 consensus_queue.cc:1035] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260811 06:17:01.671134 11362 ts_tablet_manager.cc:1397] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.235s user 0.040s sys 0.061s
I20260811 06:17:01.672399 11362 raft_consensus.cc:348] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.673221 11362 raft_consensus.cc:374] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.673430 11362 raft_consensus.cc:729] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.673700 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.674494 11362 consensus_queue.cc:260] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.675330 11362 ts_tablet_manager.cc:1428] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:17:01.676085 11362 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:01.676687 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:01.677667 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:01.689165 11362 tablet_bootstrap.cc:654] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.697961 12251 raft_consensus.cc:482] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.698262 12251 raft_consensus.cc:504] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.699115 12251 leader_election.cc:288] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.702169 12774 raft_consensus.cc:482] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.702495 11094 tablet_service.cc:1467] Processing CreateTablet for tablet f2362a85273a460da7d7cd30a20f220c (DEFAULT_TABLE table=default.Table_dac288843c414db3bbdf0877d0c4f6d3 [id=88a2b19d8d9e426a9609ad2be500998d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.702510 12774 raft_consensus.cc:504] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.703121 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2362a85273a460da7d7cd30a20f220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.703573 12774 leader_election.cc:288] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:01.707264 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cae52ba275f4d2fbd7014a1c6c01dc0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:01.708134 10564 leader_election.cc:341] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.709326 10632 tablet_service.cc:1467] Processing CreateTablet for tablet f2362a85273a460da7d7cd30a20f220c (DEFAULT_TABLE table=default.Table_dac288843c414db3bbdf0877d0c4f6d3 [id=88a2b19d8d9e426a9609ad2be500998d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.709805 10610 tablet_service.cc:1467] Processing CreateTablet for tablet b75a143de45040eba72de483363504de (DEFAULT_TABLE table=default.Table_b5d5d6495d27470c8dbd0a542a792a7c [id=f0442450d21e4cf0863e54d81a797693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.710199 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:01.710592 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.711491 10658 raft_consensus.cc:3037] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.713565 11094 tablet_service.cc:1467] Processing CreateTablet for tablet b75a143de45040eba72de483363504de (DEFAULT_TABLE table=default.Table_b5d5d6495d27470c8dbd0a542a792a7c [id=f0442450d21e4cf0863e54d81a797693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.714326 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b75a143de45040eba72de483363504de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.716969 10658 raft_consensus.cc:2454] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:01.713380 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.717846 10661 raft_consensus.cc:2379] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
W20260811 06:17:01.718835 10564 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.719705 11046 leader_election.cc:302] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:01.720191 12774 raft_consensus.cc:2781] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.721091 12774 raft_consensus.cc:686] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
W20260811 06:17:01.721341 11046 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:17:01.722434 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2362a85273a460da7d7cd30a20f220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.722288 12774 consensus_queue.cc:237] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.726532 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b75a143de45040eba72de483363504de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.728590 12765 consensus_queue.cc:1035] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260811 06:17:01.734437 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:01.741377 12762 raft_consensus.cc:482] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.741706 12762 raft_consensus.cc:504] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.742949 12762 leader_election.cc:288] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.743937 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.744359 10661 raft_consensus.cc:2379] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:01.747673 11102 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.747965 10634 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.748337 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5bf05ee95b244b88b943cc1d37f8839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.748481 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5bf05ee95b244b88b943cc1d37f8839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.753618 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:01.754168 10871 tablet_service.cc:1467] Processing CreateTablet for tablet f2362a85273a460da7d7cd30a20f220c (DEFAULT_TABLE table=default.Table_dac288843c414db3bbdf0877d0c4f6d3 [id=88a2b19d8d9e426a9609ad2be500998d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.754403 10858 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.754596 10879 tablet_service.cc:1467] Processing CreateTablet for tablet b75a143de45040eba72de483363504de (DEFAULT_TABLE table=default.Table_b5d5d6495d27470c8dbd0a542a792a7c [id=f0442450d21e4cf0863e54d81a797693]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.754753 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2362a85273a460da7d7cd30a20f220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.755038 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b75a143de45040eba72de483363504de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.755393 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5bf05ee95b244b88b943cc1d37f8839. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.757913 12765 raft_consensus.cc:482] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.758396 12765 raft_consensus.cc:504] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.758687 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:01.759590 12765 leader_election.cc:288] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.760824 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.761875 11117 tablet_service.cc:1467] Processing CreateTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.762533 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5195c4d7b09d45b8873575e1f67a5cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.763919 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:01.769528 12774 raft_consensus.cc:482] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.769909 12774 raft_consensus.cc:504] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.771102 12774 leader_election.cc:288] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.771230 10661 raft_consensus.cc:2454] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:01.771942 10555 leader_election.cc:341] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.772239 10555 leader_election.cc:302] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.772390 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d (DEFAULT_TABLE table=default.Table_f4f8f5c098d5406a8529fc0efccae4f3 [id=bd140afd689d4b958c3b0c5c228e95ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.772781 12251 raft_consensus.cc:2726] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.772972 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8456bc7fbd461c85ed2f5e7b42193d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.772886 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.773397 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5195c4d7b09d45b8873575e1f67a5cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.775367 11127 tablet_service.cc:1467] Processing CreateTablet for tablet 23ca4a89d00242ea98c5b964df27082f (DEFAULT_TABLE table=default.Table_feebdfd01f0f465fb0b3022ca1daf517 [id=776130ee53724d72ba83b985a42f9b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.780821 11127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ca4a89d00242ea98c5b964df27082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.781756 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 23ca4a89d00242ea98c5b964df27082f (DEFAULT_TABLE table=default.Table_feebdfd01f0f465fb0b3022ca1daf517 [id=776130ee53724d72ba83b985a42f9b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.782346 11096 tablet_service.cc:1467] Processing CreateTablet for tablet b79f635593b04cd59d43d54f702a8cc6 (DEFAULT_TABLE table=default.Table_3991f735c6434abc80dec8d381869762 [id=bbb819f2df55473490488e72eddb505c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.782732 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ca4a89d00242ea98c5b964df27082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.782701 10810 leader_election.cc:302] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:01.782802 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79f635593b04cd59d43d54f702a8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.784050 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 30cffba93ad74e84812e5879b851119f (DEFAULT_TABLE table=default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.784960 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cffba93ad74e84812e5879b851119f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.784922 12059 raft_consensus.cc:2781] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.785189 12059 raft_consensus.cc:482] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.785396 12059 raft_consensus.cc:3037] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.785632 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 30cffba93ad74e84812e5879b851119f (DEFAULT_TABLE table=default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.786208 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cffba93ad74e84812e5879b851119f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.787137 11102 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d (DEFAULT_TABLE table=default.Table_f4f8f5c098d5406a8529fc0efccae4f3 [id=bd140afd689d4b958c3b0c5c228e95ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.787212 10629 tablet_service.cc:1467] Processing CreateTablet for tablet b79f635593b04cd59d43d54f702a8cc6 (DEFAULT_TABLE table=default.Table_3991f735c6434abc80dec8d381869762 [id=bbb819f2df55473490488e72eddb505c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.787910 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79f635593b04cd59d43d54f702a8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.794175 12773 consensus_queue.cc:1035] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:17:01.794580 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.801829 12762 raft_consensus.cc:482] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.802161 12762 raft_consensus.cc:504] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.802980 12762 leader_election.cc:288] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.803892 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.804364 10664 raft_consensus.cc:2454] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:01.805070 10810 leader_election.cc:302] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:01.809230 12773 raft_consensus.cc:2781] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:01.809551 12773 raft_consensus.cc:482] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:01.809890 12773 raft_consensus.cc:3037] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.813577 11102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8456bc7fbd461c85ed2f5e7b42193d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.823565 11365 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:01.823542 12059 raft_consensus.cc:504] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.823822 11365 ts_tablet_manager.cc:1397] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.199s user 0.009s sys 0.004s
I20260811 06:17:01.825285 11365 raft_consensus.cc:348] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.825554 11365 raft_consensus.cc:374] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.826036 11679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:01.826632 11679 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 30) took 2197 ms. Trace:
I20260811 06:17:01.826949 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.827307 10664 raft_consensus.cc:3037] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.826771 11679 rpcz_store.cc:276] 0811 06:16:59.629002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.115258 (+486256us) service_pool.cc:227] Handling call
0811 06:17:00.115997 (+ 739us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:00.116260 (+ 263us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:00.116354 (+ 94us) catalog_manager.cc:2761] Locking tablets
0811 06:17:00.116516 (+ 162us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:00.143697 (+ 27181us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:00.143808 (+ 111us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:01.825958 (+1682150us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:01.826533 (+ 575us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.119970 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.120066 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.120071 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:00.120073 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:00.120199 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.120210 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.120214 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:00.120317 (+ 103us) tablet.cc:699] Row locks acquired
0811 06:17:00.120319 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:00.120354 (+ 35us) write_op.cc:270] Start()
0811 06:17:00.120394 (+ 40us) write_op.cc:276] Timestamp: P: 1786429020120344 usec, L: 0
0811 06:17:00.120398 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.120565 (+ 167us) log.cc:842] Serialized 759 byte log entry
0811 06:17:00.141262 (+ 20697us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.141324 (+ 62us) write_op.cc:301] APPLY: starting
0811 06:17:00.141346 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.141400 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.141449 (+ 49us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.141526 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.141563 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:00.141570 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.141660 (+ 90us) log.cc:842] Serialized 29 byte log entry
0811 06:17:00.141752 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.141775 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:00.141782 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.141839 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.141843 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":24,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":578,"num_ops":2,"prepare.queue_time_us":2656,"prepare.run_cpu_time_us":676,"prepare.run_wall_time_us":676,"raft.queue_time_us":1132,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":20846}]]}
I20260811 06:17:01.828087 11679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_221001ee9f7d4adbaeed611c4a678bcf" } modify_external_catalogs: true
I20260811 06:17:01.828433 11679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_221001ee9f7d4adbaeed611c4a678bcf" } modify_external_catalogs: true
W20260811 06:17:01.830169 11663 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1276a6c043948529b7537081e34b257 consensus state has no leader
I20260811 06:17:01.830489 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_d7b23f45b7b14c719f98c5b359db7502 [id=8444a45079b34969a38481a4b00c1352] alter complete (version 6)
I20260811 06:17:01.830649 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 5ca903ee846a4e5baf3dbb4302607c1f
I20260811 06:17:01.831308 11684 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 33) took 2201 ms. Trace:
I20260811 06:17:01.832149 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:01.832168 10664 raft_consensus.cc:2454] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.831496 11684 rpcz_store.cc:276] 0811 06:16:59.629659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.215203 (+585544us) service_pool.cc:227] Handling call
0811 06:17:00.215741 (+ 538us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:00.215890 (+ 149us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:00.215972 (+ 82us) catalog_manager.cc:2761] Locking tablets
0811 06:17:00.216099 (+ 127us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:00.224236 (+ 8137us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:00.224317 (+ 81us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:01.830508 (+1606191us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:01.831083 (+ 575us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.219181 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.219319 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.219325 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:00.219328 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:00.219454 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.219466 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.219472 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:00.219575 (+ 103us) tablet.cc:699] Row locks acquired
0811 06:17:00.219578 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:00.219618 (+ 40us) write_op.cc:270] Start()
0811 06:17:00.219651 (+ 33us) write_op.cc:276] Timestamp: P: 1786429020219597 usec, L: 0
0811 06:17:00.219656 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.219876 (+ 220us) log.cc:842] Serialized 728 byte log entry
0811 06:17:00.223445 (+ 3569us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.223568 (+ 123us) write_op.cc:301] APPLY: starting
0811 06:17:00.223580 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.223612 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.223634 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.223696 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.223722 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:00.223728 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:00.223811 (+ 83us) log.cc:842] Serialized 29 byte log entry
0811 06:17:00.223871 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.223888 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:00.223894 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.223947 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.223950 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":431,"apply.run_wall_time_us":429,"num_ops":2,"prepare.queue_time_us":2446,"prepare.run_cpu_time_us":817,"prepare.run_wall_time_us":818,"raft.queue_time_us":46,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":12,"replication_time_us":3753}]]}
I20260811 06:17:01.832855 10810 leader_election.cc:302] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:01.833268 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_8691c9b01d514e36803289085cb4c93d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:01.833496 12762 raft_consensus.cc:2781] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.833902 12762 raft_consensus.cc:686] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.834307 12762 consensus_queue.cc:237] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.834611 12251 raft_consensus.cc:482] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.834874 12251 raft_consensus.cc:504] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.835968 12251 leader_election.cc:288] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.836714 12774 raft_consensus.cc:482] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:01.837399 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52ecffcf4a0e46428caed6f7d72199bd already in progress: creating tablet
I20260811 06:17:01.837462 12774 raft_consensus.cc:504] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.838526 12774 leader_election.cc:288] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
W20260811 06:17:01.838703 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8691c9b01d514e36803289085cb4c93d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:01.838581 12773 raft_consensus.cc:504] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:01.839316 11683 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8123e24a8bbf4bd6a9344a83ca2163fc consensus state has no leader
I20260811 06:17:01.839775 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:01.840320 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.840364 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:01.840648 10664 raft_consensus.cc:3037] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:01.841077 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca903ee846a4e5baf3dbb4302607c1f already in progress: creating tablet
I20260811 06:17:01.842211 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:01.844957 10564 leader_election.cc:341] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.848390 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:01.853747 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:01.856449 10664 raft_consensus.cc:2454] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:01.857064 10810 leader_election.cc:302] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:01.857131 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:01.857589 12765 raft_consensus.cc:2781] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:01.857821 12726 tablet_replica.cc:330] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:01.857995 12765 raft_consensus.cc:686] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:01.858161 12726 raft_consensus.cc:2229] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:01.858516 12726 raft_consensus.cc:2258] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:01.858507 12765 consensus_queue.cc:237] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.859143 12726 ts_tablet_manager.cc:1905] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:01.864909 12059 leader_election.cc:288] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.867596 11361 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.867921 11361 ts_tablet_manager.cc:1397] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.318s user 0.054s sys 0.092s
I20260811 06:17:01.869462 11361 raft_consensus.cc:348] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.869915 11361 raft_consensus.cc:374] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.870110 11361 raft_consensus.cc:729] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.870513 11361 consensus_queue.cc:260] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.871528 11361 ts_tablet_manager.cc:1428] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 06:17:01.871917 11361 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.875988 11361 tablet_bootstrap.cc:654] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:01.876322 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca903ee846a4e5baf3dbb4302607c1f already in progress: creating tablet
I20260811 06:17:01.877818 12773 leader_election.cc:288] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:01.878106 11153 raft_consensus.cc:3037] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.888463 11361 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:01.888742 11361 ts_tablet_manager.cc:1397] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.007s
I20260811 06:17:01.890077 11361 raft_consensus.cc:348] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.890409 11361 raft_consensus.cc:374] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:01.890517 11361 raft_consensus.cc:729] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:01.893648 11361 consensus_queue.cc:260] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.895306 11361 ts_tablet_manager.cc:1428] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:01.895787 11361 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:01.899811 12774 raft_consensus.cc:482] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.900008 12774 raft_consensus.cc:504] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:01.900844 12774 leader_election.cc:288] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:01.905407 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:01.906057 10664 raft_consensus.cc:2379] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:01.906965 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.908619 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:01.908931 11156 raft_consensus.cc:2454] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:01.909729 11361 tablet_bootstrap.cc:654] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:01.918500 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.918588 10860 tablet_service.cc:1467] Processing CreateTablet for tablet b79f635593b04cd59d43d54f702a8cc6 (DEFAULT_TABLE table=default.Table_3991f735c6434abc80dec8d381869762 [id=bbb819f2df55473490488e72eddb505c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.932331 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79f635593b04cd59d43d54f702a8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.932426 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cae52ba275f4d2fbd7014a1c6c01dc0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.933094 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (DEFAULT_TABLE table=default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.935015 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5195c4d7b09d45b8873575e1f67a5cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.938122 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 30cffba93ad74e84812e5879b851119f (DEFAULT_TABLE table=default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.938755 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cffba93ad74e84812e5879b851119f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.942408 11663 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 28) took 2313 ms. Trace:
I20260811 06:17:01.942756 11663 rpcz_store.cc:276] 0811 06:16:59.628677 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.110014 (+481337us) service_pool.cc:227] Handling call
0811 06:17:00.113938 (+ 3924us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:00.114248 (+ 310us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:00.114429 (+ 181us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:00.114644 (+ 215us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:00.114728 (+ 84us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:00.150010 (+ 35282us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:01.942263 (+1792253us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.119149 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.119286 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.119292 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:00.119295 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:00.119402 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.119418 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.119423 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:00.119500 (+ 77us) tablet.cc:699] Row locks acquired
0811 06:17:00.119503 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:00.119544 (+ 41us) write_op.cc:270] Start()
0811 06:17:00.119586 (+ 42us) write_op.cc:276] Timestamp: P: 1786429020119533 usec, L: 0
0811 06:17:00.119590 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.119810 (+ 220us) log.cc:842] Serialized 405 byte log entry
0811 06:17:00.141169 (+ 21359us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.148703 (+ 7534us) write_op.cc:301] APPLY: starting
0811 06:17:00.148724 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.148781 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.148850 (+ 69us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.148922 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.148958 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:00.148965 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.149304 (+ 339us) log.cc:842] Serialized 23 byte log entry
0811 06:17:00.149882 (+ 578us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.149906 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:00.149914 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.150113 (+ 199us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.150117 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":8381696,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":823,"apply.run_wall_time_us":8887,"num_ops":1,"prepare.queue_time_us":3771,"prepare.run_cpu_time_us":791,"prepare.run_wall_time_us":792,"raft.queue_time_us":1774,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":8,"replication_time_us":21548}]]}
I20260811 06:17:01.945953 12765 consensus_queue.cc:1035] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260811 06:17:01.946507 12774 raft_consensus.cc:482] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:01.947949 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:01.948196 10922 raft_consensus.cc:3037] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.949946 11683 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 25) took 2321 ms. Trace:
I20260811 06:17:01.950131 11683 rpcz_store.cc:276] 0811 06:16:59.627976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:59.634893 (+ 6917us) service_pool.cc:227] Handling call
0811 06:16:59.709570 (+ 74677us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:16:59.717170 (+ 7600us) catalog_manager.cc:3616] Apply alter schema
0811 06:16:59.725880 (+ 8710us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:16:59.726134 (+ 254us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:00.073687 (+347553us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:01.949840 (+1876153us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:16:59.793245 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:16:59.800093 (+ 6848us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:16:59.800101 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:16:59.800104 (+ 3us) tablet.cc:660] Decoding operations
0811 06:16:59.804747 (+ 4643us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:16:59.804761 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:16:59.804767 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:16:59.804870 (+ 103us) tablet.cc:699] Row locks acquired
0811 06:16:59.804872 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:16:59.804923 (+ 51us) write_op.cc:270] Start()
0811 06:16:59.804967 (+ 44us) write_op.cc:276] Timestamp: P: 1786429019804877 usec, L: 0
0811 06:16:59.804971 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:16:59.805359 (+ 388us) log.cc:842] Serialized 405 byte log entry
0811 06:17:00.071917 (+266558us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.072229 (+ 312us) write_op.cc:301] APPLY: starting
0811 06:17:00.072251 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.072300 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.072338 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.072408 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.072461 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:00.072468 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.072563 (+ 95us) log.cc:842] Serialized 23 byte log entry
0811 06:17:00.072644 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.072667 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:00.072675 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.072743 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.072746 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":581,"apply.run_wall_time_us":581,"num_ops":1,"prepare.queue_time_us":65833,"prepare.run_cpu_time_us":1116,"prepare.run_wall_time_us":13643,"raft.queue_time_us":143,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":266914}]]}
I20260811 06:17:01.951188 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:01.950807 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d (DEFAULT_TABLE table=default.Table_f4f8f5c098d5406a8529fc0efccae4f3 [id=bd140afd689d4b958c3b0c5c228e95ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.952206 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_e631da66bfa04a7596d0d39becf5be95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:01.953444 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e631da66bfa04a7596d0d39becf5be95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:01.954321 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 23ca4a89d00242ea98c5b964df27082f (DEFAULT_TABLE table=default.Table_feebdfd01f0f465fb0b3022ca1daf517 [id=776130ee53724d72ba83b985a42f9b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:01.958308 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.961964 11155 raft_consensus.cc:3037] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:01.970067 11679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:01.972149 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:01.972402 10555 leader_election.cc:341] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.972690 10555 leader_election.cc:302] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.972857 11679 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 34) took 2343 ms. Trace:
I20260811 06:17:01.972159 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:01.973240 10555 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:01.973593 10555 leader_election.cc:302] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:01.973109 11679 rpcz_store.cc:276] 0811 06:16:59.629805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.827678 (+2197873us) service_pool.cc:227] Handling call
0811 06:17:01.828574 (+ 896us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:01.828773 (+ 199us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:01.828854 (+ 81us) catalog_manager.cc:2761] Locking tablets
0811 06:17:01.885877 (+ 57023us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:01.893553 (+ 7676us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:01.963719 (+ 70166us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:01.969798 (+ 6079us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:01.972792 (+ 2994us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:01.887015 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:01.887141 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:01.887149 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:01.887151 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:01.887279 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:01.887294 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:01.887300 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:01.887456 (+ 156us) tablet.cc:699] Row locks acquired
0811 06:17:01.887459 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:01.887504 (+ 45us) write_op.cc:270] Start()
0811 06:17:01.887544 (+ 40us) write_op.cc:276] Timestamp: P: 1786429021887462 usec, L: 0
0811 06:17:01.887548 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:01.887747 (+ 199us) log.cc:842] Serialized 728 byte log entry
0811 06:17:01.892529 (+ 4782us) op_driver.cc:444] REPLICATION: finished
0811 06:17:01.892670 (+ 141us) write_op.cc:301] APPLY: starting
0811 06:17:01.892690 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:01.892744 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:01.892783 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:01.892867 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:01.892907 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:01.892914 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:01.893006 (+ 92us) log.cc:842] Serialized 29 byte log entry
0811 06:17:01.893073 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:01.893098 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:01.893105 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:01.893161 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:01.893165 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":551,"apply.run_wall_time_us":550,"num_ops":2,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":855,"prepare.run_wall_time_us":856,"raft.queue_time_us":1108,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":371,"replication_time_us":4954}]]}
I20260811 06:17:01.974917 12251 raft_consensus.cc:2726] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:01.974926 11679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_cbef4a2446cd4a37bd3907ccd1ce6804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:01.975273 12251 raft_consensus.cc:2726] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:01.975903 11679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbef4a2446cd4a37bd3907ccd1ce6804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:01.958806 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5322caea49aa4b648b74c7692d6e0372" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.982962 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:01.983641 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "285b85c854bf400295b288314947840e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.985004 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea4eb7f5db2e4e75818bfb228b64ed0d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.985544 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23ca4a89d00242ea98c5b964df27082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:01.986199 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "006d3214480c47babe390496b335de70" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.987407 12579 consensus_queue.cc:1035] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260811 06:17:01.988834 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52953438e7c248b1a758ee219405d7da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:01.992148 10922 raft_consensus.cc:2454] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:01.997515 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a25b6d0d733c44398a233b595caad8a0 consensus state has no leader
W20260811 06:17:01.998184 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bc0ec3b040cd4a54a7919a15f8eb5da7 consensus state has no leader
W20260811 06:17:01.998548 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 10bb259b9721485db9c968763434f67e consensus state has no leader
W20260811 06:17:02.001147 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 61114d1bcdb94af7b6c55b0331accee5 consensus state has no leader
I20260811 06:17:02.002121 12251 raft_consensus.cc:482] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.002359 12251 raft_consensus.cc:504] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.003065 12251 leader_election.cc:288] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.003345 10813 leader_election.cc:302] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.003829 12579 raft_consensus.cc:2726] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.005437 12579 consensus_queue.cc:1035] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:17:01.825670 11365 raft_consensus.cc:729] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.017360 11365 consensus_queue.cc:260] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.019156 11365 ts_tablet_manager.cc:1428] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.195s user 0.003s sys 0.002s
W20260811 06:17:02.028398 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 754b5fec454d44608b62ddec7d58bfac consensus state has no leader
W20260811 06:17:02.028834 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7716cda181d444a99d69cbc9ade3269e consensus state has no leader
W20260811 06:17:02.029594 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d165ac025ce845c6b2b3621caaf01894 consensus state has no leader
W20260811 06:17:02.032536 11676 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 40c31ffb11484783bca9263c947f37da consensus state has no leader
W20260811 06:17:02.034157 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8bd026d2c6064a67b1c432efa4474a0e consensus state has no leader
I20260811 06:17:02.035053 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f8456bc7fbd461c85ed2f5e7b42193d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:02.035467 11588 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.124:45045, user_credentials={real_user=slave}} blocked reactor thread for 47534.5us
W20260811 06:17:02.037693 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 consensus state has no leader
W20260811 06:17:02.039058 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ce5f2fa8c64247419f2ca9b26df825b0 consensus state has no leader
W20260811 06:17:02.039635 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e00a72f178f74ca59cc073fe78c99373 consensus state has no leader
W20260811 06:17:02.040530 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 22feadfa433d46cc9f5dc052b3421e56 consensus state has no leader
W20260811 06:17:02.040947 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1a2e55d5e0244c299d837aed98f94aad consensus state has no leader
W20260811 06:17:02.041431 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b246b0e53af34c089f4fd67174396f44 consensus state has no leader
I20260811 06:17:02.043365 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d44dea35e94ed788b7e1e5a8a24d8e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:02.044420 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d6063a34ee55495584ed5623215a130f consensus state has no leader
W20260811 06:17:02.045358 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2fcf7c7a470144c0a084aebc2032d896 consensus state has no leader
W20260811 06:17:02.045673 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5322caea49aa4b648b74c7692d6e0372 consensus state has no leader
W20260811 06:17:02.047194 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f4ed851746ef4861a624940952796a37 consensus state has no leader
W20260811 06:17:02.049646 10564 leader_election.cc:341] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:02.049731 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 91f079882c3c46318f70190d5293868e consensus state has no leader
W20260811 06:17:02.058284 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 6d0f4cb9da96451ab351e1ad1aff7530 consensus state has no leader
W20260811 06:17:02.059085 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 370d971f8ef14131afc5b54dbdbaae98 consensus state has no leader
W20260811 06:17:02.061210 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5fb45a26ce7e4d8c8bf75940a6070752 consensus state has no leader
W20260811 06:17:02.061956 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 844e735c671440c5bfe1035068c7334e consensus state has no leader
W20260811 06:17:02.064087 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 75094a86738d42fca39d57f8d90e8af9 consensus state has no leader
W20260811 06:17:02.066061 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5797f3ba59924b41b92fbd089397218e consensus state has no leader
W20260811 06:17:02.069322 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a04766ede03342efb594aaf081e112af consensus state has no leader
I20260811 06:17:02.070433 11362 tablet_bootstrap.cc:492] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:02.070880 11362 ts_tablet_manager.cc:1397] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.395s user 0.018s sys 0.010s
I20260811 06:17:02.075037 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:02.075793 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet dd6584701c23406e83122bd2493b7972 consensus state has no leader
W20260811 06:17:02.077483 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 consensus state has no leader
W20260811 06:17:02.078327 11676 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 55b38127e97f400f879afc94c0672906 consensus state has no leader
W20260811 06:17:02.078958 11676 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cd53ac72e2e3450a9f777316742653bc consensus state has no leader
W20260811 06:17:02.079290 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 14a36a644dc4491dad838ce4e19793ab consensus state has no leader
W20260811 06:17:02.081296 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2fb02f61b67147f793b3a2f063d8c56c consensus state has no leader
W20260811 06:17:02.082593 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 10211a4e95464e9e9e2b2e70d23086a5 consensus state has no leader
I20260811 06:17:02.082634 11362 raft_consensus.cc:348] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.083122 11362 raft_consensus.cc:374] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.083375 11362 raft_consensus.cc:729] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.083817 11362 consensus_queue.cc:260] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.084142 12774 raft_consensus.cc:504] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.084880 11362 ts_tablet_manager.cc:1428] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.002s sys 0.002s
I20260811 06:17:02.085013 12774 leader_election.cc:288] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.085320 11362 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:02.086692 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 0874f0e73267446fb873f4619f93307e consensus state has no leader
W20260811 06:17:02.088248 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fdc323cf778548ae86f45f0fd8bd4a89 consensus state has no leader
W20260811 06:17:02.096391 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 17d90d3d23454c5bbeba1bb900b68c73 consensus state has no leader
I20260811 06:17:02.104434 11361 tablet_bootstrap.cc:492] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:17:02.104871 11047 leader_election.cc:341] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:17:02.105175 11047 leader_election.cc:302] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:02.105705 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 133118us
I20260811 06:17:02.105957 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.107944 11159 raft_consensus.cc:3037] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.108587 12774 raft_consensus.cc:2726] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.108878 12774 raft_consensus.cc:482] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.108917 11365 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:02.109182 12774 raft_consensus.cc:504] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.109515 12726 ts_tablet_manager.cc:1918] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:02.110113 12774 leader_election.cc:288] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
W20260811 06:17:02.110935 10813 leader_election.cc:341] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.111860 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.112275 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.112983 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52543aa31a1749d1a0fd5e48cbe30889" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.113736 12727 tablet_replica.cc:330] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.114092 12727 raft_consensus.cc:2229] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.114586 12727 raft_consensus.cc:2258] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.115061 11683 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 36) took 2484 ms. Trace:
W20260811 06:17:02.115774 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:02.116048 10922 raft_consensus.cc:2454] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.115466 11683 rpcz_store.cc:276] 0811 06:16:59.630283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.951696 (+2321413us) service_pool.cc:227] Handling call
0811 06:17:01.953629 (+ 1933us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:01.954646 (+ 1017us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.013519 (+ 58873us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.114729 (+101210us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.114875 (+ 146us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.000516 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.000662 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.000670 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:02.000673 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.000788 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.000804 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.000809 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.000905 (+ 96us) tablet.cc:699] Row locks acquired
0811 06:17:02.000908 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.000953 (+ 45us) write_op.cc:270] Start()
0811 06:17:02.000994 (+ 41us) write_op.cc:276] Timestamp: P: 1786429022000902 usec, L: 0
0811 06:17:02.000998 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.001269 (+ 271us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.005939 (+ 4670us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.006055 (+ 116us) write_op.cc:301] APPLY: starting
0811 06:17:02.006074 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.006124 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.006153 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.007658 (+ 1505us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.007701 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.007708 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:02.007791 (+ 83us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.007859 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.007880 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:02.007886 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.007941 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.007944 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":65,"apply.run_cpu_time_us":625,"apply.run_wall_time_us":1942,"num_ops":2,"prepare.queue_time_us":45261,"prepare.run_cpu_time_us":888,"prepare.run_wall_time_us":888,"raft.queue_time_us":625,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":236,"replication_time_us":4913}]]}
I20260811 06:17:02.116190 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7db813cbb8f74b329015b163ebd58c00" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:02.117028 11361 ts_tablet_manager.cc:1397] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.209s user 0.002s sys 0.007s
W20260811 06:17:02.118497 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52ecffcf4a0e46428caed6f7d72199bd already in progress: creating tablet
I20260811 06:17:02.118713 12251 raft_consensus.cc:482] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.119292 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 35) took 2489 ms. Trace:
I20260811 06:17:02.119529 12773 consensus_queue.cc:1035] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 06:17:02.119486 11684 rpcz_store.cc:276] 0811 06:16:59.630105 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.832638 (+2202533us) service_pool.cc:227] Handling call
0811 06:17:01.992636 (+159998us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:01.993243 (+ 607us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.016774 (+ 23531us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.118914 (+102140us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.119141 (+ 227us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.006385 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.006497 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.006503 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:02.006505 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:02.006594 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.006605 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.006610 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.006686 (+ 76us) tablet.cc:699] Row locks acquired
0811 06:17:02.006689 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.006720 (+ 31us) write_op.cc:270] Start()
0811 06:17:02.006750 (+ 30us) write_op.cc:276] Timestamp: P: 1786429022006671 usec, L: 0
0811 06:17:02.006754 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.006931 (+ 177us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.013299 (+ 6368us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.013394 (+ 95us) write_op.cc:301] APPLY: starting
0811 06:17:02.013408 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.013454 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.013974 (+ 520us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.014078 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.014111 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.014117 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.014195 (+ 78us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.014266 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.014285 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:02.014291 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.014344 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.014347 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":601,"apply.run_wall_time_us":1041,"mutex_wait_us":12530,"num_ops":2,"prepare.queue_time_us":12583,"prepare.run_cpu_time_us":611,"prepare.run_wall_time_us":610,"replication_time_us":6519}]]}
W20260811 06:17:02.120323 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca903ee846a4e5baf3dbb4302607c1f already in progress: creating tablet
I20260811 06:17:02.122560 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_9a7b04bde68640deb63e6bdbd0f322d9" } new_table_name: "default.Table_7baf5a935fc041a6818ad62931bb8665" modify_external_catalogs: true
I20260811 06:17:02.121414 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d0f4cb9da96451ab351e1ad1aff7530" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.125237 11155 raft_consensus.cc:3037] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.125805 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.131771 12727 ts_tablet_manager.cc:1905] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.133877 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.133962 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.134323 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.135097 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.138901 11155 raft_consensus.cc:2454] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:02.139175 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.142194 11362 tablet_bootstrap.cc:654] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.143642 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.144536 12762 raft_consensus.cc:482] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.145473 12762 raft_consensus.cc:504] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.146402 12762 leader_election.cc:288] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.147408 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.147802 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.148356 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.148732 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.149602 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.150692 12787 log.cc:924] Time spent T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.213s user 0.000s sys 0.000s
I20260811 06:17:02.150720 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.151741 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.152755 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.158706 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.161334 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.165127 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.165916 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.166725 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.166911 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.167714 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.167762 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.167923 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.168287 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.168892 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.169490 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.170591 12728 tablet_replica.cc:330] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:02.170885 12728 raft_consensus.cc:2229] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.171761 12728 raft_consensus.cc:2258] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.172312 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.172542 12728 ts_tablet_manager.cc:1905] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.172673 12727 ts_tablet_manager.cc:1918] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:02.173261 12727 log.cc:1196] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:02.174973 12726 log.cc:1196] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:02.175679 12251 raft_consensus.cc:504] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.175918 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.177162 12726 ts_tablet_manager.cc:1939] T 52ecffcf4a0e46428caed6f7d72199bd P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:02.178335 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.179023 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.179229 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.179812 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.180476 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.181119 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.181650 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.182322 12727 ts_tablet_manager.cc:1939] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.184194 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.184791 12727 tablet_replica.cc:330] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.185163 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.185508 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.185863 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.194051 12251 leader_election.cc:288] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.194955 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.196162 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.195302 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52543aa31a1749d1a0fd5e48cbe30889" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:02.196736 12834 raft_consensus.cc:482] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.198392 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.199934 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.200595 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.201227 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.185467 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.185974 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.186480 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.187031 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.187192 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.201962 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.202636 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.203510 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.203922 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.204568 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.205253 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.187537 11361 raft_consensus.cc:348] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.188194 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.188727 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.192837 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.193681 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.194519 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.198861 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.206077 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.206066 11361 raft_consensus.cc:374] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.206233 11361 raft_consensus.cc:729] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.206537 11361 consensus_queue.cc:260] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.206820 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.207501 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.208395 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.208441 10661 raft_consensus.cc:2454] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:02.208765 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 222397us
I20260811 06:17:02.212097 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.212623 11361 ts_tablet_manager.cc:1428] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.095s user 0.000s sys 0.003s
I20260811 06:17:02.212983 11361 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.214066 11679 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 37) took 2583 ms. Trace:
I20260811 06:17:02.214465 12727 raft_consensus.cc:2229] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.214804 12727 raft_consensus.cc:2258] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.215721 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.216764 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.217644 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.218009 12726 tablet_replica.cc:330] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:02.218616 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.219049 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.212287 12834 raft_consensus.cc:504] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.223881 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.217481 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 84) took 2454 ms (client timeout 1000 ms). Trace:
I20260811 06:17:02.225363 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.226084 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.225078 11672 rpcz_store.cc:269] 0811 06:16:59.757786 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.074598 (+316812us) service_pool.cc:227] Handling call
0811 06:17:00.121938 (+ 47340us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:02.212002 (+2090064us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.906078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.906220 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.906228 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:00.906230 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:00.906496 (+ 266us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.906514 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.906520 (+ 6us) tablet.cc:683] Acquiring locks for 3 operations
0811 06:17:00.906651 (+ 131us) tablet.cc:699] Row locks acquired
0811 06:17:00.906654 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:00.906705 (+ 51us) write_op.cc:270] Start()
0811 06:17:00.906807 (+ 102us) write_op.cc:276] Timestamp: P: 1786429020906683 usec, L: 0
0811 06:17:00.906812 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.907057 (+ 245us) log.cc:842] Serialized 1284 byte log entry
0811 06:17:00.913915 (+ 6858us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.914080 (+ 165us) write_op.cc:301] APPLY: starting
0811 06:17:00.914101 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.914157 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.914226 (+ 69us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.914378 (+ 152us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.914431 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0811 06:17:00.914438 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.914557 (+ 119us) log.cc:842] Serialized 35 byte log entry
0811 06:17:00.914626 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.914653 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:00.914661 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.914725 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.914728 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":202,"spinlock_wait_cycles":97431296,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":710,"apply.run_wall_time_us":710,"num_ops":3,"prepare.queue_time_us":10904,"prepare.run_cpu_time_us":1116,"prepare.run_wall_time_us":1116,"raft.queue_time_us":1055,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"replication_time_us":7073}]]}
I20260811 06:17:02.226672 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet a04766ede03342efb594aaf081e112af from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:02.228392 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.228688 12726 raft_consensus.cc:2229] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:02.230053 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 78) took 2506 ms (client timeout 1000 ms). Trace:
I20260811 06:17:02.230365 11362 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:02.230734 11362 ts_tablet_manager.cc:1397] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.145s user 0.007s sys 0.015s
I20260811 06:17:02.231585 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:02.230206 11676 rpcz_store.cc:269] 0811 06:16:59.723523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:16:59.891524 (+168001us) service_pool.cc:227] Handling call
0811 06:17:00.707801 (+816277us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.707822 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:02.229950 (+1522128us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:00.655586 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.655696 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.655704 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:00.655706 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:00.655839 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.655855 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.655859 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:00.655930 (+ 71us) tablet.cc:699] Row locks acquired
0811 06:17:00.655933 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:00.655976 (+ 43us) write_op.cc:270] Start()
0811 06:17:00.656017 (+ 41us) write_op.cc:276] Timestamp: P: 1786429020655981 usec, L: 0
0811 06:17:00.656020 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.656239 (+ 219us) log.cc:842] Serialized 530 byte log entry
0811 06:17:00.659631 (+ 3392us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.659864 (+ 233us) write_op.cc:301] APPLY: starting
0811 06:17:00.659884 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.659927 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.659961 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.660023 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.660060 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:00.660066 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:00.660158 (+ 92us) log.cc:842] Serialized 23 byte log entry
0811 06:17:00.660229 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.660251 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:00.660258 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0811 06:17:00.785700 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:00.785856 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:00.785864 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:00.785867 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:00.785996 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:00.786012 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:00.786017 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:00.786088 (+ 71us) tablet.cc:699] Row locks acquired
0811 06:17:00.786090 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:00.786136 (+ 46us) write_op.cc:270] Start()
0811 06:17:00.786172 (+ 36us) write_op.cc:276] Timestamp: P: 1786429020786127 usec, L: 0
0811 06:17:00.786176 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:00.786449 (+ 273us) log.cc:842] Serialized 356 byte log entry
0811 06:17:00.790662 (+ 4213us) op_driver.cc:444] REPLICATION: finished
0811 06:17:00.790820 (+ 158us) write_op.cc:301] APPLY: starting
0811 06:17:00.790840 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:00.790884 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:00.790916 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:00.790979 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:00.791020 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:00.791027 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:00.791122 (+ 95us) log.cc:842] Serialized 23 byte log entry
0811 06:17:00.791192 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.791217 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:00.791224 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:00.791285 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:00.791289 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19063,"reported_tablets":206,"child_traces":[["op",{"apply.queue_time_us":165,"apply.run_cpu_time_us":467,"apply.run_wall_time_us":467,"num_ops":1,"prepare.queue_time_us":2146,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":800,"raft.queue_time_us":160,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"replication_time_us":3583}],["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":526,"apply.run_wall_time_us":525,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":874,"prepare.run_wall_time_us":874,"raft.queue_time_us":1158,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"replication_time_us":4459}]]}
I20260811 06:17:02.232919 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.233731 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet b39dfcd1a66b4241bc6f5c38e930f048 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:02.234216 11679 rpcz_store.cc:276] 0811 06:16:59.630490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.974493 (+2344003us) service_pool.cc:227] Handling call
0811 06:17:01.976029 (+ 1536us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.022328 (+ 46299us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.041600 (+ 19272us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.041609 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:02.041705 (+ 96us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.212066 (+170361us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.213999 (+ 1933us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.022968 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.023129 (+ 161us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.023135 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:02.023138 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.023310 (+ 172us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.023324 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.023329 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.023419 (+ 90us) tablet.cc:699] Row locks acquired
0811 06:17:02.023422 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.023526 (+ 104us) write_op.cc:270] Start()
0811 06:17:02.023579 (+ 53us) write_op.cc:276] Timestamp: P: 1786429022023461 usec, L: 0
0811 06:17:02.023584 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.023780 (+ 196us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.027860 (+ 4080us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.027960 (+ 100us) write_op.cc:301] APPLY: starting
0811 06:17:02.027975 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.028018 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.028044 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.028145 (+ 101us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.028178 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.028184 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.028266 (+ 82us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.028346 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.028366 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:02.028372 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":470,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":905,"prepare.run_wall_time_us":905,"raft.queue_time_us":473,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":183,"replication_time_us":4253}]]}
W20260811 06:17:02.235692 10555 leader_election.cc:341] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.235991 10555 leader_election.cc:302] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.236405 12251 raft_consensus.cc:2726] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.238248 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d44dea35e94ed788b7e1e5a8a24d8e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.236955 11679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_4a2b60315e3c40e4bb277aab3d4e95a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:02.239627 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:02.239902 11679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a2b60315e3c40e4bb277aab3d4e95a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.240132 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.240896 11361 tablet_bootstrap.cc:654] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.242798 11365 tablet_bootstrap.cc:654] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.243005 11362 raft_consensus.cc:348] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.243371 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.243880 11362 raft_consensus.cc:374] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.244043 11362 raft_consensus.cc:729] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.244465 12727 ts_tablet_manager.cc:1905] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.245309 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.245555 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.246563 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.247125 12726 raft_consensus.cc:2258] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.247296 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.247314 11362 consensus_queue.cc:260] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.248126 12726 ts_tablet_manager.cc:1905] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.248804 12762 raft_consensus.cc:482] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.249047 12762 raft_consensus.cc:504] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.251605 12762 leader_election.cc:288] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.250900 12834 leader_election.cc:288] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.252228 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.252741 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.253690 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.253892 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.254072 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.255790 11362 ts_tablet_manager.cc:1428] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.025s user 0.002s sys 0.002s
I20260811 06:17:02.256358 11362 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:02.256446 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.257117 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.257433 12728 ts_tablet_manager.cc:1918] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.257947 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.258652 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.258723 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb93dcd940a47e78c5458041c768e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.259382 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.260002 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.260131 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.261135 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.262224 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.262960 12728 log.cc:1196] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/681736b44af04718b800d503ca645c1a
I20260811 06:17:02.263401 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.264462 11679 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 41) took 1985 ms. Trace:
I20260811 06:17:02.264537 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.265211 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.265246 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.265969 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.266258 12728 ts_tablet_manager.cc:1939] T 681736b44af04718b800d503ca645c1a P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:02.266698 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.266821 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.267398 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.268993 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.271955 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.272439 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.272961 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.273123 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.273516 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.275027 11361 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:02.275491 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.275907 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.276569 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.277217 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.278363 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.278926 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:02.268249 11362 tablet_bootstrap.cc:654] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.279350 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:02.279680 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.279906 12866 tablet.cc:1722] T 107bf6921c6e40f2a337dccc302c8856 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.280392 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.264741 11679 rpcz_store.cc:276] 0811 06:17:00.279385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.236659 (+1957274us) service_pool.cc:227] Handling call
0811 06:17:02.240018 (+ 3359us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.240577 (+ 559us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.260132 (+ 19555us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.260139 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:02.260225 (+ 86us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.260416 (+ 191us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.264331 (+ 3915us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.251006 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.251194 (+ 188us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.251201 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:02.251203 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:02.251336 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.251407 (+ 71us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.251415 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.251509 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:02.251511 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:02.251561 (+ 50us) write_op.cc:270] Start()
0811 06:17:02.251601 (+ 40us) write_op.cc:276] Timestamp: P: 1786429022251499 usec, L: 0
0811 06:17:02.251606 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.251819 (+ 213us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.256174 (+ 4355us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.256359 (+ 185us) write_op.cc:301] APPLY: starting
0811 06:17:02.256381 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.256433 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.256470 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.256602 (+ 132us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.256642 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.256648 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.256742 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.256816 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.256841 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:02.256850 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":566,"apply.run_wall_time_us":565,"num_ops":2,"prepare.queue_time_us":9712,"prepare.run_cpu_time_us":953,"prepare.run_wall_time_us":953,"raft.queue_time_us":1048,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":239,"replication_time_us":4540}]]}
I20260811 06:17:02.282246 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.282586 11361 ts_tablet_manager.cc:1397] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.007s
I20260811 06:17:02.283028 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.283953 12727 ts_tablet_manager.cc:1918] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.283993 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:02.284237 12727 log.cc:1196] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:02.284375 10661 raft_consensus.cc:2454] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:02.284512 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.285274 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.283948 11361 raft_consensus.cc:348] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.286345 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.286181 11679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_dbdcfb64222a463388e5d6de872051e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:02.286810 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.287053 11679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbdcfb64222a463388e5d6de872051e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.287846 12728 tablet_replica.cc:330] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:02.288344 12728 raft_consensus.cc:2229] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.289216 12728 raft_consensus.cc:2258] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.289846 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.290186 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.290419 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.290484 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.290589 12728 ts_tablet_manager.cc:1905] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.290863 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.291268 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.291730 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.292145 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.292446 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.292870 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.293210 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.293860 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.294129 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.294384 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.295336 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.296212 11159 raft_consensus.cc:3037] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:02.296919 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 85) took 2325 ms (client timeout 1000 ms). Trace:
I20260811 06:17:02.298069 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.298668 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.300235 11361 raft_consensus.cc:374] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.300462 11361 raft_consensus.cc:729] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.300899 11361 consensus_queue.cc:260] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.302517 11361 ts_tablet_manager.cc:1428] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.020s user 0.001s sys 0.002s
I20260811 06:17:02.302930 11361 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.306025 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:02.306468 11361 tablet_bootstrap.cc:654] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.306690 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:02.307340 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:02.307502 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:02.307994 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:02.308130 11679 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 42) took 2000 ms. Trace:
I20260811 06:17:02.312580 11156 raft_consensus.cc:3037] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.319303 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.319629 11161 raft_consensus.cc:2454] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:02.309651 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.327744 12727 ts_tablet_manager.cc:1939] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.331305 11679 rpcz_store.cc:276] 0811 06:17:00.307637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.285775 (+1978138us) service_pool.cc:227] Handling call
0811 06:17:02.287238 (+ 1463us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.297254 (+ 10016us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.307579 (+ 10325us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.307585 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:02.307671 (+ 86us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.307936 (+ 265us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.308047 (+ 111us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.298877 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.299006 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.299013 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:02.299016 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.299118 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.299133 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.299138 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.299229 (+ 91us) tablet.cc:699] Row locks acquired
0811 06:17:02.299232 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.299281 (+ 49us) write_op.cc:270] Start()
0811 06:17:02.299316 (+ 35us) write_op.cc:276] Timestamp: P: 1786429022299208 usec, L: 0
0811 06:17:02.299320 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.299580 (+ 260us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.304073 (+ 4493us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.304218 (+ 145us) write_op.cc:301] APPLY: starting
0811 06:17:02.304237 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.304301 (+ 64us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.304329 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.304472 (+ 143us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.304515 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.304521 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.304610 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.304696 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.304722 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:02.304730 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":578,"num_ops":2,"prepare.queue_time_us":675,"prepare.run_cpu_time_us":830,"prepare.run_wall_time_us":830,"raft.queue_time_us":1000,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":393,"replication_time_us":4729}]]}
I20260811 06:17:02.332468 11679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_66bf56dc63cc4ebe91984891082c9c8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:02.334925 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 40c31ffb11484783bca9263c947f37da consensus state has no leader
W20260811 06:17:02.335005 11679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66bf56dc63cc4ebe91984891082c9c8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.335218 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.335999 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.338184 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:02.341444 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.342532 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.343314 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.343778 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.344202 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.344583 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.344959 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.345321 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.345592 11047 leader_election.cc:302] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.346870 12272 consensus_queue.cc:1035] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260811 06:17:02.347648 12811 consensus_queue.cc:1035] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260811 06:17:02.348558 12059 consensus_queue.cc:1035] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260811 06:17:02.349499 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.349761 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.349975 12094 raft_consensus.cc:2726] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:02.350175 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.350484 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.350984 10555 leader_election.cc:341] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.351275 10555 leader_election.cc:302] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.351753 12821 raft_consensus.cc:2726] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.352721 10810 leader_election.cc:302] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
W20260811 06:17:02.353130 10555 leader_election.cc:341] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:02.353420 10555 leader_election.cc:341] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:02.353621 10810 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
I20260811 06:17:02.354173 12059 raft_consensus.cc:2781] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:02.354568 12059 raft_consensus.cc:482] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:02.354724 12059 raft_consensus.cc:3037] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.360719 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.362180 12726 ts_tablet_manager.cc:1918] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:02.362586 12726 log.cc:1196] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:02.362632 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.363533 12726 ts_tablet_manager.cc:1939] T e873e2f7b3d34988856b3be044de1ed7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:02.363694 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.362089 12059 raft_consensus.cc:504] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.365424 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.366662 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.367525 12059 leader_election.cc:288] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.368085 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.369412 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.370359 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.371181 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.372313 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.373435 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.374362 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.375130 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.376648 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.378850 12094 raft_consensus.cc:482] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.379139 12094 raft_consensus.cc:504] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.380537 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.381884 12727 tablet_replica.cc:330] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.378383 11047 leader_election.cc:302] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.384598 12727 raft_consensus.cc:2229] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.385267 11047 leader_election.cc:302] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.385957 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:02.386523 12727 raft_consensus.cc:2258] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.387005 12774 raft_consensus.cc:2684] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 06:17:02.387151 12094 leader_election.cc:288] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.387847 11047 leader_election.cc:302] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.388693 12483 raft_consensus.cc:2726] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.390400 11047 leader_election.cc:302] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.390576 12094 raft_consensus.cc:3037] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:02.391235 11047 raft_consensus.cc:2670] T 52543aa31a1749d1a0fd5e48cbe30889 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260811 06:17:02.391971 10813 leader_election.cc:341] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.393077 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 52543aa31a1749d1a0fd5e48cbe30889 (table default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]) successfully deleted
W20260811 06:17:02.393487 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:02.394212 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4d44dea35e94ed788b7e1e5a8a24d8e already in progress: creating tablet
I20260811 06:17:02.394481 12727 ts_tablet_manager.cc:1905] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:02.394563 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:02.395022 12773 consensus_queue.cc:1035] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:02.397120 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
W20260811 06:17:02.397228 10813 leader_election.cc:341] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
W20260811 06:17:02.397473 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:02.397514 10813 leader_election.cc:302] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.397910 12579 raft_consensus.cc:2726] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.400182 12094 raft_consensus.cc:2726] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.400413 11679 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 43) took 2090 ms. Trace:
I20260811 06:17:02.400704 11679 rpcz_store.cc:276] 0811 06:17:00.310366 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.332113 (+2021747us) service_pool.cc:227] Handling call
0811 06:17:02.335148 (+ 3035us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.336922 (+ 1774us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.399999 (+ 63077us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.400184 (+ 185us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.400285 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.337529 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.338709 (+ 1180us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.338717 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:02.338720 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.338848 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.338867 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.338873 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.338970 (+ 97us) tablet.cc:699] Row locks acquired
0811 06:17:02.338973 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.339019 (+ 46us) write_op.cc:270] Start()
0811 06:17:02.339062 (+ 43us) write_op.cc:276] Timestamp: P: 1786429022338949 usec, L: 0
0811 06:17:02.339066 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.339514 (+ 448us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.398850 (+ 59336us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.399005 (+ 155us) write_op.cc:301] APPLY: starting
0811 06:17:02.399025 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.399078 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.399168 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.399319 (+ 151us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.399374 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.399382 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:02.399476 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.399546 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.399576 (+ 30us) write_op.cc:454] Released schema lock
0811 06:17:02.399584 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.399646 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.399650 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":702,"apply.run_wall_time_us":702,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1023,"prepare.run_wall_time_us":2137,"raft.queue_time_us":1293,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":48834,"replication_time_us":59753}]]}
I20260811 06:17:02.402206 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.406853 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:02.409696 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e5b4cdeb464861ada487eeb1b901a6 already in progress: creating tablet
I20260811 06:17:02.409965 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.410111 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
W20260811 06:17:02.410513 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:17:02.411070 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
W20260811 06:17:02.411167 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45ebef95922f4e7f93533b54c07b7cec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45ebef95922f4e7f93533b54c07b7cec already in progress: creating tablet
W20260811 06:17:02.411563 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1981dc26be24ec5afaa3c0bb5c46c8c already in progress: creating tablet
I20260811 06:17:02.411741 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:02.412127 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:02.415266 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:02.415676 12762 consensus_queue.cc:1035] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.415995 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.417204 12728 ts_tablet_manager.cc:1918] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.417737 11157 raft_consensus.cc:3037] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:02.418525 11047 leader_election.cc:341] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:02.297179 11655 rpcz_store.cc:269] 0811 06:16:59.971596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:00.100070 (+128474us) service_pool.cc:227] Handling call
0811 06:17:00.117964 (+ 17894us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:02.296839 (+2178875us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:01.364590 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:01.364777 (+ 187us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:01.364785 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:01.364788 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:01.365012 (+ 224us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:01.365046 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:01.365055 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:01.365232 (+ 177us) tablet.cc:699] Row locks acquired
0811 06:17:01.365235 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:01.365285 (+ 50us) write_op.cc:270] Start()
0811 06:17:01.365341 (+ 56us) write_op.cc:276] Timestamp: P: 1786429021364979 usec, L: 0
0811 06:17:01.365345 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:01.365566 (+ 221us) log.cc:842] Serialized 907 byte log entry
0811 06:17:01.373571 (+ 8005us) op_driver.cc:444] REPLICATION: finished
0811 06:17:01.373788 (+ 217us) write_op.cc:301] APPLY: starting
0811 06:17:01.373818 (+ 30us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:01.373869 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:01.373923 (+ 54us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:01.374007 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:01.374048 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:01.374055 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:01.374267 (+ 212us) log.cc:842] Serialized 29 byte log entry
0811 06:17:01.374355 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:01.374380 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:01.374389 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:01.374469 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:01.374472 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129866,"reported_tablets":195,"spinlock_wait_cycles":21978368,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":785,"apply.run_wall_time_us":816,"mutex_wait_us":474,"num_ops":2,"prepare.queue_time_us":983,"prepare.run_cpu_time_us":1167,"prepare.run_wall_time_us":1631,"raft.queue_time_us":595,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":305,"replication_time_us":8198}]]}
I20260811 06:17:02.422078 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_b959e7d44eb64358964a8534448dc4ec" } new_table_name: "default.Table_c8f687b8d15f43d2a993c347c59f46cb" modify_external_catalogs: true
I20260811 06:17:02.426726 11157 raft_consensus.cc:2454] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:02.417591 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.423219 11362 tablet_bootstrap.cc:492] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:02.423676 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.427873 11047 leader_election.cc:341] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.429464 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6119212ae4be4204852a5d9437dcee72" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:02.429806 10663 raft_consensus.cc:3037] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.433379 10663 raft_consensus.cc:2454] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:02.439725 12821 raft_consensus.cc:482] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.440117 12821 raft_consensus.cc:504] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.441108 12821 leader_election.cc:288] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.442289 10810 leader_election.cc:302] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:02.442936 12059 raft_consensus.cc:2781] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:02.443301 12059 raft_consensus.cc:686] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:02.443773 12059 consensus_queue.cc:237] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.444903 11362 ts_tablet_manager.cc:1397] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.189s user 0.005s sys 0.008s
I20260811 06:17:02.446061 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.447295 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.447525 12728 log.cc:1196] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ea4eb7f5db2e4e75818bfb228b64ed0d
I20260811 06:17:02.447999 11361 tablet_bootstrap.cc:492] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:02.448287 11361 ts_tablet_manager.cc:1397] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.145s user 0.018s sys 0.013s
I20260811 06:17:02.448916 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.449605 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.450664 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.451220 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.453198 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.453449 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.453677 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.453836 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.453758 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.455191 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.450915 11361 raft_consensus.cc:348] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.456072 11361 raft_consensus.cc:374] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.456324 11361 raft_consensus.cc:729] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:02.456375 10555 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.456889 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.457592 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.458077 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.458700 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.458573 11361 consensus_queue.cc:260] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.459403 11361 ts_tablet_manager.cc:1428] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:17:02.459491 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.459887 11361 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.460270 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.460755 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.462435 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.463035 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.463758 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.464203 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.464258 11361 tablet_bootstrap.cc:654] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.464865 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.465394 11365 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:02.465758 11365 ts_tablet_manager.cc:1397] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.377s user 0.007s sys 0.016s
I20260811 06:17:02.466048 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.466400 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.468813 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.469549 12728 ts_tablet_manager.cc:1939] T ea4eb7f5db2e4e75818bfb228b64ed0d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:02.470031 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
W20260811 06:17:02.470523 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 58411.1us
I20260811 06:17:02.470878 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (table default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]) successfully deleted
I20260811 06:17:02.472767 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:02.473985 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.484504 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.456239 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.491210 12726 tablet_replica.cc:330] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:02.495203 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:02.495812 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:02.496299 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:02.496846 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:02.497246 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:02.497645 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:02.498064 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:02.498639 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:02.498944 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:02.499527 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:02.499935 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:02.500388 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:02.500744 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:02.489419 11365 raft_consensus.cc:348] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.501108 11365 raft_consensus.cc:374] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.501405 11365 raft_consensus.cc:729] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.501544 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:02.502087 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.503149 12726 raft_consensus.cc:2229] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.534353 12727 ts_tablet_manager.cc:1918] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.534729 12727 log.cc:1196] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ea4eb7f5db2e4e75818bfb228b64ed0d
I20260811 06:17:02.535936 12727 ts_tablet_manager.cc:1939] T ea4eb7f5db2e4e75818bfb228b64ed0d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.537864 12727 tablet_replica.cc:330] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.538316 12727 raft_consensus.cc:2229] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.538856 12727 raft_consensus.cc:2258] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.546306 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.546401 12726 raft_consensus.cc:2258] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.545526 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.547176 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.549932 12726 ts_tablet_manager.cc:1905] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.551810 12866 tablet.cc:1722] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.555596 12811 consensus_queue.cc:1035] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260811 06:17:02.570226 12727 ts_tablet_manager.cc:1905] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:02.544334 12915 log.cc:924] Time spent T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260811 06:17:02.553565 12094 raft_consensus.cc:482] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.574321 12094 raft_consensus.cc:504] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.575594 12094 leader_election.cc:288] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.575670 12773 raft_consensus.cc:482] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.575958 12773 raft_consensus.cc:504] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:02.576979 12773 leader_election.cc:288] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.577770 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.578116 10913 raft_consensus.cc:2454] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.581475 11362 raft_consensus.cc:348] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.582345 11362 raft_consensus.cc:374] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.582950 11362 raft_consensus.cc:729] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.586730 12934 tablet.cc:1722] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.591766 11047 leader_election.cc:302] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.592168 12094 raft_consensus.cc:2781] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:02.592408 12094 raft_consensus.cc:482] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:02.592744 12094 raft_consensus.cc:3037] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.594813 11361 tablet_bootstrap.cc:492] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:02.595080 11361 ts_tablet_manager.cc:1397] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.006s
I20260811 06:17:02.596248 12946 tablet.cc:1722] T 107bf6921c6e40f2a337dccc302c8856 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.598291 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.598920 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.600857 12094 raft_consensus.cc:504] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.602555 12094 leader_election.cc:288] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.603925 11361 raft_consensus.cc:348] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.604462 11361 raft_consensus.cc:374] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.604691 11361 raft_consensus.cc:729] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.609468 12728 tablet_replica.cc:330] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:02.611804 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.612936 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.613152 11361 consensus_queue.cc:260] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.614240 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.597777 11365 consensus_queue.cc:260] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.615557 11365 ts_tablet_manager.cc:1428] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.150s user 0.000s sys 0.004s
I20260811 06:17:02.617039 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.617489 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.617908 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.617964 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.618255 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.622426 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.623338 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.626035 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.627542 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.629405 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:02.629936 10813 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 864c3bbf1e004579a4d0be809f83ca33
I20260811 06:17:02.629015 12728 raft_consensus.cc:2229] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.630940 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.631465 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:02.628844 11362 consensus_queue.cc:260] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:02.631806 12885 log.cc:924] Time spent T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20260811 06:17:02.634161 12921 tablet.cc:1722] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.633700 11365 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:02.635617 12917 tablet.cc:1722] T 9d24d909b82640a386b612fba1f38fac P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:02.637451 10564 leader_election.cc:341] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.637691 10564 leader_election.cc:302] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.638053 12834 raft_consensus.cc:2726] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:02.638341 10564 leader_election.cc:341] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.638561 10564 leader_election.cc:302] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.638947 12834 raft_consensus.cc:2726] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:02.639045 10564 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.643875 12094 raft_consensus.cc:482] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.644610 12934 tablet.cc:1722] T 0391df1c64954f66a3987aba9257ca4b P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:17:02.644773 12094 raft_consensus.cc:504] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.646592 12094 leader_election.cc:288] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:02.647626 12728 raft_consensus.cc:2258] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.639161 10564 leader_election.cc:302] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.648984 12834 raft_consensus.cc:2726] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.651002 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:02.651419 10659 raft_consensus.cc:2454] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.653008 11361 ts_tablet_manager.cc:1428] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.043s user 0.005s sys 0.000s
I20260811 06:17:02.643565 12951 tablet.cc:1722] T 9d24d909b82640a386b612fba1f38fac P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.656970 12728 ts_tablet_manager.cc:1905] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.658319 11365 tablet_bootstrap.cc:654] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.660135 11362 ts_tablet_manager.cc:1428] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.214s user 0.000s sys 0.004s
I20260811 06:17:02.660653 11362 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:02.660645 11361 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.660876 12866 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.663085 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:02.663326 10918 raft_consensus.cc:3037] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.668608 10918 raft_consensus.cc:2454] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:02.669885 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:02.670164 10661 raft_consensus.cc:2454] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.672014 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:02.672219 10661 raft_consensus.cc:2454] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.672932 12917 tablet.cc:1722] T 0391df1c64954f66a3987aba9257ca4b P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:17:02.673328 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dee9af5a4504b8284c9150298ab3462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:02.673651 10661 raft_consensus.cc:3037] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.676908 12921 tablet.cc:1722] T 7246e1f0cdb049c6855b8bdbd42936f6 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:02.677263 10661 raft_consensus.cc:2454] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:02.681013 11361 tablet_bootstrap.cc:654] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.643832 12726 ts_tablet_manager.cc:1918] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:02.683856 12726 log.cc:1196] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:02.684463 12726 ts_tablet_manager.cc:1939] T 52543aa31a1749d1a0fd5e48cbe30889 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:02.686358 12727 ts_tablet_manager.cc:1918] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.686692 12727 log.cc:1196] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/0bbf657cb27f4da9a4f595242864163a
I20260811 06:17:02.687476 12727 ts_tablet_manager.cc:1939] T 0bbf657cb27f4da9a4f595242864163a P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.691036 11046 leader_election.cc:302] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.691962 11046 leader_election.cc:302] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.692615 11362 tablet_bootstrap.cc:654] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.693594 12094 raft_consensus.cc:2781] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:02.693758 12094 raft_consensus.cc:482] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:02.694059 12094 raft_consensus.cc:3037] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.697414 12921 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.700677 12726 tablet_replica.cc:330] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:02.701007 12726 raft_consensus.cc:2229] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.701212 12726 raft_consensus.cc:2258] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.702081 12726 ts_tablet_manager.cc:1905] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.710547 11365 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:02.710762 11365 ts_tablet_manager.cc:1397] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.095s user 0.005s sys 0.006s
I20260811 06:17:02.711925 11365 raft_consensus.cc:348] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.712405 11365 raft_consensus.cc:374] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.712651 11365 raft_consensus.cc:729] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.712965 11365 consensus_queue.cc:260] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.718418 12934 tablet.cc:1722] T 107bf6921c6e40f2a337dccc302c8856 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:02.719125 12774 raft_consensus.cc:2781] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:02.719271 11046 leader_election.cc:302] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.720329 12774 raft_consensus.cc:482] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:02.720532 12774 raft_consensus.cc:3037] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.720897 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:02.723097 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ea4eb7f5db2e4e75818bfb228b64ed0d (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
W20260811 06:17:02.723296 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 182137us
I20260811 06:17:02.723694 12483 raft_consensus.cc:2781] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:02.723899 12483 raft_consensus.cc:686] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
W20260811 06:17:02.723886 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:02.723994 12094 raft_consensus.cc:504] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:02.724202 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
W20260811 06:17:02.725530 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 142663us
I20260811 06:17:02.725319 12483 consensus_queue.cc:237] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.726613 12811 consensus_queue.cc:1035] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.727728 12094 leader_election.cc:288] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
W20260811 06:17:02.724506 11046 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 9c5fa9633057485b917f117819d79398
I20260811 06:17:02.730484 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 52ecffcf4a0e46428caed6f7d72199bd (table default.Table_ae798943d2514f6488c7ae50b11ef679 [id=6265dc35475144bd9f4b3348ed37447a]) successfully deleted
I20260811 06:17:02.732395 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:02.732625 11047 leader_election.cc:341] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 9c5fa9633057485b917f117819d79398
I20260811 06:17:02.732856 11047 leader_election.cc:302] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.732889 10661 raft_consensus.cc:3037] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:02.733085 11584 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 111803us
I20260811 06:17:02.733619 12484 raft_consensus.cc:2726] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:02.734577 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
W20260811 06:17:02.735005 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:02.735383 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e873e2f7b3d34988856b3be044de1ed7 (table default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]) successfully deleted
W20260811 06:17:02.735757 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:02.736163 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 52543aa31a1749d1a0fd5e48cbe30889 (table default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]) successfully deleted
I20260811 06:17:02.737686 10661 raft_consensus.cc:2454] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:02.739156 11046 leader_election.cc:302] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.739616 12484 raft_consensus.cc:2781] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:02.740068 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 0bbf657cb27f4da9a4f595242864163a (table default.Table_3ae91f4b99784386b61c6b22b804b906 [id=e3f87a09fef5439a9dbc3d579d073d62]) successfully deleted
I20260811 06:17:02.744035 11365 ts_tablet_manager.cc:1428] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.033s user 0.001s sys 0.002s
I20260811 06:17:02.744467 11365 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:02.751248 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:02.752214 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:02.753345 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:02.754900 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:02.756213 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c4e76ecde14d0a86fedc84815e78a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:02.757637 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:02.758945 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:02.760439 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:02.760556 12484 raft_consensus.cc:686] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:02.761026 12484 consensus_queue.cc:237] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.761222 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:02.762144 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:02.762425 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:02.762655 12774 raft_consensus.cc:504] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.762868 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:02.763162 12940 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:02.764011 11047 leader_election.cc:341] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.763108 12952 tablet.cc:1722] T 7246e1f0cdb049c6855b8bdbd42936f6 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:02.764079 12774 leader_election.cc:288] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.765105 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:02.766013 11047 leader_election.cc:341] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.767915 12727 tablet_replica.cc:330] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.768273 12727 raft_consensus.cc:2229] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:02.768780 12727 raft_consensus.cc:2258] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.769467 12727 ts_tablet_manager.cc:1905] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.774183 12578 raft_consensus.cc:482] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 24d29113b2454d9c93e23db3e3dac801)
I20260811 06:17:02.774449 12578 raft_consensus.cc:504] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:02.777287 10813 leader_election.cc:341] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 22cac1c339574b1fa26555b18811539b
I20260811 06:17:02.779203 12866 tablet.cc:1722] T 0391df1c64954f66a3987aba9257ca4b P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260811 06:17:02.780753 12578 leader_election.cc:288] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.781266 12578 consensus_queue.cc:1035] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.782697 11361 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:02.782948 11361 ts_tablet_manager.cc:1397] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.129s user 0.010s sys 0.007s
I20260811 06:17:02.784123 11361 raft_consensus.cc:348] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.784447 11361 raft_consensus.cc:374] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.784674 11361 raft_consensus.cc:729] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.785080 11361 consensus_queue.cc:260] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.789537 12866 tablet.cc:1722] T 7246e1f0cdb049c6855b8bdbd42936f6 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:02.789757 12943 consensus_queue.cc:1035] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260811 06:17:02.793191 10810 leader_election.cc:341] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 864c3bbf1e004579a4d0be809f83ca33
I20260811 06:17:02.793612 10810 leader_election.cc:302] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.794070 12943 raft_consensus.cc:2726] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:02.798352 10810 leader_election.cc:341] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 22cac1c339574b1fa26555b18811539b
I20260811 06:17:02.799144 11361 ts_tablet_manager.cc:1428] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.016s user 0.002s sys 0.002s
I20260811 06:17:02.798712 10810 leader_election.cc:302] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.800276 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:02.801383 11361 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.799278 12973 tablet.cc:1722] T 9d24d909b82640a386b612fba1f38fac P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:02.802142 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:02.803553 12943 raft_consensus.cc:2726] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:02.802927 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:02.804677 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:02.807523 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:02.808010 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:02.808591 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:02.809300 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:02.812566 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:02.813336 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:02.814181 11361 tablet_bootstrap.cc:654] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:02.804903 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
W20260811 06:17:02.815420 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:02.816867 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
W20260811 06:17:02.817265 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:02.817699 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
W20260811 06:17:02.818038 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1981dc26be24ec5afaa3c0bb5c46c8c already in progress: creating tablet
W20260811 06:17:02.818365 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4d44dea35e94ed788b7e1e5a8a24d8e already in progress: creating tablet
W20260811 06:17:02.818666 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:02.818773 12728 ts_tablet_manager.cc:1918] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260811 06:17:02.819233 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0e5b4cdeb464861ada487eeb1b901a6 already in progress: creating tablet
I20260811 06:17:02.819607 12728 log.cc:1196] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:02.824872 12727 ts_tablet_manager.cc:1918] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.825093 12727 log.cc:1196] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/67f458dba9444bfa8841a84cdb798588
W20260811 06:17:02.825358 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:02.826973 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 681736b44af04718b800d503ca645c1a (table default.Table_ecbfc78f213d4d2f9efe02b95e85e6ef [id=2590d2d487344033b794724044194981]) successfully deleted
I20260811 06:17:02.827827 12728 ts_tablet_manager.cc:1939] T b39dfcd1a66b4241bc6f5c38e930f048 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:02.829272 12727 ts_tablet_manager.cc:1939] T 67f458dba9444bfa8841a84cdb798588 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.830264 12728 tablet_replica.cc:330] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:02.831267 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 67f458dba9444bfa8841a84cdb798588 (table default.Table_b63b26856f794ef6abd6c07660a63664 [id=c6aae61f2b50440b8f02c1fa0365b82f]) successfully deleted
I20260811 06:17:02.831805 12727 tablet_replica.cc:330] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.832043 11365 tablet_bootstrap.cc:654] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.832407 12727 raft_consensus.cc:2229] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.832731 12727 raft_consensus.cc:2258] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.834038 12728 raft_consensus.cc:2229] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.834578 12727 ts_tablet_manager.cc:1905] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.834769 12728 raft_consensus.cc:2258] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:02.834789 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f4f14a0add084048b92a501476ad6588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4f14a0add084048b92a501476ad6588 already in progress: creating tablet
W20260811 06:17:02.836018 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:02.836570 12728 ts_tablet_manager.cc:1905] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.838887 12578 consensus_queue.cc:1035] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.849090 12059 consensus_queue.cc:1035] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.851868 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ea4eb7f5db2e4e75818bfb228b64ed0d (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
W20260811 06:17:02.859126 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 67f458dba9444bfa8841a84cdb798588 because the tablet was not found. No further retry: Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588
I20260811 06:17:02.862303 11676 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 40) took 2919 ms. Trace:
I20260811 06:17:02.865309 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet b39dfcd1a66b4241bc6f5c38e930f048 (table default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]) successfully deleted
I20260811 06:17:02.867760 11676 rpcz_store.cc:276] 0811 06:16:59.942215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.233504 (+2291289us) service_pool.cc:227] Handling call
0811 06:17:02.862101 (+628597us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:02.873399 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:02.874523 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_e13f1a2d6d924970ae68d9a31b0f6903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:02.875396 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e13f1a2d6d924970ae68d9a31b0f6903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.876036 12821 raft_consensus.cc:482] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.876291 12821 raft_consensus.cc:504] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.877209 12821 leader_election.cc:288] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:02.878296 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:02.879416 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:02.880215 10555 leader_election.cc:341] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:02.880847 10564 leader_election.cc:341] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:02.881006 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet a04766ede03342efb594aaf081e112af
I20260811 06:17:02.881038 10564 leader_election.cc:302] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:02.881670 11672 catalog_manager.cc:6565] ReplaceTablet: tablet a04766ede03342efb594aaf081e112af deleted and replaced by tablet b23c8754701444db93ceb1131a98b1dc
I20260811 06:17:02.881968 12821 raft_consensus.cc:2726] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.881980 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 39) took 2965 ms. Trace:
I20260811 06:17:02.882143 11672 rpcz_store.cc:276] 0811 06:16:59.916606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.226470 (+2309864us) service_pool.cc:227] Handling call
0811 06:17:02.881789 (+655319us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.862533 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.862665 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.862673 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:02.862676 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.862803 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.862819 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.862824 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.862934 (+ 110us) tablet.cc:699] Row locks acquired
0811 06:17:02.862937 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.863041 (+ 104us) write_op.cc:270] Start()
0811 06:17:02.863084 (+ 43us) write_op.cc:276] Timestamp: P: 1786429022863005 usec, L: 0
0811 06:17:02.863089 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.863308 (+ 219us) log.cc:842] Serialized 625 byte log entry
0811 06:17:02.868829 (+ 5521us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.868948 (+ 119us) write_op.cc:301] APPLY: starting
0811 06:17:02.868966 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.869018 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.869063 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.869180 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.873538 (+ 4358us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:02.873548 (+ 10us) write_op.cc:312] APPLY: finished
0811 06:17:02.873672 (+ 124us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.873776 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.873808 (+ 32us) write_op.cc:454] Released schema lock
0811 06:17:02.873818 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.873893 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.873896 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":797,"apply.run_wall_time_us":5008,"num_ops":2,"prepare.queue_time_us":648,"prepare.run_cpu_time_us":886,"prepare.run_wall_time_us":885,"raft.queue_time_us":469,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":254,"replication_time_us":5711}]]}
I20260811 06:17:02.883383 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:02.883831 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_06b0354f6caf43b89e9cccafc05ae8e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:02.886142 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:02.888631 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b0354f6caf43b89e9cccafc05ae8e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:02.895674 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 144145us
I20260811 06:17:02.896385 11676 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 45) took 2584 ms. Trace:
I20260811 06:17:02.896601 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:02.896974 10655 raft_consensus.cc:3037] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.896672 11676 rpcz_store.cc:276] 0811 06:17:00.311657 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.872499 (+2560842us) service_pool.cc:227] Handling call
0811 06:17:02.875509 (+ 3010us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.875982 (+ 473us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.895569 (+ 19587us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.895680 (+ 111us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.895778 (+ 98us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.876951 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.877053 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.877059 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:02.877062 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.877160 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.877175 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.877181 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.877270 (+ 89us) tablet.cc:699] Row locks acquired
0811 06:17:02.877273 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.877316 (+ 43us) write_op.cc:270] Start()
0811 06:17:02.877350 (+ 34us) write_op.cc:276] Timestamp: P: 1786429022877280 usec, L: 0
0811 06:17:02.877354 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.877536 (+ 182us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.890830 (+ 13294us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.890969 (+ 139us) write_op.cc:301] APPLY: starting
0811 06:17:02.890989 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.891089 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.891117 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.891293 (+ 176us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.891334 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.891341 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:02.891426 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.891495 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.891521 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:02.891529 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.891590 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.891593 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":677,"apply.run_wall_time_us":677,"num_ops":2,"prepare.queue_time_us":439,"prepare.run_cpu_time_us":661,"prepare.run_wall_time_us":661,"replication_time_us":13451}]]}
I20260811 06:17:02.898944 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_cec5b49f1dee44e785c6ef74c5ca41fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:02.899881 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec5b49f1dee44e785c6ef74c5ca41fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.900367 12726 ts_tablet_manager.cc:1918] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:02.909137 11361 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:02.909657 12484 consensus_queue.cc:1035] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260811 06:17:02.910356 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 46) took 2595 ms. Trace:
I20260811 06:17:02.910539 11672 rpcz_store.cc:276] 0811 06:17:00.314460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.883526 (+2569066us) service_pool.cc:227] Handling call
0811 06:17:02.888817 (+ 5291us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.889354 (+ 537us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.909793 (+ 20439us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.909916 (+ 123us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.910181 (+ 265us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.894383 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.894560 (+ 177us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.894566 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:02.894568 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:02.894664 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.894680 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.894685 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.894770 (+ 85us) tablet.cc:699] Row locks acquired
0811 06:17:02.894772 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:02.894805 (+ 33us) write_op.cc:270] Start()
0811 06:17:02.894831 (+ 26us) write_op.cc:276] Timestamp: P: 1786429022894771 usec, L: 0
0811 06:17:02.894833 (+ 2us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.894989 (+ 156us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.904483 (+ 9494us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.904598 (+ 115us) write_op.cc:301] APPLY: starting
0811 06:17:02.904615 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.904663 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.904691 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.904809 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.904848 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.904855 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:02.904945 (+ 90us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.905017 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.905040 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:02.905047 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.905109 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.905112 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":566,"apply.run_wall_time_us":566,"num_ops":2,"prepare.queue_time_us":4379,"prepare.run_cpu_time_us":715,"prepare.run_wall_time_us":715,"raft.queue_time_us":62,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":352,"replication_time_us":9623}]]}
I20260811 06:17:02.911321 11361 ts_tablet_manager.cc:1397] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.005s
I20260811 06:17:02.912549 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_befcafaab1e245148bebd1c621529067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:02.912741 11361 raft_consensus.cc:348] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.913062 12963 raft_consensus.cc:482] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:02.913611 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_befcafaab1e245148bebd1c621529067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:02.913352 12963 raft_consensus.cc:504] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.914130 12774 raft_consensus.cc:482] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:02.914290 12774 raft_consensus.cc:504] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.914651 12963 leader_election.cc:288] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.914829 12774 leader_election.cc:288] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:02.914994 11361 raft_consensus.cc:374] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.915105 11361 raft_consensus.cc:729] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.915391 11361 consensus_queue.cc:260] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.915637 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52ecffcf4a0e46428caed6f7d72199bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:02.916034 10922 raft_consensus.cc:2454] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:02.916102 11361 ts_tablet_manager.cc:1428] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:02.916603 11361 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:02.917089 11365 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:02.918428 11047 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae
I20260811 06:17:02.918740 11047 leader_election.cc:302] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.919313 12774 raft_consensus.cc:2781] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:02.919490 12774 raft_consensus.cc:482] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:02.919605 12774 raft_consensus.cc:3037] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.920626 12727 ts_tablet_manager.cc:1918] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:02.921103 12727 log.cc:1196] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:02.921985 12727 ts_tablet_manager.cc:1939] T b39dfcd1a66b4241bc6f5c38e930f048 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:02.923266 10655 raft_consensus.cc:2454] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:02.923708 11365 ts_tablet_manager.cc:1397] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.173s user 0.006s sys 0.000s
I20260811 06:17:02.925571 12727 tablet_replica.cc:330] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:02.925576 11365 raft_consensus.cc:348] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.925850 12727 raft_consensus.cc:2229] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.925931 11365 raft_consensus.cc:374] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.926102 11365 raft_consensus.cc:729] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.926457 11365 consensus_queue.cc:260] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.927933 11365 ts_tablet_manager.cc:1428] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:17:02.928164 12726 log.cc:1196] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:02.928746 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet b39dfcd1a66b4241bc6f5c38e930f048 (table default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]) successfully deleted
W20260811 06:17:02.929200 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 already in progress: creating tablet
I20260811 06:17:02.929873 11365 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:02.928929 12963 consensus_queue.cc:1035] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.930691 12774 raft_consensus.cc:504] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.929735 11156 raft_consensus.cc:3037] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.931552 12774 leader_election.cc:288] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:02.934703 11365 tablet_bootstrap.cc:654] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.936751 11676 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 47) took 2591 ms. Trace:
I20260811 06:17:02.937098 12726 ts_tablet_manager.cc:1939] T d4d44dea35e94ed788b7e1e5a8a24d8e P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:02.936949 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52ecffcf4a0e46428caed6f7d72199bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:02.937354 10915 raft_consensus.cc:3037] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:02.937052 11676 rpcz_store.cc:276] 0811 06:17:00.344750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.898540 (+2553790us) service_pool.cc:227] Handling call
0811 06:17:02.900050 (+ 1510us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.914179 (+ 14129us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.936322 (+ 22143us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.936451 (+ 129us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.936554 (+ 103us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.915061 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.915162 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.915169 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:02.915171 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:02.915266 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.915283 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.915288 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.915386 (+ 98us) tablet.cc:699] Row locks acquired
0811 06:17:02.915388 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:02.915428 (+ 40us) write_op.cc:270] Start()
0811 06:17:02.915463 (+ 35us) write_op.cc:276] Timestamp: P: 1786429022915390 usec, L: 0
0811 06:17:02.915466 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.915662 (+ 196us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.920815 (+ 5153us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.921024 (+ 209us) write_op.cc:301] APPLY: starting
0811 06:17:02.921041 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.921089 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.921226 (+ 137us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.921365 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.921406 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.921412 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.921500 (+ 88us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.921565 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.921589 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:02.921596 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.921648 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.921652 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":148,"apply.run_cpu_time_us":683,"apply.run_wall_time_us":683,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":706,"prepare.run_wall_time_us":706,"raft.queue_time_us":1239,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":234,"replication_time_us":5326}]]}
I20260811 06:17:02.938505 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet d4d44dea35e94ed788b7e1e5a8a24d8e (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
I20260811 06:17:02.939097 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet 6119212ae4be4204852a5d9437dcee72 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:02.939592 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
I20260811 06:17:02.941617 12773 consensus_queue.cc:1035] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.942135 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:02.942814 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:02.941133 10915 raft_consensus.cc:2454] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:02.944671 11046 leader_election.cc:302] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:02.944900 11047 leader_election.cc:302] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:02.945221 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
W20260811 06:17:02.945552 11046 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:02.946009 12963 raft_consensus.cc:2781] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:02.946251 12963 raft_consensus.cc:686] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:02.946710 12963 consensus_queue.cc:237] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.948585 12484 raft_consensus.cc:2781] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:02.950690 11362 tablet_bootstrap.cc:492] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:02.951038 11362 ts_tablet_manager.cc:1397] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.290s user 0.003s sys 0.015s
I20260811 06:17:02.949335 12484 raft_consensus.cc:686] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:02.952046 12484 consensus_queue.cc:237] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.952445 11362 raft_consensus.cc:348] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.952828 11362 raft_consensus.cc:374] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:02.952988 11362 raft_consensus.cc:729] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:02.953357 11362 consensus_queue.cc:260] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:02.954649 11361 tablet_bootstrap.cc:654] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.955305 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:02.955917 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:02.956540 11362 ts_tablet_manager.cc:1428] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260811 06:17:02.959863 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
W20260811 06:17:02.963071 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:02.962257 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 48) took 2595 ms. Trace:
I20260811 06:17:02.963436 11672 rpcz_store.cc:276] 0811 06:17:00.366990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.912103 (+2545113us) service_pool.cc:227] Handling call
0811 06:17:02.913801 (+ 1698us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:02.946275 (+ 32474us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x6160000160b8. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e40f03351 00007f3e53e1f376 00007f3e53d90420 00007f3e53d89d35 00007f3e53f8b46a 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25
0811 06:17:02.946767 (+ 492us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:02.961893 (+ 15126us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:02.962016 (+ 123us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:02.962112 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.947383 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.947546 (+ 163us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.947553 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:02.947556 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.947655 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.947669 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.947674 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:02.947833 (+ 159us) tablet.cc:699] Row locks acquired
0811 06:17:02.947836 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.947876 (+ 40us) write_op.cc:270] Start()
0811 06:17:02.947922 (+ 46us) write_op.cc:276] Timestamp: P: 1786429022947834 usec, L: 0
0811 06:17:02.947926 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.948108 (+ 182us) log.cc:842] Serialized 433 byte log entry
0811 06:17:02.958320 (+ 10212us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.958476 (+ 156us) write_op.cc:301] APPLY: starting
0811 06:17:02.958510 (+ 34us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.958568 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.958595 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.958712 (+ 117us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.958750 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:02.958757 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:02.958852 (+ 95us) log.cc:842] Serialized 29 byte log entry
0811 06:17:02.958932 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.958960 (+ 28us) write_op.cc:454] Released schema lock
0811 06:17:02.958969 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.959027 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.959030 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":72526208,"child_traces":[["op",{"apply.queue_time_us":97,"apply.run_cpu_time_us":610,"apply.run_wall_time_us":609,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":830,"prepare.run_wall_time_us":831,"raft.queue_time_us":68,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":225,"replication_time_us":10359}]]}
I20260811 06:17:02.964887 12726 tablet_replica.cc:330] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:02.965915 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:02.946019 11046 leader_election.cc:341] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae
I20260811 06:17:02.966251 12726 raft_consensus.cc:2229] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:02.966248 11046 leader_election.cc:302] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:02.966928 11046 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:02.967172 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:02.958148 12943 consensus_queue.cc:1035] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.967886 11362 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:02.968441 12774 raft_consensus.cc:2726] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:02.971117 12943 consensus_queue.cc:1035] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:02.969375 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:02.974329 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:02.981205 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:02.982789 12727 raft_consensus.cc:2258] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:02.981632 11588 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.124:45045, user_credentials={real_user=slave}} blocked reactor thread for 115910us
I20260811 06:17:02.988656 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:02.993494 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:02.993647 12726 raft_consensus.cc:2258] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:02.994503 12726 ts_tablet_manager.cc:1905] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:02.996672 11362 tablet_bootstrap.cc:654] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:02.998296 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:03.012825 12963 raft_consensus.cc:482] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.017838 12963 raft_consensus.cc:504] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.018698 12963 leader_election.cc:288] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:03.020386 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:03.021337 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:03.021943 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:03.023152 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:03.023630 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:03.023947 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:03.024346 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:03.025322 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:03.025775 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:03.026835 11361 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.027084 11361 ts_tablet_manager.cc:1397] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.111s user 0.003s sys 0.016s
I20260811 06:17:03.028103 11361 raft_consensus.cc:348] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.028630 11361 raft_consensus.cc:374] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.028820 11361 raft_consensus.cc:729] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.029186 11361 consensus_queue.cc:260] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.030804 12727 ts_tablet_manager.cc:1905] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.033815 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:03.034564 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:03.034986 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:03.035347 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:03.035934 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:03.036531 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:03.037066 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:03.037516 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:03.038226 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:03.038421 11361 ts_tablet_manager.cc:1428] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s
I20260811 06:17:03.038932 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:03.039331 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:03.039783 11361 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.039923 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:03.040469 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:03.042613 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.043110 10665 raft_consensus.cc:2454] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.044127 11361 tablet_bootstrap.cc:654] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.044930 11046 leader_election.cc:302] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.045507 12963 raft_consensus.cc:2781] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.045696 12963 raft_consensus.cc:482] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.045948 12963 raft_consensus.cc:3037] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.050911 12963 raft_consensus.cc:504] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.052623 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:03.052932 10651 raft_consensus.cc:3037] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.053292 12963 leader_election.cc:288] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:03.057642 10651 raft_consensus.cc:2454] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.058228 11046 leader_election.cc:302] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.059031 12963 raft_consensus.cc:2781] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.059438 12963 raft_consensus.cc:686] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.058962 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:03.060524 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:03.060777 12963 consensus_queue.cc:237] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.061019 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:03.061867 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:03.065429 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:03.065909 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:03.066380 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:03.066676 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:03.067061 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:03.067359 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:03.067796 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:03.070163 11365 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.070426 11365 ts_tablet_manager.cc:1397] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.141s user 0.003s sys 0.005s
I20260811 06:17:03.070540 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:03.071115 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:03.071442 11653 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:03.072009 11365 raft_consensus.cc:348] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.072280 11365 raft_consensus.cc:374] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.072502 11365 raft_consensus.cc:729] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.075729 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.076061 10922 raft_consensus.cc:2454] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.082502 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4f14a0add084048b92a501476ad6588" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.082806 10922 raft_consensus.cc:3037] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.087551 12943 consensus_queue.cc:1035] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260811 06:17:03.090270 11676 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 49) took 2707 ms. Trace:
I20260811 06:17:03.090560 11676 rpcz_store.cc:276] 0811 06:17:00.382250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.938837 (+2556587us) service_pool.cc:227] Handling call
0811 06:17:03.090105 (+151268us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:03.097355 12728 ts_tablet_manager.cc:1918] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.098258 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 50) took 2649 ms. Trace:
I20260811 06:17:03.098605 11672 rpcz_store.cc:276] 0811 06:17:00.449122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.965589 (+2516467us) service_pool.cc:227] Handling call
0811 06:17:03.098141 (+132552us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:03.099088 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet 1f48707b4fb746f49eaaf91b5b81e814 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:03.111374 11361 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.111678 11361 ts_tablet_manager.cc:1397] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.072s user 0.017s sys 0.020s
I20260811 06:17:03.113092 11361 raft_consensus.cc:348] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.113493 11361 raft_consensus.cc:374] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.113657 11361 raft_consensus.cc:729] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.114213 11361 consensus_queue.cc:260] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.115062 11361 ts_tablet_manager.cc:1428] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 06:17:03.115064 12728 log.cc:1196] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:03.115540 11361 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.117865 12728 ts_tablet_manager.cc:1939] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.118824 11361 tablet_bootstrap.cc:654] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.119371 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (table default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]) successfully deleted
I20260811 06:17:03.121587 10922 raft_consensus.cc:2454] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.122391 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:03.124029 11365 consensus_queue.cc:260] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:03.124353 10813 consensus_peers.cc:487] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:03.125638 11365 ts_tablet_manager.cc:1428] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.055s user 0.003s sys 0.000s
I20260811 06:17:03.131522 12728 tablet_replica.cc:330] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.135628 11365 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.151046 11365 tablet_bootstrap.cc:654] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.151254 12727 ts_tablet_manager.cc:1918] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.151592 12727 log.cc:1196] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:03.152901 12727 ts_tablet_manager.cc:1939] T 1c42b5ef0fc84627908200331f53b1a3 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.155583 11362 tablet_bootstrap.cc:492] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.155817 11362 ts_tablet_manager.cc:1397] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.188s user 0.004s sys 0.004s
I20260811 06:17:03.156401 12728 raft_consensus.cc:2229] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.158334 12728 raft_consensus.cc:2258] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.159839 11362 raft_consensus.cc:348] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.160456 11362 raft_consensus.cc:374] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.160976 11362 raft_consensus.cc:729] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.161396 11362 consensus_queue.cc:260] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.162077 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 1c42b5ef0fc84627908200331f53b1a3 (table default.Table_41fd7b3230944f5395bc21e68b708026 [id=0f621f2014f34e6a9de177f2843c8180]) successfully deleted
I20260811 06:17:03.160755 12728 ts_tablet_manager.cc:1905] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.167752 12727 tablet_replica.cc:330] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.169850 12727 raft_consensus.cc:2229] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.170217 11361 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.170233 12727 raft_consensus.cc:2258] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.170478 11361 ts_tablet_manager.cc:1397] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.004s
I20260811 06:17:03.171473 11362 ts_tablet_manager.cc:1428] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:17:03.171521 12727 ts_tablet_manager.cc:1905] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.172065 11362 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.172004 11361 raft_consensus.cc:348] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.172294 11361 raft_consensus.cc:374] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.172515 11361 raft_consensus.cc:729] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.172874 11361 consensus_queue.cc:260] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.175073 11361 ts_tablet_manager.cc:1428] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:17:03.177955 11361 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.179283 12726 ts_tablet_manager.cc:1918] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.181119 12726 log.cc:1196] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ea4eb7f5db2e4e75818bfb228b64ed0d
I20260811 06:17:03.185758 12726 ts_tablet_manager.cc:1939] T ea4eb7f5db2e4e75818bfb228b64ed0d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.186923 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ea4eb7f5db2e4e75818bfb228b64ed0d (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
I20260811 06:17:03.189162 11361 tablet_bootstrap.cc:654] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.189997 11362 tablet_bootstrap.cc:654] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.193462 12726 tablet_replica.cc:330] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:03.195561 12726 raft_consensus.cc:2229] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.195848 12726 raft_consensus.cc:2258] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.196760 12726 ts_tablet_manager.cc:1905] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.213949 12727 ts_tablet_manager.cc:1918] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.217778 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:03.219395 12726 ts_tablet_manager.cc:1918] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:03.219944 12727 log.cc:1196] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7db813cbb8f74b329015b163ebd58c00
I20260811 06:17:03.220813 12727 ts_tablet_manager.cc:1939] T 7db813cbb8f74b329015b163ebd58c00 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.221777 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 61) took 1040 ms. Trace:
I20260811 06:17:03.221928 12727 rpcz_store.cc:276] 0811 06:17:02.181476 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.181517 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:03.167613 (+986096us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:03.167623 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.185358 (+ 17735us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.213801 (+ 28443us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.221686 (+ 7885us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985799}
I20260811 06:17:03.222862 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 63) took 1037 ms. Trace:
I20260811 06:17:03.223050 12727 rpcz_store.cc:276] 0811 06:17:02.185706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.185786 (+ 80us) service_pool.cc:227] Handling call
0811 06:17:03.222519 (+1036733us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:03.222532 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.222686 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021096}
I20260811 06:17:03.223507 12727 tablet_replica.cc:330] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.223805 12727 raft_consensus.cc:2229] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.224238 12727 pending_rounds.cc:62] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:03.224383 12727 pending_rounds.cc:68] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213278014234624 op_type: NO_OP noop_request { }
I20260811 06:17:03.224877 12727 raft_consensus.cc:2866] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:03.225085 12727 raft_consensus.cc:2258] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.226435 12726 log.cc:1196] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:03.227186 12726 ts_tablet_manager.cc:1939] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.228967 11365 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.229192 11365 ts_tablet_manager.cc:1397] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.007s
I20260811 06:17:03.223955 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7db813cbb8f74b329015b163ebd58c00 (table default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]) successfully deleted
I20260811 06:17:03.230414 11365 raft_consensus.cc:348] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.230736 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:03.230856 11365 raft_consensus.cc:374] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:03.230868 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:03.231034 11365 raft_consensus.cc:729] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.231346 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:03.231416 11365 consensus_queue.cc:260] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.232471 11365 ts_tablet_manager.cc:1428] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 06:17:03.233395 12727 ts_tablet_manager.cc:1905] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.236799 11365 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.231856 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:03.237661 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:03.238076 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:03.238376 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:03.238762 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:03.239383 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:03.239692 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:03.240080 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:03.240362 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:03.240933 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (table default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]) successfully deleted
I20260811 06:17:03.241822 11365 tablet_bootstrap.cc:654] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.244202 12727 ts_tablet_manager.cc:1918] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.244709 12727 log.cc:1196] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:03.245198 12726 tablet_replica.cc:330] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:03.245543 12726 raft_consensus.cc:2229] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.245944 12726 raft_consensus.cc:2258] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.245993 12727 ts_tablet_manager.cc:1939] T 52ecffcf4a0e46428caed6f7d72199bd P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.247347 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 62) took 1062 ms. Trace:
I20260811 06:17:03.247579 12727 rpcz_store.cc:276] 0811 06:17:02.185156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.185201 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:03.223309 (+1038108us) ts_tablet_manager.cc:1145] Deleting tablet 52ecffcf4a0e46428caed6f7d72199bd
0811 06:17:03.223320 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.239617 (+ 16297us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.243542 (+ 3925us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.247257 (+ 3715us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021825}
I20260811 06:17:03.246670 12726 ts_tablet_manager.cc:1905] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.248342 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 52ecffcf4a0e46428caed6f7d72199bd (table default.Table_ae798943d2514f6488c7ae50b11ef679 [id=6265dc35475144bd9f4b3348ed37447a]) successfully deleted
I20260811 06:17:03.248896 12727 tablet_replica.cc:330] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.249387 12727 raft_consensus.cc:2229] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.249866 12727 raft_consensus.cc:2258] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.251127 12727 ts_tablet_manager.cc:1905] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.252492 11361 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.252810 11361 ts_tablet_manager.cc:1397] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.009s
I20260811 06:17:03.254884 11361 raft_consensus.cc:348] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.255333 11361 raft_consensus.cc:374] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.255512 11361 raft_consensus.cc:729] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.256511 11362 tablet_bootstrap.cc:492] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.256786 11362 ts_tablet_manager.cc:1397] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.003s
I20260811 06:17:03.258256 11362 raft_consensus.cc:348] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.258705 11362 raft_consensus.cc:374] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.259732 11361 consensus_queue.cc:260] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.260558 11361 ts_tablet_manager.cc:1428] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260811 06:17:03.240939 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:03.261152 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:03.261495 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:03.261624 11362 raft_consensus.cc:729] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.262038 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:03.263026 12727 ts_tablet_manager.cc:1918] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.263244 12727 log.cc:1196] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/285b85c854bf400295b288314947840e
I20260811 06:17:03.263631 11362 consensus_queue.cc:260] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.263965 12727 ts_tablet_manager.cc:1939] T 285b85c854bf400295b288314947840e P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.264314 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:03.265360 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:03.266109 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:03.267190 11361 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.269228 11362 ts_tablet_manager.cc:1428] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.002s sys 0.002s
I20260811 06:17:03.270445 11362 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.270812 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 65) took 1084 ms. Trace:
I20260811 06:17:03.271040 12727 rpcz_store.cc:276] 0811 06:17:02.186749 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.186835 (+ 86us) service_pool.cc:227] Handling call
0811 06:17:03.248681 (+1061846us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:03.248693 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.256052 (+ 7359us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.262854 (+ 6802us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.270695 (+ 7841us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1047134}
I20260811 06:17:03.271942 11361 tablet_bootstrap.cc:654] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.274055 11365 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.272841 11362 tablet_bootstrap.cc:654] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.274238 11365 ts_tablet_manager.cc:1397] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.007s
I20260811 06:17:03.275594 11365 raft_consensus.cc:348] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.275992 11365 raft_consensus.cc:374] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.276257 11365 raft_consensus.cc:729] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.276671 11365 consensus_queue.cc:260] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.277891 12728 ts_tablet_manager.cc:1918] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.278154 12728 log.cc:1196] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/fe5eea681072477ab52a822d721629cf
I20260811 06:17:03.278914 12728 ts_tablet_manager.cc:1939] T fe5eea681072477ab52a822d721629cf P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.272440 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 285b85c854bf400295b288314947840e (table default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]) successfully deleted
I20260811 06:17:03.279595 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:03.279778 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 58) took 1095 ms. Trace:
I20260811 06:17:03.280001 12728 rpcz_store.cc:276] 0811 06:17:02.184598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.184765 (+ 167us) service_pool.cc:227] Handling call
0811 06:17:03.129370 (+944605us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:17:03.129386 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.193292 (+ 63906us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.277658 (+ 84366us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.279738 (+ 2080us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":943745}
I20260811 06:17:03.281147 11365 ts_tablet_manager.cc:1428] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:17:03.282164 11365 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.280695 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet fe5eea681072477ab52a822d721629cf (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
I20260811 06:17:03.284113 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:03.285948 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:03.286338 12728 tablet_replica.cc:330] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.286612 12728 raft_consensus.cc:2229] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.286840 12728 raft_consensus.cc:2258] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.287408 11365 tablet_bootstrap.cc:654] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.287513 12728 ts_tablet_manager.cc:1905] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.287981 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:03.289305 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:03.290074 12727 tablet_replica.cc:330] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.290357 12727 raft_consensus.cc:2229] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.290614 12727 raft_consensus.cc:2258] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.293329 12727 ts_tablet_manager.cc:1905] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.294154 12726 ts_tablet_manager.cc:1918] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.294363 12726 log.cc:1196] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:03.295020 12726 ts_tablet_manager.cc:1939] T 1c42b5ef0fc84627908200331f53b1a3 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.296027 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 52) took 1042 ms. Trace:
I20260811 06:17:03.297334 11362 tablet_bootstrap.cc:492] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.297591 11362 ts_tablet_manager.cc:1397] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.004s
I20260811 06:17:03.298913 11362 raft_consensus.cc:348] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.299175 11362 raft_consensus.cc:374] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.299388 11362 raft_consensus.cc:729] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.299729 11362 consensus_queue.cc:260] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.300104 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:03.300566 11362 ts_tablet_manager.cc:1428] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:03.300905 12726 rpcz_store.cc:276] 0811 06:17:02.253158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.253618 (+ 460us) service_pool.cc:227] Handling call
0811 06:17:03.244108 (+990490us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:17:03.244990 (+ 882us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.263055 (+ 18065us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.293906 (+ 30851us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.295925 (+ 2019us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":990044}
I20260811 06:17:03.301504 12726 tablet_replica.cc:330] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:03.301733 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1c42b5ef0fc84627908200331f53b1a3 (table default.Table_41fd7b3230944f5395bc21e68b708026 [id=0f621f2014f34e6a9de177f2843c8180]) successfully deleted
I20260811 06:17:03.300571 11663 catalog_manager.cc:5495] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:03.306967 12726 raft_consensus.cc:2229] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.310803 12726 raft_consensus.cc:2258] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.311621 11362 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.320194 12726 ts_tablet_manager.cc:1905] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.320564 11361 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.320812 11361 ts_tablet_manager.cc:1397] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.007s
I20260811 06:17:03.322044 11361 raft_consensus.cc:348] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.322441 11361 raft_consensus.cc:374] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.322669 11361 raft_consensus.cc:729] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.322983 11361 consensus_queue.cc:260] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.324326 11361 ts_tablet_manager.cc:1428] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:03.324761 11361 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.327910 11361 tablet_bootstrap.cc:654] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.331558 12727 ts_tablet_manager.cc:1918] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.331840 12727 log.cc:1196] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:17:03.332598 12727 ts_tablet_manager.cc:1939] T 9ac8c5daeb3249e38d863ee94f1267b1 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.333787 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 66) took 1146 ms. Trace:
I20260811 06:17:03.333956 12727 rpcz_store.cc:276] 0811 06:17:02.186954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.187010 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:03.271512 (+1084502us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:03.286739 (+ 15227us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.297083 (+ 10344us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.331425 (+ 34342us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.333670 (+ 2245us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069923}
I20260811 06:17:03.335186 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 9ac8c5daeb3249e38d863ee94f1267b1 (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]) successfully deleted
I20260811 06:17:03.335649 12727 tablet_replica.cc:330] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.336068 12727 raft_consensus.cc:2229] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.336956 12484 raft_consensus.cc:482] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.337114 12484 raft_consensus.cc:504] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.337870 12484 leader_election.cc:288] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:03.339251 11047 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
I20260811 06:17:03.340600 12727 raft_consensus.cc:2258] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.341625 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:03.342159 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:03.342461 11362 tablet_bootstrap.cc:654] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.342440 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:03.342743 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:03.343633 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:03.344447 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
W20260811 06:17:03.344542 11046 leader_election.cc:341] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
I20260811 06:17:03.344794 11046 leader_election.cc:302] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.345798 12484 raft_consensus.cc:2726] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:03.345896 12727 ts_tablet_manager.cc:1905] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.346774 12728 ts_tablet_manager.cc:1918] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.347064 12728 log.cc:1196] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/0bbf657cb27f4da9a4f595242864163a
I20260811 06:17:03.347661 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:03.347765 12728 ts_tablet_manager.cc:1939] T 0bbf657cb27f4da9a4f595242864163a P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.347822 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:03.348245 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 59) took 1163 ms. Trace:
I20260811 06:17:03.348402 12728 rpcz_store.cc:276] 0811 06:17:02.184727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.184806 (+ 79us) service_pool.cc:227] Handling call
0811 06:17:03.286184 (+1101378us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:17:03.286250 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.314986 (+ 28736us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.346603 (+ 31617us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.348183 (+ 1580us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100144}
I20260811 06:17:03.349023 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 0bbf657cb27f4da9a4f595242864163a (table default.Table_3ae91f4b99784386b61c6b22b804b906 [id=e3f87a09fef5439a9dbc3d579d073d62]) successfully deleted
I20260811 06:17:03.358253 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:03.358723 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 61) took 1160 ms. Trace:
I20260811 06:17:03.359822 12363 rpc_server.cc:307] RPC server started. Bound to: 127.9.203.124:45045
I20260811 06:17:03.360287 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:03.363354 13064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.203.124:45045 every 8 connection(s)
I20260811 06:17:03.363746 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:03.364068 11361 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.364483 11361 ts_tablet_manager.cc:1397] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.004s
I20260811 06:17:03.365319 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:03.365427 12363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
I20260811 06:17:03.358979 12728 rpcz_store.cc:276] 0811 06:17:02.198122 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.198165 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:03.358120 (+1159955us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:03.358136 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.358528 (+ 392us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159552}
W20260811 06:17:03.366279 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:03.366698 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:03.367302 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 63) took 1167 ms. Trace:
I20260811 06:17:03.367393 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:03.367470 12728 rpcz_store.cc:276] 0811 06:17:02.199596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.199816 (+ 220us) service_pool.cc:227] Handling call
0811 06:17:03.366768 (+1166952us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:17:03.366784 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.367161 (+ 377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1166637}
I20260811 06:17:03.367750 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
W20260811 06:17:03.368178 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 already in progress: creating tablet
I20260811 06:17:03.368460 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:03.368948 12728 tablet_replica.cc:330] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.369295 12728 raft_consensus.cc:2229] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.369357 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:03.370162 11362 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.370429 11362 ts_tablet_manager.cc:1397] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.009s
I20260811 06:17:03.371755 10029 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu as pid 12363
I20260811 06:17:03.370591 12728 raft_consensus.cc:2258] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.371785 11362 raft_consensus.cc:348] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.372359 11362 raft_consensus.cc:374] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.372524 11362 raft_consensus.cc:729] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.373788 12821 raft_consensus.cc:482] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.374109 12821 raft_consensus.cc:504] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.375535 12728 ts_tablet_manager.cc:1905] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.375981 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.376020 11362 consensus_queue.cc:260] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.377118 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.378448 12821 leader_election.cc:288] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:03.378876 10564 leader_election.cc:341] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:03.379312 10555 leader_election.cc:341] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.379503 10555 leader_election.cc:302] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.380192 12944 raft_consensus.cc:482] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.380455 12944 raft_consensus.cc:504] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.382133 12944 leader_election.cc:288] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.382952 12821 raft_consensus.cc:2726] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:03.383697 10810 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: b0d203f652b24b4897e62fc8c03d32df
W20260811 06:17:03.384043 10813 leader_election.cc:341] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: b0d203f652b24b4897e62fc8c03d32df
I20260811 06:17:03.384274 10813 leader_election.cc:302] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.384778 12944 raft_consensus.cc:2726] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.366142 11361 raft_consensus.cc:348] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.385759 11361 raft_consensus.cc:374] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.386603 11362 ts_tablet_manager.cc:1428] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.016s user 0.000s sys 0.003s
I20260811 06:17:03.386636 11361 raft_consensus.cc:729] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.390591 11365 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.390938 11365 ts_tablet_manager.cc:1397] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.109s user 0.014s sys 0.010s
I20260811 06:17:03.388897 11361 consensus_queue.cc:260] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.392414 11361 ts_tablet_manager.cc:1428] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.028s user 0.003s sys 0.002s
I20260811 06:17:03.392603 11365 raft_consensus.cc:348] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.393025 11365 raft_consensus.cc:374] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.393165 11365 raft_consensus.cc:729] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.393496 11362 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.395485 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:03.396028 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:03.396335 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:03.396831 11361 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.396572 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:03.399394 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:03.399845 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:03.401090 12728 ts_tablet_manager.cc:1918] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.401424 12728 log.cc:1196] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:03.396822 11365 consensus_queue.cc:260] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.405704 11365 ts_tablet_manager.cc:1428] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260811 06:17:03.406595 12728 ts_tablet_manager.cc:1939] T 1c42b5ef0fc84627908200331f53b1a3 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.407119 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 64) took 1206 ms. Trace:
I20260811 06:17:03.407487 12728 rpcz_store.cc:276] 0811 06:17:02.200276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.200458 (+ 182us) service_pool.cc:227] Handling call
0811 06:17:03.368046 (+1167588us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:17:03.368058 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.384833 (+ 16775us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.389444 (+ 4611us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.407081 (+ 17637us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167325}
I20260811 06:17:03.407991 11365 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.408191 12728 tablet_replica.cc:330] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.409072 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 1c42b5ef0fc84627908200331f53b1a3 (table default.Table_41fd7b3230944f5395bc21e68b708026 [id=0f621f2014f34e6a9de177f2843c8180]) successfully deleted
I20260811 06:17:03.409240 12728 raft_consensus.cc:2229] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.409564 12728 raft_consensus.cc:2258] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.410485 12728 ts_tablet_manager.cc:1905] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.413618 11365 tablet_bootstrap.cc:654] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.415234 11362 tablet_bootstrap.cc:654] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.424958 12726 ts_tablet_manager.cc:1918] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:03.397130 12484 raft_consensus.cc:482] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.425968 12963 raft_consensus.cc:482] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.426165 12484 raft_consensus.cc:504] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.426232 12963 raft_consensus.cc:504] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.427897 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.428238 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.428573 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.428900 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.429530 10655 raft_consensus.cc:2454] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.429628 12484 leader_election.cc:288] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:03.429811 11047 leader_election.cc:341] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.430127 10651 raft_consensus.cc:2454] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:03.430238 11047 leader_election.cc:341] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.430663 12726 log.cc:1196] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/cdb93dcd940a47e78c5458041c768e36
I20260811 06:17:03.432042 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 1f48707b4fb746f49eaaf91b5b81e814
I20260811 06:17:03.432672 11672 catalog_manager.cc:6565] ReplaceTablet: tablet 1f48707b4fb746f49eaaf91b5b81e814 deleted and replaced by tablet 524db95e51fe444497aa1c558bd4539a
I20260811 06:17:03.432977 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 51) took 2487 ms. Trace:
I20260811 06:17:03.433238 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:03.433882 11046 leader_election.cc:302] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.433164 11672 rpcz_store.cc:276] 0811 06:17:00.945522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.098890 (+2153368us) service_pool.cc:227] Handling call
0811 06:17:03.432757 (+333867us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:03.421105 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:03.421253 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:03.421260 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:03.421263 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:03.421399 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:03.421414 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:03.421419 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:03.421508 (+ 89us) tablet.cc:699] Row locks acquired
0811 06:17:03.421511 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:03.421551 (+ 40us) write_op.cc:270] Start()
0811 06:17:03.421588 (+ 37us) write_op.cc:276] Timestamp: P: 1786429023421509 usec, L: 0
0811 06:17:03.421592 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:03.421843 (+ 251us) log.cc:842] Serialized 625 byte log entry
0811 06:17:03.430866 (+ 9023us) op_driver.cc:444] REPLICATION: finished
0811 06:17:03.431035 (+ 169us) write_op.cc:301] APPLY: starting
0811 06:17:03.431057 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:03.431108 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:03.431182 (+ 74us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:03.431315 (+ 133us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:03.431376 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:03.431383 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:03.431480 (+ 97us) log.cc:842] Serialized 29 byte log entry
0811 06:17:03.431558 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.431586 (+ 28us) write_op.cc:454] Released schema lock
0811 06:17:03.431594 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:03.431667 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.431671 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":695,"apply.run_wall_time_us":694,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":866,"prepare.run_wall_time_us":868,"raft.queue_time_us":167,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257,"replication_time_us":9242}]]}
I20260811 06:17:03.434190 12483 raft_consensus.cc:2781] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.434387 12963 leader_election.cc:288] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.434554 12483 raft_consensus.cc:482] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.434687 12483 raft_consensus.cc:3037] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.435564 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:03.437826 11046 leader_election.cc:302] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.439124 12774 raft_consensus.cc:2781] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.439350 12774 raft_consensus.cc:482] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.439489 12774 raft_consensus.cc:3037] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.443238 12728 ts_tablet_manager.cc:1918] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.444087 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:03.431625 12726 ts_tablet_manager.cc:1939] T cdb93dcd940a47e78c5458041c768e36 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.447412 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 53) took 1189 ms. Trace:
I20260811 06:17:03.450548 12726 rpcz_store.cc:276] 0811 06:17:02.257960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.258506 (+ 546us) service_pool.cc:227] Handling call
0811 06:17:03.301358 (+1042852us) ts_tablet_manager.cc:1145] Deleting tablet cdb93dcd940a47e78c5458041c768e36
0811 06:17:03.301371 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.361440 (+ 60069us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.424816 (+ 63376us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.447348 (+ 22532us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042504}
I20260811 06:17:03.452629 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet cdb93dcd940a47e78c5458041c768e36 (table default.Table_889fe834de014fd8add63e0a4fec5334 [id=16a23a037e8c4fb8946fd77eb4629e06]) successfully deleted
I20260811 06:17:03.453310 12821 raft_consensus.cc:482] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.452715 12774 raft_consensus.cc:504] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.453524 12821 raft_consensus.cc:504] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.454358 12821 leader_election.cc:288] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.455174 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.455515 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.455502 12483 raft_consensus.cc:504] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.456108 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:03.456315 10555 leader_election.cc:341] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.456386 12483 leader_election.cc:288] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.456559 10651 raft_consensus.cc:3037] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.456907 12774 leader_election.cc:288] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.457784 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "847df543db4244a6b2900fc16fea7c07" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:03.458420 10564 leader_election.cc:341] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:03.458539 11047 leader_election.cc:341] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.458722 10564 leader_election.cc:302] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.459045 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.459421 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:03.459774 11047 leader_election.cc:341] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.459872 10655 raft_consensus.cc:3037] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.395114 12727 ts_tablet_manager.cc:1918] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.460564 12727 log.cc:1196] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a4a46cec25944310a838d8323b119883
I20260811 06:17:03.460810 11362 tablet_bootstrap.cc:492] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.461177 11362 ts_tablet_manager.cc:1397] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.004s
I20260811 06:17:03.461946 12821 raft_consensus.cc:2726] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.462244 12728 log.cc:1196] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/d668bcfbeff54181ba3b4407b1eb5704
I20260811 06:17:03.462328 12727 ts_tablet_manager.cc:1939] T a4a46cec25944310a838d8323b119883 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.463382 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 64) took 1277 ms. Trace:
I20260811 06:17:03.463603 12727 rpcz_store.cc:276] 0811 06:17:02.186245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.186292 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:03.335435 (+1149143us) ts_tablet_manager.cc:1145] Deleting tablet a4a46cec25944310a838d8323b119883
0811 06:17:03.335448 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.355786 (+ 20338us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.394879 (+ 39093us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.463340 (+ 68461us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133778}
I20260811 06:17:03.464290 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a4a46cec25944310a838d8323b119883 (table default.Table_21f0b9c149d7498e8ba846e4f3adb056 [id=cba6e77528e14ab3a7f179586ccde125]) successfully deleted
I20260811 06:17:03.464423 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 67) took 1276 ms. Trace:
I20260811 06:17:03.463656 11362 raft_consensus.cc:348] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.464687 12727 rpcz_store.cc:276] 0811 06:17:02.187489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.188097 (+ 608us) service_pool.cc:227] Handling call
0811 06:17:03.464107 (+1276010us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:17:03.464119 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.464303 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258380}
W20260811 06:17:03.465176 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532208d7a02d448e8dac702ffe6c2ffc already in progress: creating tablet
I20260811 06:17:03.462919 13074 sys_catalog.cc:263] Verifying existing consensus state
I20260811 06:17:03.464653 12728 ts_tablet_manager.cc:1939] T d668bcfbeff54181ba3b4407b1eb5704 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.467767 11361 tablet_bootstrap.cc:654] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.466410 11362 raft_consensus.cc:374] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.468276 11362 raft_consensus.cc:729] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.468566 11362 consensus_queue.cc:260] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.469053 10655 raft_consensus.cc:2454] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.469991 10651 raft_consensus.cc:2454] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.471627 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 54) took 1194 ms. Trace:
I20260811 06:17:03.473272 11046 leader_election.cc:302] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.473949 11046 leader_election.cc:302] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.474469 11362 ts_tablet_manager.cc:1428] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20260811 06:17:03.474743 12726 rpcz_store.cc:276] 0811 06:17:02.259147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.259768 (+ 621us) service_pool.cc:227] Handling call
0811 06:17:03.453892 (+1194124us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:03.453907 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.454056 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1193655}
I20260811 06:17:03.475207 12774 raft_consensus.cc:2781] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.475574 12774 raft_consensus.cc:686] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.476347 12774 consensus_queue.cc:237] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:03.478062 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:03.478932 12726 tablet_replica.cc:330] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:03.479763 11362 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.480628 12483 raft_consensus.cc:2781] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.481017 12483 raft_consensus.cc:686] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.481863 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 65) took 1280 ms. Trace:
I20260811 06:17:03.481899 13074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Bootstrap starting.
I20260811 06:17:03.482084 12728 rpcz_store.cc:276] 0811 06:17:02.200937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.201142 (+ 205us) service_pool.cc:227] Handling call
0811 06:17:03.408045 (+1206903us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:03.408059 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.426481 (+ 18422us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.443086 (+ 16605us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.481665 (+ 38579us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206701}
I20260811 06:17:03.482368 12726 raft_consensus.cc:2229] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.482738 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet d668bcfbeff54181ba3b4407b1eb5704 (table default.Table_16798efef90c476e88ece60ceda20557 [id=41effa9bdd8c47bca930b230e16c6091]) successfully deleted
I20260811 06:17:03.482764 12726 raft_consensus.cc:2258] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.483526 12726 ts_tablet_manager.cc:1905] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.484474 12728 tablet_replica.cc:330] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.484445 12483 consensus_queue.cc:237] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.484813 12728 raft_consensus.cc:2229] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.485357 12728 raft_consensus.cc:2258] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.490688 11362 tablet_bootstrap.cc:654] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.493774 12728 ts_tablet_manager.cc:1905] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.507095 12483 raft_consensus.cc:482] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.507493 12483 raft_consensus.cc:504] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.509388 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:03.510197 11047 leader_election.cc:341] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.514264 12483 leader_election.cc:288] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.514703 12727 tablet_replica.cc:330] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.515246 12727 raft_consensus.cc:2229] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.515549 12727 raft_consensus.cc:2258] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.516785 12727 ts_tablet_manager.cc:1905] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.517856 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:03.520718 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:03.526902 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.527336 10651 raft_consensus.cc:2454] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.528328 11365 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.528501 11365 ts_tablet_manager.cc:1397] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.122s user 0.001s sys 0.005s
I20260811 06:17:03.529771 11365 raft_consensus.cc:348] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.530144 12774 raft_consensus.cc:482] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.530201 11365 raft_consensus.cc:374] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.530407 11365 raft_consensus.cc:729] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.530329 12774 raft_consensus.cc:504] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.530822 11365 consensus_queue.cc:260] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.531620 11046 leader_election.cc:302] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.532265 12484 raft_consensus.cc:2781] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.532428 12484 raft_consensus.cc:482] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.532537 12484 raft_consensus.cc:3037] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.533766 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.534126 10665 raft_consensus.cc:2454] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.534834 11046 leader_election.cc:302] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.535172 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:03.535305 12094 raft_consensus.cc:2781] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.535706 12094 raft_consensus.cc:482] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.535928 12094 raft_consensus.cc:3037] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.536224 12774 leader_election.cc:288] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.538666 11365 ts_tablet_manager.cc:1428] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260811 06:17:03.545554 11365 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.556707 12484 raft_consensus.cc:504] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.558548 12094 raft_consensus.cc:504] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.560490 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:03.560995 10655 raft_consensus.cc:3037] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.563804 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 2848d8141dc44846878fcb3e1011003d (DEFAULT_TABLE table=default.Table_8691c9b01d514e36803289085cb4c93d [id=e8c4519f457d4adc87d1ea07874e5d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.564584 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2848d8141dc44846878fcb3e1011003d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.567198 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a (DEFAULT_TABLE table=default.Table_cbef4a2446cd4a37bd3907ccd1ce6804 [id=2525ab74888047c5ba8f545eb5a87fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.570654 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 2848d8141dc44846878fcb3e1011003d (DEFAULT_TABLE table=default.Table_8691c9b01d514e36803289085cb4c93d [id=e8c4519f457d4adc87d1ea07874e5d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.571557 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2848d8141dc44846878fcb3e1011003d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.574652 11101 tablet_service.cc:1467] Processing CreateTablet for tablet ffbcb6061e544b5cb1a31bf1175fb0ba (DEFAULT_TABLE table=default.Table_e631da66bfa04a7596d0d39becf5be95 [id=cd5494dd48bf459d8291bf472a20ae05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.575758 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbcb6061e544b5cb1a31bf1175fb0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.578123 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:03.578466 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:03.578707 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a (DEFAULT_TABLE table=default.Table_cbef4a2446cd4a37bd3907ccd1ce6804 [id=2525ab74888047c5ba8f545eb5a87fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.578805 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:03.579658 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.579877 12094 leader_election.cc:288] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.580654 12484 leader_election.cc:288] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.581825 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:03.582697 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:03.583407 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:03.584029 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:03.584582 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:03.585098 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:03.585644 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:03.586323 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:03.586817 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:03.587249 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:03.587738 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:03.588122 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:03.588461 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:03.588987 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:03.589483 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:03.589962 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:03.590368 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:03.591224 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:03.591642 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:03.592422 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:03.593060 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:03.593545 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:03.594086 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:03.594883 11683 catalog_manager.cc:5495] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:03.595944 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:03.596462 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:03.596880 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:03.597437 11683 catalog_manager.cc:5495] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:03.598179 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:03.598773 11683 catalog_manager.cc:5495] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:03.599638 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:03.600044 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:03.601326 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:03.602118 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:03.602531 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:03.603133 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:03.603592 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:03.603991 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:03.604534 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:03.604938 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:03.605233 11683 catalog_manager.cc:5495] T 8b8b12e80bc54e58a63d45bde8faac89 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:03.606179 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:03.606474 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:03.606853 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:03.607192 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:03.607672 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:03.608026 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:03.608471 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:03.613344 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.617053 10632 tablet_service.cc:1467] Processing CreateTablet for tablet ffbcb6061e544b5cb1a31bf1175fb0ba (DEFAULT_TABLE table=default.Table_e631da66bfa04a7596d0d39becf5be95 [id=cd5494dd48bf459d8291bf472a20ae05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.618213 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbcb6061e544b5cb1a31bf1175fb0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.628710 11365 tablet_bootstrap.cc:654] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.629957 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:03.630314 10665 raft_consensus.cc:3037] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.632334 12483 consensus_queue.cc:1035] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.641500 11361 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.641808 11361 ts_tablet_manager.cc:1397] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.246s user 0.056s sys 0.031s
I20260811 06:17:03.643226 11361 raft_consensus.cc:348] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.643602 11361 raft_consensus.cc:374] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.643831 11361 raft_consensus.cc:729] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.644644 11361 consensus_queue.cc:260] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.645581 11361 ts_tablet_manager.cc:1428] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:03.649235 12821 raft_consensus.cc:482] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.649441 11361 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.649577 12821 raft_consensus.cc:504] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.650619 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.651706 12943 raft_consensus.cc:482] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.651878 12943 raft_consensus.cc:504] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.651866 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.652513 12943 leader_election.cc:288] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.654197 11361 tablet_bootstrap.cc:654] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:03.661399 11047 leader_election.cc:341] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.662420 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cae52ba275f4d2fbd7014a1c6c01dc0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.666371 12944 consensus_queue.cc:1035] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.138s
I20260811 06:17:03.683220 10918 raft_consensus.cc:3037] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.683511 12727 ts_tablet_manager.cc:1918] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.684360 12578 consensus_queue.cc:1035] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260811 06:17:03.681613 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.686615 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.690434 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.690845 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a (DEFAULT_TABLE table=default.Table_cbef4a2446cd4a37bd3907ccd1ce6804 [id=2525ab74888047c5ba8f545eb5a87fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.692068 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 2848d8141dc44846878fcb3e1011003d (DEFAULT_TABLE table=default.Table_8691c9b01d514e36803289085cb4c93d [id=e8c4519f457d4adc87d1ea07874e5d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.693152 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ca3f61e9ac04ade9d4a68fe198cd77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.697880 10855 tablet_service.cc:1467] Processing CreateTablet for tablet ffbcb6061e544b5cb1a31bf1175fb0ba (DEFAULT_TABLE table=default.Table_e631da66bfa04a7596d0d39becf5be95 [id=cd5494dd48bf459d8291bf472a20ae05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:03.699774 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2848d8141dc44846878fcb3e1011003d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.700744 12728 ts_tablet_manager.cc:1918] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.700784 12727 log.cc:1196] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/37e73b8798b2455baf642abc532a5d8c
I20260811 06:17:03.700894 12728 log.cc:1196] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:17:03.701272 12727 ts_tablet_manager.cc:1939] T 37e73b8798b2455baf642abc532a5d8c P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.701296 12728 ts_tablet_manager.cc:1939] T 9ac8c5daeb3249e38d863ee94f1267b1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.701654 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 66) took 1500 ms. Trace:
I20260811 06:17:03.701810 12728 rpcz_store.cc:276] 0811 06:17:02.201599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.201826 (+ 227us) service_pool.cc:227] Handling call
0811 06:17:03.484227 (+1282401us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:03.484245 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.503976 (+ 19731us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.691867 (+187891us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.701620 (+ 9753us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282140}
I20260811 06:17:03.702185 12728 tablet_replica.cc:330] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.702611 12728 raft_consensus.cc:2229] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.702629 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 9ac8c5daeb3249e38d863ee94f1267b1 (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]) successfully deleted
I20260811 06:17:03.703083 12728 raft_consensus.cc:2258] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.703841 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 68) took 1515 ms. Trace:
I20260811 06:17:03.703972 12727 rpcz_store.cc:276] 0811 06:17:02.188385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.188642 (+ 257us) service_pool.cc:227] Handling call
0811 06:17:03.472807 (+1284165us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:17:03.472823 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.626541 (+153718us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.653564 (+ 27023us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.703753 (+ 50189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266980}
I20260811 06:17:03.704596 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 37e73b8798b2455baf642abc532a5d8c (table default.Table_24b24206598e4f27a32cabb7ed03ed3e [id=4bc106defb5246f6b2ceed8c51ba1516]) successfully deleted
I20260811 06:17:03.706125 11362 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:03.706496 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 69) took 1513 ms. Trace:
I20260811 06:17:03.707973 12727 rpcz_store.cc:276] 0811 06:17:02.192102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.192626 (+ 524us) service_pool.cc:227] Handling call
0811 06:17:03.705516 (+1512890us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:17:03.705576 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.705760 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499635}
W20260811 06:17:03.709532 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f243c792a634abf83484aef820dbb48 already in progress: creating tablet
I20260811 06:17:03.710359 12727 tablet_replica.cc:330] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.711365 12727 raft_consensus.cc:2229] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.712529 12727 raft_consensus.cc:2258] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:03.713021 10813 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:03.715167 11047 leader_election.cc:341] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:03.716500 11047 leader_election.cc:341] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.715466 12483 consensus_queue.cc:1035] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.716931 12094 consensus_queue.cc:1035] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.717363 12483 raft_consensus.cc:482] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.717483 12483 raft_consensus.cc:504] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.718195 12483 leader_election.cc:288] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.719738 12727 ts_tablet_manager.cc:1905] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:03.719944 10564 leader_election.cc:341] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:03.722185 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 67798.3us
I20260811 06:17:03.723309 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.724217 12821 leader_election.cc:288] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.724555 12483 consensus_queue.cc:1035] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.725654 10663 raft_consensus.cc:2454] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.727413 11046 leader_election.cc:302] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.728358 12821 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.728849 12483 raft_consensus.cc:2781] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.728981 12483 raft_consensus.cc:482] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.729228 12483 raft_consensus.cc:3037] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.730362 12821 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.731065 12821 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.731302 12821 raft_consensus.cc:482] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.731546 12821 raft_consensus.cc:504] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.732409 12821 leader_election.cc:288] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.734395 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.734666 11159 raft_consensus.cc:2454] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:03.734479 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.742074 10665 raft_consensus.cc:2454] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:03.743206 10555 leader_election.cc:341] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.744527 10555 leader_election.cc:302] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.746536 13098 raft_consensus.cc:2726] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.748510 13074 log.cc:824] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Log is configured to *not* fsync() on all Append() calls
I20260811 06:17:03.751085 10564 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.759248 13098 raft_consensus.cc:2781] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260811 06:17:03.759912 10564 leader_election.cc:341] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.760543 11046 leader_election.cc:302] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.761225 12774 raft_consensus.cc:2781] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.761574 12774 raft_consensus.cc:686] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.763151 12774 consensus_queue.cc:237] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.764261 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:03.764937 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:03.765100 13098 raft_consensus.cc:482] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.765301 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:03.765353 13098 raft_consensus.cc:3037] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:17:03.769936 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:03.770736 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:03.771325 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:03.771669 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:03.772190 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:03.772683 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:03.773051 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:03.773241 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:03.773450 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:03.773914 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d24d909b82640a386b612fba1f38fac (table default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99]). Expected version 1 got 0
I20260811 06:17:03.774154 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:03.778193 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:03.778545 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:03.778729 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:03.778951 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:03.779150 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:03.779381 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:03.779560 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:03.779803 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:03.780081 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:03.780426 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:03.780680 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:03.780905 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:03.781450 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 107bf6921c6e40f2a337dccc302c8856 (table default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b]). Expected version 1 got 0
I20260811 06:17:03.781839 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7246e1f0cdb049c6855b8bdbd42936f6 (table default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa]). Expected version 2 got 0
I20260811 06:17:03.782116 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:03.782217 12578 raft_consensus.cc:482] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.782433 11362 ts_tablet_manager.cc:1397] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.227s user 0.002s sys 0.024s
I20260811 06:17:03.782611 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbcb6061e544b5cb1a31bf1175fb0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:03.782632 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:03.783298 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.785897 12728 ts_tablet_manager.cc:1905] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.782944 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:03.793107 12963 raft_consensus.cc:482] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.793334 12963 raft_consensus.cc:504] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.794052 12963 leader_election.cc:288] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.794412 12727 ts_tablet_manager.cc:1918] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:03.794601 12727 log.cc:1196] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/9c5fa9633057485b917f117819d79398
I20260811 06:17:03.795372 12727 ts_tablet_manager.cc:1939] T 9c5fa9633057485b917f117819d79398 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.795753 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 70) took 1602 ms. Trace:
I20260811 06:17:03.795881 12727 rpcz_store.cc:276] 0811 06:17:02.193160 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.193505 (+ 345us) service_pool.cc:227] Handling call
0811 06:17:03.710110 (+1516605us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:17:03.710125 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.738841 (+ 28716us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.794151 (+ 55310us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.795716 (+ 1565us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1504181}
I20260811 06:17:03.796309 12727 tablet_replica.cc:330] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.796602 12727 raft_consensus.cc:2229] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.796800 12727 raft_consensus.cc:2258] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.797508 12727 ts_tablet_manager.cc:1905] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.759028 10655 raft_consensus.cc:2454] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.800212 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 9c5fa9633057485b917f117819d79398 (table default.Table_2bc3fd5062864693aa7108fd630a0c63 [id=23737dbd5b7142a3b945ae38971e14c4]) successfully deleted
I20260811 06:17:03.801754 11046 leader_election.cc:302] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.802261 12484 raft_consensus.cc:2781] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.802423 12484 raft_consensus.cc:686] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.802772 12484 consensus_queue.cc:237] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.809062 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.809003 11362 raft_consensus.cc:348] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.810346 11362 raft_consensus.cc:374] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.810493 11362 raft_consensus.cc:729] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.811272 11362 consensus_queue.cc:260] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.811914 11362 ts_tablet_manager.cc:1428] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260811 06:17:03.809448 12578 raft_consensus.cc:504] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.812819 11362 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:03.813967 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.816306 12578 leader_election.cc:288] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.816170 12483 raft_consensus.cc:504] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.817147 12483 leader_election.cc:288] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.817809 10918 raft_consensus.cc:3037] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.822304 11365 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:03.822571 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:03.823844 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:03.824380 10915 raft_consensus.cc:2454] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.824299 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
W20260811 06:17:03.832079 11047 leader_election.cc:341] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.832259 11362 tablet_bootstrap.cc:654] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.833065 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.830746 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:03.835253 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0391df1c64954f66a3987aba9257ca4b (table default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd]). Expected version 4 got 0
I20260811 06:17:03.835719 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538]). Expected version 1 got 0
I20260811 06:17:03.836233 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:03.836522 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:03.836594 12483 consensus_queue.cc:1035] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.836876 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:03.837303 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:03.837544 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:03.840083 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.840517 10918 raft_consensus.cc:3037] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.840775 12727 ts_tablet_manager.cc:1918] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:03.841006 12727 log.cc:1196] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:17:03.841615 12727 ts_tablet_manager.cc:1939] T c5efe8eb16e84575abd18a5079aad2c9 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:03.842082 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 71) took 1648 ms. Trace:
I20260811 06:17:03.842216 12727 rpcz_store.cc:276] 0811 06:17:02.194024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.194402 (+ 378us) service_pool.cc:227] Handling call
0811 06:17:03.796217 (+1601815us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:17:03.796228 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.825087 (+ 28859us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.840631 (+ 15544us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.842016 (+ 1385us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1590243}
I20260811 06:17:03.842844 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet c5efe8eb16e84575abd18a5079aad2c9 (table default.Table_59bc917bf1c440c6a607b0727ef3a8ff [id=4a189ec6459341a6b50dc5c1d28bd101]) successfully deleted
I20260811 06:17:03.844280 12483 consensus_queue.cc:1035] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:03.844679 10918 raft_consensus.cc:2454] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.845350 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:03.845731 11047 leader_election.cc:302] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:17:03.845458 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0cec2c3e143a4834a07aef7a31340d9c consensus state has no leader
I20260811 06:17:03.846217 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:03.846511 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:03.846537 12483 raft_consensus.cc:2781] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.846837 12483 raft_consensus.cc:686] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:03.846922 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:03.847205 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:03.847236 12483 consensus_queue.cc:237] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.847584 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:03.850036 12726 ts_tablet_manager.cc:1918] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:03.850850 12726 log.cc:1196] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:03.856545 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.856671 12726 ts_tablet_manager.cc:1939] T bc3091f8a8f9442da50b17d4752cedb0 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.858109 11365 ts_tablet_manager.cc:1397] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.277s user 0.008s sys 0.010s
I20260811 06:17:03.860126 10665 raft_consensus.cc:2454] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:03.860049 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 72) took 1664 ms. Trace:
I20260811 06:17:03.863304 11046 leader_election.cc:302] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:03.828898 13098 raft_consensus.cc:504] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:03.864329 10810 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:03.865106 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f12c8618198f4413b2727d04f850a10f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:03.865284 10665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3250276181a24e58a2db92376b7520e7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:03.866595 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 55) took 1598 ms. Trace:
I20260811 06:17:03.866505 11361 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:03.868376 10661 raft_consensus.cc:2379] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:03.868445 11361 ts_tablet_manager.cc:1397] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.219s user 0.023s sys 0.026s
W20260811 06:17:03.868780 10555 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
I20260811 06:17:03.883430 13102 raft_consensus.cc:482] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.883661 13102 raft_consensus.cc:504] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.884194 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:03.884593 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:03.884670 13102 leader_election.cc:288] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.885103 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:03.885150 12726 rpcz_store.cc:276] 0811 06:17:02.260626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.260937 (+ 311us) service_pool.cc:227] Handling call
0811 06:17:03.478684 (+1217747us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:03.478698 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.629068 (+150370us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.821554 (+192486us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.859269 (+ 37715us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1217360}
W20260811 06:17:03.886054 10555 leader_election.cc:341] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.886257 10555 leader_election.cc:302] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.886370 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc2d99019384c33840f16cbe98d336c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:03.886863 11156 raft_consensus.cc:3037] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:17:03.862113 11365 raft_consensus.cc:348] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.888137 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bc3091f8a8f9442da50b17d4752cedb0 (table default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]) successfully deleted
I20260811 06:17:03.888767 13102 raft_consensus.cc:2726] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.889150 13098 leader_election.cc:288] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.890766 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:03.891183 10665 raft_consensus.cc:3037] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.892905 11156 raft_consensus.cc:2454] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 2.
I20260811 06:17:03.897251 12726 tablet_replica.cc:330] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:03.899945 10564 leader_election.cc:341] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.911862 10665 raft_consensus.cc:2454] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:03.916344 12774 raft_consensus.cc:2781] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.916744 12774 raft_consensus.cc:482] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.917186 12774 raft_consensus.cc:3037] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.920471 12726 raft_consensus.cc:2229] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.920768 12726 raft_consensus.cc:2258] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.862155 12727 rpcz_store.cc:276] 0811 06:17:02.194793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.198752 (+ 3959us) service_pool.cc:227] Handling call
0811 06:17:03.857631 (+1658879us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:03.857840 (+ 209us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.859081 (+ 1241us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1651430}
I20260811 06:17:03.921590 12726 ts_tablet_manager.cc:1905] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.922065 12727 tablet_replica.cc:330] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:03.922442 12727 raft_consensus.cc:2229] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:03.922997 12727 raft_consensus.cc:2258] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.923934 12727 ts_tablet_manager.cc:1905] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.925819 10564 leader_election.cc:302] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:03.926641 13102 raft_consensus.cc:2781] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:17:03.926834 13102 raft_consensus.cc:686] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 2 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:03.927165 13098 raft_consensus.cc:482] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.927377 13098 raft_consensus.cc:504] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.928164 13098 leader_election.cc:288] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.927208 13102 consensus_queue.cc:237] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.930819 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:03.931650 10564 leader_election.cc:341] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.933249 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:03.937366 12726 ts_tablet_manager.cc:1918] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.937577 12726 log.cc:1196] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/285b85c854bf400295b288314947840e
I20260811 06:17:03.938202 11365 raft_consensus.cc:374] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.938869 11365 raft_consensus.cc:729] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.939615 11365 consensus_queue.cc:260] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.941731 11365 ts_tablet_manager.cc:1428] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
W20260811 06:17:03.942052 13112 log.cc:924] Time spent T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260811 06:17:03.942134 11365 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:03.942996 10810 leader_election.cc:302] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.944008 11361 raft_consensus.cc:348] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.944392 11361 raft_consensus.cc:374] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:03.944502 11361 raft_consensus.cc:729] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:03.944828 11361 consensus_queue.cc:260] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.945487 13103 raft_consensus.cc:2726] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.947458 12726 ts_tablet_manager.cc:1939] T 285b85c854bf400295b288314947840e P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:03.947896 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 56) took 1686 ms. Trace:
I20260811 06:17:03.948040 12726 rpcz_store.cc:276] 0811 06:17:02.261643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.261990 (+ 347us) service_pool.cc:227] Handling call
0811 06:17:03.885648 (+1623658us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:03.891939 (+ 6291us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.925639 (+ 33700us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.937218 (+ 11579us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.947814 (+ 10596us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1623293}
I20260811 06:17:03.948768 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 285b85c854bf400295b288314947840e (table default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]) successfully deleted
I20260811 06:17:03.948875 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.949596 10921 raft_consensus.cc:2454] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
W20260811 06:17:03.949851 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 79143.1us
I20260811 06:17:03.950183 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:03.950817 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:03.951258 10810 leader_election.cc:302] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:03.955211 10555 leader_election.cc:341] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
I20260811 06:17:03.955627 10555 leader_election.cc:302] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.956187 12821 raft_consensus.cc:2781] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:03.956329 12821 raft_consensus.cc:482] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:03.956425 12821 raft_consensus.cc:3037] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.956645 11365 tablet_bootstrap.cc:654] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.958782 11361 ts_tablet_manager.cc:1428] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260811 06:17:03.960276 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:03.960568 12821 raft_consensus.cc:504] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.961850 12821 leader_election.cc:288] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:03.962204 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:03.963021 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:03.966300 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:03.966361 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:03.968984 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:03.970116 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:03.971138 12943 raft_consensus.cc:2726] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.971221 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:03.971601 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:03.972431 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:03.972688 10921 raft_consensus.cc:3037] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.975229 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:03.976251 10921 raft_consensus.cc:2454] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:03.977231 12728 ts_tablet_manager.cc:1918] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:03.977420 12728 log.cc:1196] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/285b85c854bf400295b288314947840e
W20260811 06:17:03.978132 10555 leader_election.cc:341] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.978348 12728 ts_tablet_manager.cc:1939] T 285b85c854bf400295b288314947840e P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:03.978292 10555 leader_election.cc:302] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:03.978713 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 67) took 1776 ms. Trace:
I20260811 06:17:03.978869 10555 leader_election.cc:302] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:03.978839 12728 rpcz_store.cc:276] 0811 06:17:02.202352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.202542 (+ 190us) service_pool.cc:227] Handling call
0811 06:17:03.702114 (+1499572us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:03.702125 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.969684 (+267559us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.977098 (+ 7414us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:03.978653 (+ 1555us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499365}
I20260811 06:17:03.979394 12728 tablet_replica.cc:330] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:03.979622 12728 raft_consensus.cc:2229] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.979840 12728 raft_consensus.cc:2258] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.980041 13098 raft_consensus.cc:2726] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:03.980376 13098 raft_consensus.cc:2781] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:03.980597 13098 raft_consensus.cc:686] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:03.981040 13098 consensus_queue.cc:237] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.983886 11361 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:03.961068 12726 tablet_replica.cc:330] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:03.984993 12774 raft_consensus.cc:504] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:03.985270 12726 raft_consensus.cc:2229] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:03.985626 12726 raft_consensus.cc:2258] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:03.986195 12774 leader_election.cc:288] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:03.987462 12726 ts_tablet_manager.cc:1905] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.987578 11361 tablet_bootstrap.cc:654] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:03.992393 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:03.993731 10564 leader_election.cc:341] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:03.992180 12728 ts_tablet_manager.cc:1905] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:03.998500 12484 raft_consensus.cc:482] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:03.998803 12484 raft_consensus.cc:504] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.008172 11362 tablet_bootstrap.cc:492] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.008590 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:04.012542 11362 ts_tablet_manager.cc:1397] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.196s user 0.009s sys 0.022s
I20260811 06:17:04.014938 12726 ts_tablet_manager.cc:1918] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.018743 11362 raft_consensus.cc:348] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.019044 11362 raft_consensus.cc:374] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.001325 13132 raft_consensus.cc:482] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:04.001958 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 138655us
I20260811 06:17:04.024963 13132 raft_consensus.cc:504] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.025730 13132 leader_election.cc:288] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.003724 13133 raft_consensus.cc:482] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.026270 11362 raft_consensus.cc:729] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.013471 12727 ts_tablet_manager.cc:1918] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.026543 12727 log.cc:1196] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/97b348d30dc44fa383a27d9097c2e598
I20260811 06:17:04.026592 11362 consensus_queue.cc:260] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.027122 12727 ts_tablet_manager.cc:1939] T 97b348d30dc44fa383a27d9097c2e598 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.027308 11362 ts_tablet_manager.cc:1428] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260811 06:17:04.027557 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 73) took 1828 ms. Trace:
I20260811 06:17:04.027669 11362 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.027678 12727 rpcz_store.cc:276] 0811 06:17:02.199183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.215472 (+ 16289us) service_pool.cc:227] Handling call
0811 06:17:03.921782 (+1706310us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:03.921847 (+ 65us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.000217 (+ 78370us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.013269 (+ 13052us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.027519 (+ 14250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1705901}
I20260811 06:17:04.028056 12727 tablet_replica.cc:330] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.028328 12727 raft_consensus.cc:2229] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.028729 12727 raft_consensus.cc:2258] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.029452 12727 ts_tablet_manager.cc:1905] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.030242 13133 raft_consensus.cc:504] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.031062 13133 leader_election.cc:288] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.032671 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:04.032752 12484 leader_election.cc:288] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.032922 10651 raft_consensus.cc:3037] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:03.979568 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 285b85c854bf400295b288314947840e (table default.Table_795a58b37e3a43e4b20318a4b44fa3e4 [id=379912e8173145b6a25a0eed6a4c79d3]) successfully deleted
W20260811 06:17:04.034266 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 54739us
W20260811 06:17:03.997377 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:04.034796 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:04.035167 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.035271 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:04.035415 10661 raft_consensus.cc:2454] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:04.035843 11365 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:04.036048 11365 ts_tablet_manager.cc:1397] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.094s user 0.006s sys 0.000s
I20260811 06:17:04.037065 11365 raft_consensus.cc:348] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.037334 11365 raft_consensus.cc:374] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.037469 11365 raft_consensus.cc:729] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.037755 11365 consensus_queue.cc:260] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.039932 10651 raft_consensus.cc:2454] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.040995 11046 leader_election.cc:302] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.041476 11046 leader_election.cc:302] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.041944 11362 tablet_bootstrap.cc:654] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.042039 12094 consensus_queue.cc:1035] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.042606 12094 raft_consensus.cc:2781] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.042732 12094 raft_consensus.cc:482] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.042872 12094 raft_consensus.cc:3037] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.045943 13133 raft_consensus.cc:2781] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.046160 13133 raft_consensus.cc:686] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:04.046492 13133 consensus_queue.cc:237] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.048465 12094 raft_consensus.cc:504] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.049161 12094 leader_election.cc:288] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.035490 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:04.052256 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:04.053841 12728 ts_tablet_manager.cc:1918] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.054041 12728 log.cc:1196] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/59c4e76ecde14d0a86fedc84815e78a7
I20260811 06:17:04.054585 12728 ts_tablet_manager.cc:1939] T 59c4e76ecde14d0a86fedc84815e78a7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.054955 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 68) took 1852 ms. Trace:
I20260811 06:17:04.055081 12728 rpcz_store.cc:276] 0811 06:17:02.202942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.203392 (+ 450us) service_pool.cc:227] Handling call
0811 06:17:03.979262 (+1775870us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:03.979273 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.036389 (+ 57116us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.053651 (+ 17262us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.054913 (+ 1262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775550}
I20260811 06:17:04.055379 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.055799 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 102188us
I20260811 06:17:04.060612 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e873e2f7b3d34988856b3be044de1ed7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.056010 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 59c4e76ecde14d0a86fedc84815e78a7 (table default.Table_9fc91bec335145b987dbe074ac9af84c [id=dd42ee7602454afc9b1a9de67c56b4a0]) successfully deleted
I20260811 06:17:04.059818 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 97b348d30dc44fa383a27d9097c2e598 (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:17:04.062361 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:04.062759 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:04.063086 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:04.063792 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:04.064296 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:04.064683 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:04.065063 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:04.065407 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:04.065753 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:04.072510 12728 tablet_replica.cc:330] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.072784 12728 raft_consensus.cc:2229] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.073096 12728 raft_consensus.cc:2258] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.075131 11361 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:04.075462 11361 ts_tablet_manager.cc:1397] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.003s
I20260811 06:17:04.076722 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.077030 10918 raft_consensus.cc:2454] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:04.080320 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:04.080482 10664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:04.080890 11046 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:04.082188 11362 tablet_bootstrap.cc:492] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.082420 11362 ts_tablet_manager.cc:1397] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20260811 06:17:04.083354 11362 raft_consensus.cc:348] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.083603 11362 raft_consensus.cc:374] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.083716 11362 raft_consensus.cc:729] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.084057 11362 consensus_queue.cc:260] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.084847 11362 ts_tablet_manager.cc:1428] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 06:17:04.085207 11362 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.086030 10662 raft_consensus.cc:3037] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:04.087460 11047 leader_election.cc:341] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:04.088135 11047 leader_election.cc:341] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:04.088510 11047 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.088656 11047 leader_election.cc:302] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:04.088835 10664 raft_consensus.cc:2454] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:04.089416 11046 leader_election.cc:302] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.090062 12727 ts_tablet_manager.cc:1918] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.090727 12727 log.cc:1196] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/d668bcfbeff54181ba3b4407b1eb5704
I20260811 06:17:04.092590 12727 ts_tablet_manager.cc:1939] T d668bcfbeff54181ba3b4407b1eb5704 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.095654 12821 raft_consensus.cc:482] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.095853 12821 raft_consensus.cc:504] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.096750 12821 leader_election.cc:288] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.097820 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.097965 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.098610 10564 leader_election.cc:341] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:04.098901 10555 leader_election.cc:341] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.099171 10555 leader_election.cc:302] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.099659 12821 raft_consensus.cc:2726] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.099922 11365 ts_tablet_manager.cc:1428] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20260811 06:17:04.099968 10662 raft_consensus.cc:2454] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.100373 11365 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:04.102195 13137 raft_consensus.cc:2726] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.103302 11046 leader_election.cc:302] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.103648 13132 raft_consensus.cc:2781] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.103803 13132 raft_consensus.cc:482] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.103920 13132 raft_consensus.cc:3037] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.104516 12728 ts_tablet_manager.cc:1905] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.107136 11362 tablet_bootstrap.cc:654] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.107416 13132 raft_consensus.cc:504] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.108193 13132 leader_election.cc:288] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.108424 13132 raft_consensus.cc:2781] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.108930 13132 raft_consensus.cc:686] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:04.109336 13132 consensus_queue.cc:237] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.110004 12821 raft_consensus.cc:482] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.110343 12821 raft_consensus.cc:504] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.110579 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:04.110782 10662 raft_consensus.cc:3037] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.111104 12821 leader_election.cc:288] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.112437 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 74) took 1896 ms. Trace:
I20260811 06:17:04.112504 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:04.113144 10564 leader_election.cc:341] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.113322 12484 consensus_queue.cc:1035] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:17:04.113138 12727 rpcz_store.cc:276] 0811 06:17:02.216144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.216514 (+ 370us) service_pool.cc:227] Handling call
0811 06:17:04.027969 (+1811455us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:04.027981 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.056250 (+ 28269us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.089506 (+ 33256us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.112320 (+ 22814us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15793,"tablet-delete.queue_time_us":1811060}
I20260811 06:17:04.114079 10662 raft_consensus.cc:2454] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.114327 12726 log.cc:1196] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:17:04.114430 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 75) took 1897 ms. Trace:
I20260811 06:17:04.114652 12727 rpcz_store.cc:276] 0811 06:17:02.217169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.217466 (+ 297us) service_pool.cc:227] Handling call
0811 06:17:04.114120 (+1896654us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:04.114156 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.114329 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896305}
I20260811 06:17:04.115051 12726 ts_tablet_manager.cc:1939] T 9ac8c5daeb3249e38d863ee94f1267b1 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:04.115118 11046 leader_election.cc:302] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.115424 12094 raft_consensus.cc:2781] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.115793 12094 raft_consensus.cc:686] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:04.115893 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 57) took 1853 ms. Trace:
I20260811 06:17:04.115969 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.116036 12726 rpcz_store.cc:276] 0811 06:17:02.262637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.263123 (+ 486us) service_pool.cc:227] Handling call
0811 06:17:03.960810 (+1697687us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:03.960867 (+ 57us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:03.998799 (+ 37932us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.014778 (+ 15979us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.115845 (+101067us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3,"tablet-delete.queue_time_us":1697251}
I20260811 06:17:04.116091 12094 consensus_queue.cc:237] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.116405 12726 tablet_replica.cc:330] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:04.116686 12726 raft_consensus.cc:2229] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.116901 12726 raft_consensus.cc:2258] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:04.117384 10555 leader_election.cc:341] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.117568 12726 ts_tablet_manager.cc:1905] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.110316 11361 raft_consensus.cc:348] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.117812 11361 raft_consensus.cc:374] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.117928 11361 raft_consensus.cc:729] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.118219 11361 consensus_queue.cc:260] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.119185 11361 ts_tablet_manager.cc:1428] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.044s user 0.001s sys 0.002s
I20260811 06:17:04.119372 12727 tablet_replica.cc:330] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.119624 11361 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:04.120306 12727 raft_consensus.cc:2229] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.121382 12727 raft_consensus.cc:2258] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.121980 11361 tablet_bootstrap.cc:654] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.117630 10555 leader_election.cc:302] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.124038 12821 raft_consensus.cc:2726] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.125088 12727 ts_tablet_manager.cc:1905] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.129320 12728 ts_tablet_manager.cc:1918] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260811 06:17:04.133234 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 44734.1us
I20260811 06:17:04.141093 11365 tablet_bootstrap.cc:654] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.145186 13165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a36d6d06a0cb4489b5014178b9973219)
I20260811 06:17:04.145439 12821 raft_consensus.cc:482] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.145514 13165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:04.145707 12821 raft_consensus.cc:504] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.146734 12821 leader_election.cc:288] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.147594 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:04.148281 10564 leader_election.cc:341] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.134333 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22feadfa433d46cc9f5dc052b3421e56" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:04.134533 11362 tablet_bootstrap.cc:492] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.135653 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5797f3ba59924b41b92fbd089397218e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:04.138414 10813 consensus_peers.cc:487] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37e73b8798b2455baf642abc532a5d8c. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:04.150744 11362 ts_tablet_manager.cc:1397] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.000s
I20260811 06:17:04.150759 10921 raft_consensus.cc:3037] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.151455 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.152128 10555 leader_election.cc:341] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.152012 11362 raft_consensus.cc:348] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.152287 11362 raft_consensus.cc:374] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.152271 10555 leader_election.cc:302] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.152408 11362 raft_consensus.cc:729] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.152680 11362 consensus_queue.cc:260] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.152853 12821 raft_consensus.cc:2726] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.153468 11362 ts_tablet_manager.cc:1428] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:04.153846 11362 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.155827 11362 tablet_bootstrap.cc:654] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.156371 10921 raft_consensus.cc:2454] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.157163 12728 log.cc:1196] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/7db813cbb8f74b329015b163ebd58c00
I20260811 06:17:04.158893 12728 ts_tablet_manager.cc:1939] T 7db813cbb8f74b329015b163ebd58c00 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.159641 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 69) took 1956 ms. Trace:
I20260811 06:17:04.160303 12728 rpcz_store.cc:276] 0811 06:17:02.203264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.203771 (+ 507us) service_pool.cc:227] Handling call
0811 06:17:04.072414 (+1868643us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:04.072427 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.123246 (+ 50819us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.129189 (+ 5943us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.159583 (+ 30394us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1868322}
I20260811 06:17:04.163995 12728 tablet_replica.cc:330] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.165249 12728 raft_consensus.cc:2229] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.165921 12728 raft_consensus.cc:2258] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.171185 12728 ts_tablet_manager.cc:1905] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.177253 12726 ts_tablet_manager.cc:1918] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260811 06:17:04.177537 11047 leader_election.cc:341] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.180151 11361 tablet_bootstrap.cc:492] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:04.180449 11361 ts_tablet_manager.cc:1397] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.061s user 0.001s sys 0.005s
I20260811 06:17:04.181572 13165 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:17:04.182192 11361 raft_consensus.cc:348] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.182580 11361 raft_consensus.cc:374] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.182703 11361 raft_consensus.cc:729] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.184614 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 7db813cbb8f74b329015b163ebd58c00 (table default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]) successfully deleted
I20260811 06:17:04.184782 12726 log.cc:1196] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7db813cbb8f74b329015b163ebd58c00
I20260811 06:17:04.189097 12726 ts_tablet_manager.cc:1939] T 7db813cbb8f74b329015b163ebd58c00 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:04.190335 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 58) took 1926 ms. Trace:
I20260811 06:17:04.194429 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 5 candidate_status { last_received { term: 4 index: 612 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:17:04.194931 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet d668bcfbeff54181ba3b4407b1eb5704 (table default.Table_16798efef90c476e88ece60ceda20557 [id=41effa9bdd8c47bca930b230e16c6091]) successfully deleted
I20260811 06:17:04.195446 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 9ac8c5daeb3249e38d863ee94f1267b1 (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]) successfully deleted
W20260811 06:17:04.196357 11584 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 79306.8us
W20260811 06:17:04.197168 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 59406.7us
W20260811 06:17:04.198748 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
I20260811 06:17:04.198627 12726 rpcz_store.cc:276] 0811 06:17:02.263919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.264924 (+ 1005us) service_pool.cc:227] Handling call
0811 06:17:04.116330 (+1851406us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:04.116340 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.146384 (+ 30044us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.177104 (+ 30720us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.190255 (+ 13151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1850977}
I20260811 06:17:04.199222 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7db813cbb8f74b329015b163ebd58c00 (table default.Table_bcb3cda7490e4ac7ac1b6efbbaca158c [id=aa16c5bb20e44d158cdc845c1f7bfd14]) successfully deleted
I20260811 06:17:04.199983 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:04.200642 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:04.200919 12726 tablet_replica.cc:330] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:04.201198 12726 raft_consensus.cc:2229] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.201460 12726 raft_consensus.cc:2258] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.201450 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:04.201620 11365 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:04.201936 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:04.202183 12726 ts_tablet_manager.cc:1905] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.202411 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:04.202803 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:04.203187 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:04.203488 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:04.203518 11362 tablet_bootstrap.cc:492] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.203735 11362 ts_tablet_manager.cc:1397] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20260811 06:17:04.204046 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:04.204216 11365 ts_tablet_manager.cc:1397] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.002s
I20260811 06:17:04.204748 11362 raft_consensus.cc:348] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.205085 11362 raft_consensus.cc:374] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.205204 11362 raft_consensus.cc:729] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.205484 11362 consensus_queue.cc:260] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.206175 11362 ts_tablet_manager.cc:1428] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:04.183001 11361 consensus_queue.cc:260] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.206578 11362 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.202848 12727 ts_tablet_manager.cc:1918] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:04.206882 12727 log.cc:1196] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a378a6f20c564eb685b655a762b638ae
I20260811 06:17:04.208709 11362 tablet_bootstrap.cc:654] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.210480 12728 ts_tablet_manager.cc:1918] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:04.211133 12728 log.cc:1196] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/864c3bbf1e004579a4d0be809f83ca33
I20260811 06:17:04.211999 12727 ts_tablet_manager.cc:1939] T a378a6f20c564eb685b655a762b638ae P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.217963 12728 ts_tablet_manager.cc:1939] T 864c3bbf1e004579a4d0be809f83ca33 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.218983 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 70) took 2015 ms. Trace:
I20260811 06:17:04.222852 13184 tablet.cc:1722] T 8123e24a8bbf4bd6a9344a83ca2163fc P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:04.222406 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 76) took 1999 ms. Trace:
I20260811 06:17:04.225457 11361 ts_tablet_manager.cc:1428] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260811 06:17:04.225847 12728 rpcz_store.cc:276] 0811 06:17:02.203356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.204390 (+ 1034us) service_pool.cc:227] Handling call
0811 06:17:04.163872 (+1959482us) ts_tablet_manager.cc:1145] Deleting tablet 864c3bbf1e004579a4d0be809f83ca33
0811 06:17:04.163884 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.194095 (+ 30211us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.197646 (+ 3551us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.218939 (+ 21293us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959182}
I20260811 06:17:04.226817 12728 tablet_replica.cc:330] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.227082 12728 raft_consensus.cc:2229] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.227303 12728 raft_consensus.cc:2258] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.227512 13181 tablet.cc:1722] T 8123e24a8bbf4bd6a9344a83ca2163fc P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:04.228132 12728 ts_tablet_manager.cc:1905] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.223999 11365 raft_consensus.cc:348] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.229377 11365 raft_consensus.cc:374] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.230304 12726 ts_tablet_manager.cc:1918] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.230476 12726 log.cc:1196] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/d668bcfbeff54181ba3b4407b1eb5704
I20260811 06:17:04.231257 12726 ts_tablet_manager.cc:1939] T d668bcfbeff54181ba3b4407b1eb5704 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:04.230713 11365 raft_consensus.cc:729] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.232218 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 59) took 1966 ms. Trace:
I20260811 06:17:04.233560 13132 raft_consensus.cc:482] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.233831 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:04.233947 12726 rpcz_store.cc:276] 0811 06:17:02.265626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.266525 (+ 899us) service_pool.cc:227] Handling call
0811 06:17:04.200756 (+1934231us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:04.200770 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.214086 (+ 13316us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.230130 (+ 16044us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.232153 (+ 2023us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1933935}
I20260811 06:17:04.234479 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 60) took 1967 ms. Trace:
I20260811 06:17:04.224313 12727 rpcz_store.cc:276] 0811 06:17:02.217999 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.218528 (+ 529us) service_pool.cc:227] Handling call
0811 06:17:04.115183 (+1896655us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:17:04.115195 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.158097 (+ 42902us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.200824 (+ 42727us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.217702 (+ 16878us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896380}
I20260811 06:17:04.233839 13132 raft_consensus.cc:504] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.236101 13132 leader_election.cc:288] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.237473 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cae52ba275f4d2fbd7014a1c6c01dc0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.237830 10916 raft_consensus.cc:2454] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:04.226461 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 864c3bbf1e004579a4d0be809f83ca33 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]) successfully deleted
I20260811 06:17:04.234565 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet d668bcfbeff54181ba3b4407b1eb5704 (table default.Table_16798efef90c476e88ece60ceda20557 [id=41effa9bdd8c47bca930b230e16c6091]) successfully deleted
I20260811 06:17:04.234969 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a378a6f20c564eb685b655a762b638ae (table default.Table_eab05c1288934064b96562cf11ac2675 [id=c29ff899f4c149e48ff675a0dfea0a1a]) successfully deleted
I20260811 06:17:04.238418 11047 leader_election.cc:302] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.240046 12726 rpcz_store.cc:276] 0811 06:17:02.267151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.271999 (+ 4848us) service_pool.cc:227] Handling call
0811 06:17:04.234294 (+1962295us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:04.234307 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.234428 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1960956}
W20260811 06:17:04.240470 11046 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
W20260811 06:17:04.240945 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:04.241453 11362 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.241642 11362 ts_tablet_manager.cc:1397] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260811 06:17:04.242146 12727 tablet_replica.cc:330] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.242825 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 61) took 1969 ms. Trace:
I20260811 06:17:04.243468 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:04.243737 11361 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:04.243040 11365 consensus_queue.cc:260] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.243629 12726 rpcz_store.cc:276] 0811 06:17:02.273450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.278717 (+ 5267us) service_pool.cc:227] Handling call
0811 06:17:04.240685 (+1961968us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:17:04.240701 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.242705 (+ 2004us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1960763}
I20260811 06:17:04.246868 11362 raft_consensus.cc:348] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.247238 11362 raft_consensus.cc:374] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.247469 11362 raft_consensus.cc:729] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.247689 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:04.248148 12726 tablet_replica.cc:330] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:04.248174 11362 consensus_queue.cc:260] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.249336 11365 ts_tablet_manager.cc:1428] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.044s user 0.004s sys 0.001s
I20260811 06:17:04.249768 11362 ts_tablet_manager.cc:1428] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260811 06:17:04.250245 11362 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.250401 12726 raft_consensus.cc:2229] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.250633 12726 raft_consensus.cc:2258] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.250921 11365 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:04.251358 12726 ts_tablet_manager.cc:1905] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.256911 11362 tablet_bootstrap.cc:654] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:04.246125 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 22cac1c339574b1fa26555b18811539b because the tablet was not found. No further retry: Not found: Tablet not found: 22cac1c339574b1fa26555b18811539b
I20260811 06:17:04.258411 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:04.259949 11365 tablet_bootstrap.cc:654] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.263365 12094 raft_consensus.cc:2781] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.263536 12094 raft_consensus.cc:482] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.263710 12094 raft_consensus.cc:3037] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.268697 13189 tablet.cc:1722] T 8123e24a8bbf4bd6a9344a83ca2163fc P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:04.273332 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:04.279326 10916 raft_consensus.cc:3037] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.284547 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:04.285069 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:04.285411 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:04.285810 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:04.270087 12094 raft_consensus.cc:504] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:04.275477 11046 consensus_peers.cc:487] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:04.287890 11046 leader_election.cc:341] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:04.288412 12094 leader_election.cc:288] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.278402 11361 tablet_bootstrap.cc:654] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.278534 12727 raft_consensus.cc:2229] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.289494 12727 pending_rounds.cc:62] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:04.289726 12727 pending_rounds.cc:68] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213281682169856 op_type: NO_OP noop_request { }
I20260811 06:17:04.289973 12727 raft_consensus.cc:2866] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:04.290251 12727 raft_consensus.cc:2258] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.291323 12727 ts_tablet_manager.cc:1905] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.299933 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cae52ba275f4d2fbd7014a1c6c01dc0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:04.300371 10916 raft_consensus.cc:3037] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.304773 10916 raft_consensus.cc:2454] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.312170 12094 raft_consensus.cc:482] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.312578 12094 raft_consensus.cc:504] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.314303 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.314320 13132 consensus_queue.cc:1035] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.314721 10651 raft_consensus.cc:2454] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:04.315089 11047 leader_election.cc:302] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:04.315672 11046 leader_election.cc:302] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.316056 12484 raft_consensus.cc:2781] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.316367 12484 raft_consensus.cc:482] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.316587 12484 raft_consensus.cc:3037] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.316920 13132 raft_consensus.cc:2781] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.317219 13132 raft_consensus.cc:686] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:04.317613 13132 consensus_queue.cc:237] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.318853 13158 raft_consensus.cc:482] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.319190 13158 raft_consensus.cc:504] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.319883 12094 leader_election.cc:288] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.320606 13158 leader_election.cc:288] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.321195 12484 raft_consensus.cc:504] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.321910 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.322718 10555 leader_election.cc:341] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.322835 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:04.323227 10651 raft_consensus.cc:3037] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.324103 11362 tablet_bootstrap.cc:492] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.327993 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.329479 12727 ts_tablet_manager.cc:1918] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.329670 12727 log.cc:1196] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/3250276181a24e58a2db92376b7520e7
I20260811 06:17:04.330811 11159 raft_consensus.cc:2454] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:04.333161 10564 leader_election.cc:302] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:04.334211 13158 raft_consensus.cc:2781] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.334509 13158 raft_consensus.cc:482] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.334728 13158 raft_consensus.cc:3037] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.324445 11362 ts_tablet_manager.cc:1397] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.003s
I20260811 06:17:04.337416 12727 ts_tablet_manager.cc:1939] T 3250276181a24e58a2db92376b7520e7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.338554 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 77) took 2100 ms. Trace:
I20260811 06:17:04.338783 12727 rpcz_store.cc:276] 0811 06:17:02.238356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.243134 (+ 4778us) service_pool.cc:227] Handling call
0811 06:17:04.234716 (+1991582us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:17:04.242052 (+ 7336us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.295016 (+ 52964us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.329300 (+ 34284us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.338509 (+ 9209us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1991187}
I20260811 06:17:04.339325 12727 tablet_replica.cc:330] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.339740 12727 raft_consensus.cc:2229] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.340241 12727 raft_consensus.cc:2258] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.340677 11362 raft_consensus.cc:348] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.326673 12728 ts_tablet_manager.cc:1918] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.341046 11362 raft_consensus.cc:374] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.343221 11362 raft_consensus.cc:729] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.344583 12484 leader_election.cc:288] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.344617 12728 log.cc:1196] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/97b348d30dc44fa383a27d9097c2e598
I20260811 06:17:04.345264 12728 ts_tablet_manager.cc:1939] T 97b348d30dc44fa383a27d9097c2e598 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.345851 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 71) took 2140 ms. Trace:
I20260811 06:17:04.345871 12484 raft_consensus.cc:482] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.346051 12728 rpcz_store.cc:276] 0811 06:17:02.204934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.205171 (+ 237us) service_pool.cc:227] Handling call
0811 06:17:04.226721 (+2021550us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:04.226735 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.259548 (+ 32813us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.326522 (+ 66974us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.345790 (+ 19268us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2021347}
I20260811 06:17:04.346961 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 97b348d30dc44fa383a27d9097c2e598 (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:17:04.346274 12484 raft_consensus.cc:504] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.348726 12727 ts_tablet_manager.cc:1905] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.348886 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.346146 11362 consensus_queue.cc:260] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.350880 11362 ts_tablet_manager.cc:1428] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.014s user 0.000s sys 0.003s
I20260811 06:17:04.357761 12484 leader_election.cc:288] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.359491 10651 raft_consensus.cc:2454] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:04.361560 12821 raft_consensus.cc:482] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56a371f7ed104f68a5db9ca097eb237e)
I20260811 06:17:04.361987 12821 raft_consensus.cc:504] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:04.362218 13142 raft_consensus.cc:482] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.362563 13142 raft_consensus.cc:504] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.362998 12821 leader_election.cc:288] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:04.364543 13142 leader_election.cc:288] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:04.364981 10564 leader_election.cc:341] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 681736b44af04718b800d503ca645c1a
W20260811 06:17:04.365836 10555 leader_election.cc:341] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 681736b44af04718b800d503ca645c1a
I20260811 06:17:04.366189 10555 leader_election.cc:302] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.367108 12821 raft_consensus.cc:2726] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:04.367506 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.368206 10654 raft_consensus.cc:2379] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:04.360829 11046 leader_election.cc:302] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:04.370015 12484 raft_consensus.cc:2781] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.370294 12484 raft_consensus.cc:686] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:04.370642 12484 consensus_queue.cc:237] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.371532 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 72) took 2142 ms. Trace:
I20260811 06:17:04.371809 12728 rpcz_store.cc:276] 0811 06:17:02.205563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.205958 (+ 395us) service_pool.cc:227] Handling call
0811 06:17:04.347340 (+2141382us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:04.347451 (+ 111us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.347638 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141154}
I20260811 06:17:04.371887 13158 raft_consensus.cc:504] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:04.372570 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:04.373983 12728 tablet_replica.cc:330] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.374352 12728 raft_consensus.cc:2229] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.374593 10662 raft_consensus.cc:2379] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:17:04.375849 12728 raft_consensus.cc:2258] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.376302 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:04.376843 12728 ts_tablet_manager.cc:1905] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:04.376945 10555 leader_election.cc:341] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.379781 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:04.380242 11159 raft_consensus.cc:3037] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.384363 11159 raft_consensus.cc:2454] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:04.385231 10564 leader_election.cc:302] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:04.385799 12821 raft_consensus.cc:2781] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.385996 12821 raft_consensus.cc:686] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:04.386329 12821 consensus_queue.cc:237] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.387881 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:04.389190 11362 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.394570 13158 leader_election.cc:288] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.411008 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 3250276181a24e58a2db92376b7520e7 (table default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]) successfully deleted
I20260811 06:17:04.413121 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.413115 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.415391 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:04.420955 11362 tablet_bootstrap.cc:654] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.441322 12728 ts_tablet_manager.cc:1918] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.441980 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5119e9bb88844329aea123dc3805d91d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.444507 12726 ts_tablet_manager.cc:1918] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.444844 12726 log.cc:1196] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2875318863584e659e2b76ad2a72ca45
I20260811 06:17:04.445603 12726 ts_tablet_manager.cc:1939] T 2875318863584e659e2b76ad2a72ca45 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:04.446208 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 62) took 2164 ms. Trace:
I20260811 06:17:04.446388 12726 rpcz_store.cc:276] 0811 06:17:02.281792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.286079 (+ 4287us) service_pool.cc:227] Handling call
0811 06:17:04.246608 (+1960529us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:17:04.248051 (+ 1443us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.255480 (+ 7429us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.444354 (+188874us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.446118 (+ 1764us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1925,"tablet-delete.queue_time_us":1924582}
I20260811 06:17:04.447067 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2875318863584e659e2b76ad2a72ca45 (table default.Table_3aeade8d5c694298954b38d3d3ed01bb [id=2f798d3676d5463da80a81e029017dd9]) successfully deleted
I20260811 06:17:04.453083 11362 tablet_bootstrap.cc:492] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.454119 11362 ts_tablet_manager.cc:1397] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.005s
I20260811 06:17:04.455945 11362 raft_consensus.cc:348] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.456395 11362 raft_consensus.cc:374] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.456645 11362 raft_consensus.cc:729] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.457012 11362 consensus_queue.cc:260] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.457430 12728 log.cc:1196] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/58fdb5920003438d983987ff242f6dce
I20260811 06:17:04.458357 12728 ts_tablet_manager.cc:1939] T 58fdb5920003438d983987ff242f6dce P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.463485 12821 raft_consensus.cc:482] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.463778 12821 raft_consensus.cc:504] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.464592 12821 leader_election.cc:288] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.461438 11362 ts_tablet_manager.cc:1428] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260811 06:17:04.465881 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.466881 10555 leader_election.cc:341] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.466993 11362 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.468307 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 73) took 2261 ms. Trace:
I20260811 06:17:04.471834 12728 rpcz_store.cc:276] 0811 06:17:02.206506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.206709 (+ 203us) service_pool.cc:227] Handling call
0811 06:17:04.373766 (+2167057us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:17:04.373781 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.431303 (+ 57522us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.441088 (+ 9785us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.468168 (+ 27080us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2166827}
I20260811 06:17:04.472595 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 58fdb5920003438d983987ff242f6dce (table default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]) successfully deleted
I20260811 06:17:04.473217 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 74) took 2266 ms. Trace:
I20260811 06:17:04.473587 12728 rpcz_store.cc:276] 0811 06:17:02.207191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.207387 (+ 196us) service_pool.cc:227] Handling call
0811 06:17:04.472981 (+2265594us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:17:04.472997 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.473170 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265365}
W20260811 06:17:04.474406 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
I20260811 06:17:04.474942 12728 tablet_replica.cc:330] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.475392 12728 raft_consensus.cc:2229] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.479242 12728 raft_consensus.cc:2258] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.471446 11362 tablet_bootstrap.cc:654] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.482427 12728 ts_tablet_manager.cc:1905] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.490962 13181 tablet.cc:1722] T 6d0f4cb9da96451ab351e1ad1aff7530 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.492755 13184 tablet.cc:1722] T 6d0f4cb9da96451ab351e1ad1aff7530 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.506569 12727 ts_tablet_manager.cc:1918] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.506601 13181 tablet.cc:1722] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:04.510404 12821 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.510699 12821 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.522822 12821 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.528579 13184 tablet.cc:1722] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:04.529414 13103 raft_consensus.cc:482] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.529826 13103 raft_consensus.cc:504] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.531245 13103 leader_election.cc:288] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.531627 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:04.532606 10555 leader_election.cc:341] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:04.542841 10810 consensus_peers.cc:487] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2875318863584e659e2b76ad2a72ca45. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:04.543095 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.543342 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.543512 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.543967 12727 log.cc:1196] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f4f14a0add084048b92a501476ad6588
I20260811 06:17:04.544661 12727 ts_tablet_manager.cc:1939] T f4f14a0add084048b92a501476ad6588 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.544857 13142 raft_consensus.cc:482] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.545225 13142 raft_consensus.cc:504] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.545743 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 78) took 2301 ms. Trace:
I20260811 06:17:04.545962 12727 rpcz_store.cc:276] 0811 06:17:02.245358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.245411 (+ 53us) service_pool.cc:227] Handling call
0811 06:17:04.339173 (+2093762us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:17:04.339186 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.419205 (+ 80019us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.506414 (+ 87209us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.545654 (+ 39240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2093248}
I20260811 06:17:04.546399 13142 leader_election.cc:288] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.546468 12727 tablet_replica.cc:330] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.546785 10661 raft_consensus.cc:2379] T 3b658d1cd9b74251981fe1ff3959033a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:04.546777 12727 raft_consensus.cc:2229] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:04.547427 12727 raft_consensus.cc:2258] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.548398 12727 ts_tablet_manager.cc:1905] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:04.552873 10564 leader_election.cc:341] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.556571 11361 tablet_bootstrap.cc:492] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:04.561013 10564 leader_election.cc:302] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.561586 12821 raft_consensus.cc:2726] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.556839 11361 ts_tablet_manager.cc:1397] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.316s user 0.027s sys 0.061s
W20260811 06:17:04.561947 10564 leader_election.cc:341] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.562265 10564 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.562661 12821 raft_consensus.cc:2726] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.563256 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.563731 10659 raft_consensus.cc:2379] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:04.576625 11365 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:04.577103 11365 ts_tablet_manager.cc:1397] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.327s user 0.014s sys 0.044s
I20260811 06:17:04.577661 13189 tablet.cc:1722] T 5322caea49aa4b648b74c7692d6e0372 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.579903 11365 raft_consensus.cc:348] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.580549 11365 raft_consensus.cc:374] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.580776 11365 raft_consensus.cc:729] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.581472 11365 consensus_queue.cc:260] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.584383 13184 tablet.cc:1722] T 5322caea49aa4b648b74c7692d6e0372 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.589381 13142 raft_consensus.cc:482] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.589570 13142 raft_consensus.cc:504] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.589751 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:04.590230 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:04.590560 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:04.590651 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:04.591208 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:04.592226 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:04.592494 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:04.593132 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:04.593179 13142 leader_election.cc:288] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.593528 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:04.593937 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:04.594386 11361 raft_consensus.cc:348] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.594659 11361 raft_consensus.cc:374] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.594798 11361 raft_consensus.cc:729] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.595069 11361 consensus_queue.cc:260] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.595691 11361 ts_tablet_manager.cc:1428] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.034s user 0.000s sys 0.001s
I20260811 06:17:04.596323 11361 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:04.596964 11365 ts_tablet_manager.cc:1428] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
W20260811 06:17:04.598745 10810 leader_election.cc:341] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:04.599546 11361 tablet_bootstrap.cc:654] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.600708 11365 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:04.605814 12726 tablet_replica.cc:330] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:04.606216 12726 raft_consensus.cc:2229] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.606825 12726 raft_consensus.cc:2258] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.608090 12726 ts_tablet_manager.cc:1905] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:04.562119 11047 leader_election.cc:341] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.613113 11047 leader_election.cc:302] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:04.616668 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 174199us
W20260811 06:17:04.617478 11047 leader_election.cc:341] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:04.618278 11047 leader_election.cc:341] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.617121 12484 raft_consensus.cc:2726] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.622915 12727 ts_tablet_manager.cc:1918] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.623744 12727 log.cc:1196] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/59c4e76ecde14d0a86fedc84815e78a7
I20260811 06:17:04.625213 12727 ts_tablet_manager.cc:1939] T 59c4e76ecde14d0a86fedc84815e78a7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.634707 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f4f14a0add084048b92a501476ad6588 (table default.Table_e8e359f459ab4b79a079b6f990345a9a [id=7792bcddbdd44cad988860223ed4e05e]) successfully deleted
I20260811 06:17:04.641224 10813 leader_election.cc:302] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.643666 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:04.644964 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:04.645830 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:04.647832 13132 consensus_queue.cc:1035] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.648027 13103 raft_consensus.cc:3037] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.649829 11365 tablet_bootstrap.cc:654] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.650548 12963 consensus_queue.cc:1035] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.655694 13103 raft_consensus.cc:2726] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.659896 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b658d1cd9b74251981fe1ff3959033a" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.660836 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9fd17e8c6264f898493c15b0aa5518d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.663558 10916 raft_consensus.cc:3037] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.663494 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3091f8a8f9442da50b17d4752cedb0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.660040 11361 tablet_bootstrap.cc:492] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:04.664772 11361 ts_tablet_manager.cc:1397] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.069s user 0.000s sys 0.008s
I20260811 06:17:04.666894 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 79) took 2420 ms. Trace:
I20260811 06:17:04.669588 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:04.672756 11362 tablet_bootstrap.cc:492] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:04.673216 11362 ts_tablet_manager.cc:1397] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.206s user 0.003s sys 0.006s
I20260811 06:17:04.674677 11362 raft_consensus.cc:348] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.675158 11362 raft_consensus.cc:374] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.675385 11362 raft_consensus.cc:729] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.676113 11362 consensus_queue.cc:260] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.676784 13103 raft_consensus.cc:482] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.677070 13103 raft_consensus.cc:504] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.673418 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:04.678727 13103 leader_election.cc:288] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:04.679343 10810 leader_election.cc:341] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:04.688401 11362 ts_tablet_manager.cc:1428] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.015s user 0.000s sys 0.003s
I20260811 06:17:04.693118 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:04.693888 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:04.694321 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:04.694908 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:04.698345 11362 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:04.706080 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d44dea35e94ed788b7e1e5a8a24d8e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.708004 13189 tablet.cc:1722] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:04.708154 10813 leader_election.cc:302] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.708595 12944 raft_consensus.cc:2726] T 3b658d1cd9b74251981fe1ff3959033a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.708840 12963 consensus_queue.cc:1035] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 06:17:04.709262 10813 leader_election.cc:302] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.710302 12944 raft_consensus.cc:3037] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.713223 12774 consensus_queue.cc:1035] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 06:17:04.715507 12944 raft_consensus.cc:2726] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.716248 10916 raft_consensus.cc:3037] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.721160 10813 leader_election.cc:302] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.723199 13189 tablet.cc:1722] T 6d0f4cb9da96451ab351e1ad1aff7530 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.725530 12727 rpcz_store.cc:276] 0811 06:17:02.245837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.246448 (+ 611us) service_pool.cc:227] Handling call
0811 06:17:04.546247 (+2299799us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:04.546259 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.590700 (+ 44441us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.622486 (+ 31786us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.666651 (+ 44165us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2299535}
I20260811 06:17:04.724401 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:04.726212 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 59c4e76ecde14d0a86fedc84815e78a7 (table default.Table_9fc91bec335145b987dbe074ac9af84c [id=dd42ee7602454afc9b1a9de67c56b4a0]) successfully deleted
I20260811 06:17:04.726006 12727 tablet_replica.cc:330] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.730731 12727 raft_consensus.cc:2229] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.731047 12727 raft_consensus.cc:2258] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.729578 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:04.732046 12727 ts_tablet_manager.cc:1905] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.704742 11361 raft_consensus.cc:348] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.739028 11361 raft_consensus.cc:374] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.739264 11361 raft_consensus.cc:729] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.740127 13240 raft_consensus.cc:2726] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:04.741952 12728 ts_tablet_manager.cc:1918] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.743048 12963 consensus_queue.cc:1035] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.736927 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:04.746070 11361 consensus_queue.cc:260] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.755729 11365 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:04.756068 11365 ts_tablet_manager.cc:1397] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.156s user 0.011s sys 0.000s
I20260811 06:17:04.747187 11361 ts_tablet_manager.cc:1428] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.082s user 0.004s sys 0.000s
I20260811 06:17:04.747231 11161 raft_consensus.cc:2454] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:04.753886 11153 raft_consensus.cc:1261] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Refusing update from remote peer 24d29113b2454d9c93e23db3e3dac801: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 06:17:04.758201 12821 consensus_queue.cc:1035] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.758222 11365 raft_consensus.cc:348] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.758728 11365 raft_consensus.cc:374] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.758908 11365 raft_consensus.cc:729] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.759299 11365 consensus_queue.cc:260] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.759881 11361 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:04.760411 11365 ts_tablet_manager.cc:1428] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 06:17:04.760917 11365 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:04.764488 11365 tablet_bootstrap.cc:654] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.772073 12728 log.cc:1196] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6119212ae4be4204852a5d9437dcee72
I20260811 06:17:04.772401 10813 leader_election.cc:302] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:04.772981 12728 ts_tablet_manager.cc:1939] T 6119212ae4be4204852a5d9437dcee72 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:04.773057 13240 raft_consensus.cc:2781] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:04.773288 13240 raft_consensus.cc:482] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:04.773440 13240 raft_consensus.cc:3037] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.777107 13240 raft_consensus.cc:504] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.778740 13240 leader_election.cc:288] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:04.779929 10810 leader_election.cc:341] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:04.773444 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 77) took 2549 ms. Trace:
I20260811 06:17:04.780550 12728 rpcz_store.cc:276] 0811 06:17:02.223470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.223674 (+ 204us) service_pool.cc:227] Handling call
0811 06:17:04.474839 (+2251165us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:17:04.474852 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.489841 (+ 14989us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.741798 (+251957us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.773371 (+ 31573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250728}
I20260811 06:17:04.781339 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6119212ae4be4204852a5d9437dcee72 (table default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]) successfully deleted
I20260811 06:17:04.782006 12728 tablet_replica.cc:330] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:04.782406 12728 raft_consensus.cc:2229] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.787562 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_b959e7d44eb64358964a8534448dc4ec [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 1 got 0
I20260811 06:17:04.789827 12728 raft_consensus.cc:2258] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.792785 12728 ts_tablet_manager.cc:1905] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:04.794999 10072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.203.124:45045 timed out after 0.646s (SENT)
I20260811 06:17:04.803637 11362 tablet_bootstrap.cc:654] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.803825 11365 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:04.804068 11365 ts_tablet_manager.cc:1397] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.003s
I20260811 06:17:04.805465 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d44dea35e94ed788b7e1e5a8a24d8e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:04.806804 11161 raft_consensus.cc:3037] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.806785 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:04.807262 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:04.808166 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:04.808712 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:04.809389 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:04.810182 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:04.810596 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
I20260811 06:17:04.811002 11161 raft_consensus.cc:2454] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:04.811475 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:04.811995 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:04.812438 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:04.812803 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:04.813050 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:04.813498 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
W20260811 06:17:04.816890 13247 log.cc:924] Time spent T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260811 06:17:04.817342 11361 tablet_bootstrap.cc:654] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.805579 11365 raft_consensus.cc:348] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.818364 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:04.818923 11365 raft_consensus.cc:374] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.819986 11365 raft_consensus.cc:729] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.821563 11365 consensus_queue.cc:260] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.822402 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:04.823871 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:04.825868 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:04.826840 11365 ts_tablet_manager.cc:1428] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.022s user 0.003s sys 0.003s
I20260811 06:17:04.827119 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:04.829051 11365 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:04.829269 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:04.842844 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
W20260811 06:17:04.844286 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a2e55d5e0244c299d837aed98f94aad consensus state has no leader
I20260811 06:17:04.844591 11655 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 44) took 4534 ms. Trace:
I20260811 06:17:04.844841 11655 rpcz_store.cc:276] 0811 06:17:00.310492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.421703 (+2111211us) service_pool.cc:227] Handling call
0811 06:17:02.422318 (+ 615us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:02.422578 (+ 260us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:02.422825 (+ 247us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:02.422893 (+ 68us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:02.433595 (+ 10702us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:04.844477 (+2410882us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.428314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.428457 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.428466 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:02.428469 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:02.428586 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.428603 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.428608 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:02.428719 (+ 111us) tablet.cc:699] Row locks acquired
0811 06:17:02.428722 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.428763 (+ 41us) write_op.cc:270] Start()
0811 06:17:02.428801 (+ 38us) write_op.cc:276] Timestamp: P: 1786429022428685 usec, L: 0
0811 06:17:02.428805 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.429004 (+ 199us) log.cc:842] Serialized 405 byte log entry
0811 06:17:02.432800 (+ 3796us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.432973 (+ 173us) write_op.cc:301] APPLY: starting
0811 06:17:02.432992 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.433037 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.433107 (+ 70us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.433169 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.433209 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:02.433215 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.433300 (+ 85us) log.cc:842] Serialized 23 byte log entry
0811 06:17:02.433372 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.433495 (+ 123us) write_op.cc:454] Released schema lock
0811 06:17:02.433505 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:02.433577 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.433581 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":679,"apply.run_wall_time_us":677,"num_ops":1,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":860,"prepare.run_wall_time_us":860,"raft.queue_time_us":779,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":259,"replication_time_us":3969}]]}
W20260811 06:17:04.846271 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 88) took 1463 ms (client timeout 1000 ms). Trace:
W20260811 06:17:04.846529 11655 rpcz_store.cc:269] 0811 06:17:03.382808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.845933 (+1463125us) service_pool.cc:214] Skipping call since client already timed out
0811 06:17:04.846162 (+ 229us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260811 06:17:04.848086 12094 raft_consensus.cc:482] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.848384 12094 raft_consensus.cc:504] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.848948 12821 raft_consensus.cc:482] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.849233 12821 raft_consensus.cc:504] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.850193 12821 leader_election.cc:288] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.851349 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:04.852797 10564 leader_election.cc:341] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.856019 12726 ts_tablet_manager.cc:1918] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.857553 12726 log.cc:1196] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6c706bf0455341a0a953d937f9778b5f
I20260811 06:17:04.859249 12094 leader_election.cc:288] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:04.859725 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6dd4a21086934bd9a64d74075ab41fbe consensus state has no leader
I20260811 06:17:04.860180 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 38) took 5229 ms. Trace:
I20260811 06:17:04.860407 11684 rpcz_store.cc:276] 0811 06:16:59.630630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.122134 (+2491504us) service_pool.cc:227] Handling call
0811 06:17:02.122865 (+ 731us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:02.123075 (+ 210us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:02.123333 (+ 258us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:02.123414 (+ 81us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:02.139647 (+ 16233us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.139690 (+ 43us) write_op.cc:454] Released schema lock
0811 06:17:02.139807 (+ 117us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:04.859929 (+2720122us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:02.124227 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:02.124398 (+ 171us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:02.124405 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:02.124407 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:02.124522 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:02.124538 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:02.124543 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:02.124617 (+ 74us) tablet.cc:699] Row locks acquired
0811 06:17:02.124620 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:02.124656 (+ 36us) write_op.cc:270] Start()
0811 06:17:02.124694 (+ 38us) write_op.cc:276] Timestamp: P: 1786429022124594 usec, L: 0
0811 06:17:02.124698 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:02.124944 (+ 246us) log.cc:842] Serialized 405 byte log entry
0811 06:17:02.129747 (+ 4803us) op_driver.cc:444] REPLICATION: finished
0811 06:17:02.129954 (+ 207us) write_op.cc:301] APPLY: starting
0811 06:17:02.129973 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:02.130017 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:02.130085 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:02.130145 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:02.130181 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:02.130187 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:02.130330 (+ 143us) log.cc:842] Serialized 23 byte log entry
0811 06:17:02.130406 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:02.130427 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:02.130436 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":554,"apply.run_wall_time_us":553,"num_ops":1,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":842,"prepare.run_wall_time_us":843,"raft.queue_time_us":1158,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":423,"replication_time_us":4997}]]}
I20260811 06:17:04.858721 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.871070 12821 raft_consensus.cc:482] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.875921 12821 raft_consensus.cc:504] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.876880 12821 leader_election.cc:288] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.878703 12726 ts_tablet_manager.cc:1939] T 6c706bf0455341a0a953d937f9778b5f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:04.921617 10810 consensus_peers.cc:487] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:04.924299 13103 raft_consensus.cc:482] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.878542 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.887768 11161 raft_consensus.cc:3037] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:04.901394 11361 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:04.929800 11361 ts_tablet_manager.cc:1397] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.172s user 0.000s sys 0.009s
I20260811 06:17:04.931354 11361 raft_consensus.cc:348] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.931744 11361 raft_consensus.cc:374] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:04.931982 11361 raft_consensus.cc:729] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:04.932267 11361 consensus_queue.cc:260] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.933517 11361 ts_tablet_manager.cc:1428] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:04.934067 13103 raft_consensus.cc:504] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.934886 13103 leader_election.cc:288] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.935217 13142 raft_consensus.cc:482] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:04.883148 11365 tablet_bootstrap.cc:654] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:04.930341 10564 leader_election.cc:341] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:04.936776 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:04.939126 13142 raft_consensus.cc:504] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.939862 13142 leader_election.cc:288] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:04.939921 12821 consensus_queue.cc:1035] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.940083 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.940865 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:04.941438 10813 leader_election.cc:302] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:04.941779 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 63) took 2608 ms. Trace:
I20260811 06:17:04.945384 13181 tablet.cc:1722] T 5322caea49aa4b648b74c7692d6e0372 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:04.947280 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f243c792a634abf83484aef820dbb48" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:04.947726 11159 raft_consensus.cc:2379] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:17:04.948185 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:04.949800 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1a2e55d5e0244c299d837aed98f94aad consensus state has no leader
W20260811 06:17:04.951839 10555 consensus_peers.cc:487] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:04.954216 12963 consensus_queue.cc:1035] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:04.902782 12727 ts_tablet_manager.cc:1918] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:04.956622 12727 log.cc:1196] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6c706bf0455341a0a953d937f9778b5f
I20260811 06:17:04.957346 12727 ts_tablet_manager.cc:1939] T 6c706bf0455341a0a953d937f9778b5f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:04.957851 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 80) took 2710 ms. Trace:
I20260811 06:17:04.958071 12727 rpcz_store.cc:276] 0811 06:17:02.246889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.247168 (+ 279us) service_pool.cc:227] Handling call
0811 06:17:04.725913 (+2478745us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:17:04.725923 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.736815 (+ 10892us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.901738 (+164923us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.957796 (+ 56058us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2478498}
I20260811 06:17:04.959512 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 81) took 2711 ms. Trace:
I20260811 06:17:04.959820 12727 rpcz_store.cc:276] 0811 06:17:02.247591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.252033 (+ 4442us) service_pool.cc:227] Handling call
0811 06:17:04.958731 (+2706698us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:04.958880 (+ 149us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.959137 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2706350}
I20260811 06:17:04.961550 12727 tablet_replica.cc:330] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:04.962198 12727 raft_consensus.cc:2229] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:04.962904 11361 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:04.967782 13240 raft_consensus.cc:2781] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:04.968125 13240 raft_consensus.cc:686] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:04.970072 11361 tablet_bootstrap.cc:654] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:04.973954 12727 raft_consensus.cc:2258] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:04.975636 12727 ts_tablet_manager.cc:1905] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:04.969116 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 6c706bf0455341a0a953d937f9778b5f (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]) successfully deleted
W20260811 06:17:04.976461 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:04.977687 13240 consensus_queue.cc:237] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:04.989858 10810 leader_election.cc:302] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:04.992095 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:04.995918 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:04.996418 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:04.998032 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:04.999888 10813 consensus_peers.cc:487] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.000193 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.000406 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.001011 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.002552 13103 raft_consensus.cc:3037] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:05.003479 11683 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 0a67f283a7a6447daaecc9c03703b977 consensus state has no leader
I20260811 06:17:05.001667 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.006867 13132 consensus_queue.cc:1035] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.008060 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.008268 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1da7a10783f4bb9aadb20668aee95c2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.009629 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.010102 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.014060 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.015916 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.016628 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.017879 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.020184 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.021011 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.021327 10916 raft_consensus.cc:2379] T a1da7a10783f4bb9aadb20668aee95c2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:17:05.021797 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.022104 11047 leader_election.cc:302] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.023480 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.023890 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.025337 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.025568 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.025928 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.026578 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.026979 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.027727 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.054983 13103 raft_consensus.cc:2726] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.055495 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.056943 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.058683 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.060323 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.061512 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet cdb93dcd940a47e78c5458041c768e36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.064709 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.064953 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.065205 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.065428 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.065737 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.066056 12728 ts_tablet_manager.cc:1918] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:05.066380 12728 log.cc:1196] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6c62cbef937a46dfbc4dbf934e887139
I20260811 06:17:05.067234 12728 ts_tablet_manager.cc:1939] T 6c62cbef937a46dfbc4dbf934e887139 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:05.070799 11679 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 30cffba93ad74e84812e5879b851119f consensus state has no leader
I20260811 06:17:05.071738 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 864c3bbf1e004579a4d0be809f83ca33 with delete_type TABLET_DATA_DELETED (replaced by tablet b246b0e53af34c089f4fd67174396f44) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.072554 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.073321 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.076792 12726 rpcz_store.cc:276] 0811 06:17:02.333522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.333606 (+ 84us) service_pool.cc:227] Handling call
0811 06:17:04.600207 (+2266601us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:17:04.600220 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:04.628710 (+ 28490us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.633143 (+ 4433us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:04.941676 (+308533us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2264833}
I20260811 06:17:05.078200 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab32f96671984766a54b5ee904c465f7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.078682 10661 raft_consensus.cc:2379] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:05.079195 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.079559 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.079914 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.080219 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.080523 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:05.081617 10555 leader_election.cc:341] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.081619 11362 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.082458 12726 tablet_replica.cc:330] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:05.082950 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.083559 10555 leader_election.cc:302] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.083988 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.084174 11362 ts_tablet_manager.cc:1397] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.385s user 0.000s sys 0.009s
I20260811 06:17:05.084197 12821 raft_consensus.cc:2726] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.084367 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.085305 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.085520 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.086131 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.086359 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 76) took 2862 ms. Trace:
I20260811 06:17:05.086879 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:05.091101 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 131860us
W20260811 06:17:05.091447 10555 leader_election.cc:341] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.091648 10555 leader_election.cc:302] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.091940 12728 rpcz_store.cc:276] 0811 06:17:02.223250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.224176 (+ 926us) service_pool.cc:227] Handling call
0811 06:17:04.781773 (+2557597us) ts_tablet_manager.cc:1145] Deleting tablet 6c62cbef937a46dfbc4dbf934e887139
0811 06:17:04.781803 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.004874 (+223071us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.031709 (+ 26835us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.085991 (+ 54282us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2556099}
I20260811 06:17:05.092541 10810 leader_election.cc:302] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.092832 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.093006 13158 raft_consensus.cc:2726] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.093130 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.093364 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.093586 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.093789 13241 raft_consensus.cc:3037] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.093822 12821 raft_consensus.cc:482] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.093987 12821 raft_consensus.cc:504] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.094678 12821 leader_election.cc:288] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.095044 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.095248 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.095439 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:05.096293 12726 raft_consensus.cc:2229] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 2 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.096709 12726 raft_consensus.cc:2258] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.097553 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:05.098250 10555 leader_election.cc:341] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.098665 12726 ts_tablet_manager.cc:1905] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.102316 13102 raft_consensus.cc:482] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8dcf15ece3a4389932aa672079442b6)
I20260811 06:17:05.102530 13102 raft_consensus.cc:504] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.103197 13102 leader_election.cc:288] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.106738 13241 raft_consensus.cc:2726] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:05.107836 10555 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:05.093986 11362 raft_consensus.cc:348] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.108460 11362 raft_consensus.cc:374] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.108736 11362 raft_consensus.cc:729] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.108982 11365 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:05.109297 11365 ts_tablet_manager.cc:1397] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.281s user 0.006s sys 0.002s
I20260811 06:17:05.109447 11362 consensus_queue.cc:260] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.110430 11362 ts_tablet_manager.cc:1428] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.026s user 0.000s sys 0.002s
I20260811 06:17:05.110801 11365 raft_consensus.cc:348] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.111204 11365 raft_consensus.cc:374] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.111441 11365 raft_consensus.cc:729] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.111626 11362 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.111944 11365 consensus_queue.cc:260] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.112793 11365 ts_tablet_manager.cc:1428] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:05.113461 11365 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:05.120805 11362 tablet_bootstrap.cc:654] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.117682 11365 tablet_bootstrap.cc:654] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.128810 12821 consensus_queue.cc:1035] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260811 06:17:05.132368 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 78) took 2869 ms. Trace:
W20260811 06:17:05.138598 11656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 85) took 4243 ms (client timeout 1000 ms). Trace:
W20260811 06:17:05.138779 11656 rpcz_store.cc:269] 0811 06:17:00.894285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.646005 (+751720us) service_pool.cc:227] Handling call
0811 06:17:05.137204 (+3491199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41181,"reported_tablets":220}
I20260811 06:17:05.139532 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6c706bf0455341a0a953d937f9778b5f (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]) successfully deleted
W20260811 06:17:05.140791 11584 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 57258.4us
I20260811 06:17:05.142501 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6c62cbef937a46dfbc4dbf934e887139 (table default.Table_6b45271419ea4e4a9b82a7aff6a113f7 [id=28510dda062b4164a5672202cb2f268c]) successfully deleted
I20260811 06:17:05.151842 12728 rpcz_store.cc:276] 0811 06:17:02.223626 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.225882 (+ 2256us) service_pool.cc:227] Handling call
0811 06:17:05.092454 (+2866572us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:05.092470 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.092614 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2866234}
I20260811 06:17:05.152376 12728 tablet_replica.cc:330] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:05.152657 12728 raft_consensus.cc:2229] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.153167 12728 raft_consensus.cc:2258] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.153965 12728 ts_tablet_manager.cc:1905] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.158138 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:05.158972 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:05.159029 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:05.164626 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:05.166937 11653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 86) took 4119 ms (client timeout 1000 ms). Trace:
W20260811 06:17:05.167125 11653 rpcz_store.cc:269] 0811 06:17:01.045559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.663965 (+618406us) service_pool.cc:227] Handling call
0811 06:17:05.165260 (+3501295us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58139,"reported_tablets":216}
I20260811 06:17:05.177541 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:05.190990 10564 leader_election.cc:341] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:05.191560 10564 leader_election.cc:302] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.192139 12821 raft_consensus.cc:2726] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:05.193996 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:05.197016 10564 leader_election.cc:341] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.197889 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3991f735c6434abc80dec8d381869762" } modify_external_catalogs: true
I20260811 06:17:05.198349 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3991f735c6434abc80dec8d381869762" } modify_external_catalogs: true
I20260811 06:17:05.197546 10564 leader_election.cc:302] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.200400 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.200824 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.200999 12774 raft_consensus.cc:2726] T a1da7a10783f4bb9aadb20668aee95c2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.201691 12821 raft_consensus.cc:2726] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.201666 12774 consensus_queue.cc:1035] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:17:05.202244 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.202728 12094 consensus_queue.cc:1035] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260811 06:17:05.203814 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.205899 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.206174 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.206705 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:05.207361 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 80) took 3334 ms (client timeout 1000 ms). Trace:
I20260811 06:17:05.208945 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.209177 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.208966 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:05.209429 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 87) took 2869 ms (client timeout 1000 ms). Trace:
W20260811 06:17:05.209575 11679 rpcz_store.cc:269] 0811 06:17:02.338460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.401683 (+ 63223us) service_pool.cc:227] Handling call
0811 06:17:05.207812 (+2806129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36848,"reported_tablets":225}
I20260811 06:17:05.210153 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.210361 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.211120 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:05.212205 11683 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 86) took 3111 ms (client timeout 1000 ms). Trace:
W20260811 06:17:05.212412 11683 rpcz_store.cc:269] 0811 06:17:02.100948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.117021 (+ 16073us) service_pool.cc:227] Handling call
0811 06:17:03.627947 (+1510926us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.627956 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:05.212035 (+1584079us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:03.610511 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:03.610772 (+ 261us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:03.610781 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:03.610784 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:03.611138 (+ 354us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:03.611159 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:03.611167 (+ 8us) tablet.cc:683] Acquiring locks for 4 operations
0811 06:17:03.611304 (+ 137us) tablet.cc:699] Row locks acquired
0811 06:17:03.611307 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:03.611377 (+ 70us) write_op.cc:270] Start()
0811 06:17:03.611423 (+ 46us) write_op.cc:276] Timestamp: P: 1786429023611312 usec, L: 0
0811 06:17:03.611427 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:03.611859 (+ 432us) log.cc:842] Serialized 1662 byte log entry
0811 06:17:03.618658 (+ 6799us) op_driver.cc:444] REPLICATION: finished
0811 06:17:03.618809 (+ 151us) write_op.cc:301] APPLY: starting
0811 06:17:03.618833 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:03.618901 (+ 68us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:03.618935 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:03.619049 (+ 114us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:03.619097 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0811 06:17:03.619104 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:03.619220 (+ 116us) log.cc:842] Serialized 41 byte log entry
0811 06:17:03.619299 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.619332 (+ 33us) write_op.cc:454] Released schema lock
0811 06:17:03.619342 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":48889,"reported_tablets":223,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":602,"apply.run_wall_time_us":601,"num_ops":4,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":1507,"prepare.run_wall_time_us":1508,"raft.queue_time_us":1386,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":417,"replication_time_us":7191}]]}
I20260811 06:17:05.214564 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.215211 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:05.216482 11670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 79) took 4467 ms (client timeout 1000 ms). Trace:
W20260811 06:17:05.216692 11670 rpcz_store.cc:269] 0811 06:17:00.744295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.351511 (+607216us) service_pool.cc:227] Handling call
0811 06:17:05.211625 (+3860114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45468,"reported_tablets":225}
I20260811 06:17:05.217240 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.228268 11362 tablet_bootstrap.cc:492] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.228489 11362 ts_tablet_manager.cc:1397] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.005s
I20260811 06:17:05.229969 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_0363307b6205431e911d6f5a556b6bd2" } modify_external_catalogs: true
I20260811 06:17:05.232654 11683 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d7b23f45b7b14c719f98c5b359db7502" } new_table_name: "default.Table_33b9f31254094f76a6490edc033c7d2c" modify_external_catalogs: true
W20260811 06:17:05.218910 11663 rpcz_store.cc:269] 0811 06:17:01.870208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:01.945382 (+ 75174us) service_pool.cc:227] Handling call
0811 06:17:03.417522 (+1472140us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.417533 (+ 11us) write_op.cc:454] Released schema lock
0811 06:17:05.204780 (+1787247us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:03.402111 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:03.402242 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:03.402249 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:03.402252 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:03.402385 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:03.402401 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:03.402406 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:03.402483 (+ 77us) tablet.cc:699] Row locks acquired
0811 06:17:03.402486 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:03.402533 (+ 47us) write_op.cc:270] Start()
0811 06:17:03.402577 (+ 44us) write_op.cc:276] Timestamp: P: 1786429023402489 usec, L: 0
0811 06:17:03.402582 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:03.402809 (+ 227us) log.cc:842] Serialized 530 byte log entry
0811 06:17:03.407961 (+ 5152us) op_driver.cc:444] REPLICATION: finished
0811 06:17:03.408118 (+ 157us) write_op.cc:301] APPLY: starting
0811 06:17:03.408139 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:03.408183 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:03.408269 (+ 86us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:03.408366 (+ 97us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:03.408408 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:03.408415 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:03.408511 (+ 96us) log.cc:842] Serialized 23 byte log entry
0811 06:17:03.408586 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:03.408608 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:03.408616 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":88534,"reported_tablets":230,"child_traces":[["op",{"apply.queue_time_us":97,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":567,"num_ops":1,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":836,"prepare.run_wall_time_us":837,"raft.queue_time_us":1445,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":280,"replication_time_us":5347}]]}
I20260811 06:17:05.235526 11663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_6e61e223c12c4b6ebc75c0d5d04491c0" } modify_external_catalogs: true
I20260811 06:17:05.235955 11679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_02a8e77ed1244d0fad74b7f3de65575a" } modify_external_catalogs: true
I20260811 06:17:05.241148 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_0363307b6205431e911d6f5a556b6bd2" } modify_external_catalogs: true
I20260811 06:17:05.241864 11361 tablet_bootstrap.cc:492] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.249861 11679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_02a8e77ed1244d0fad74b7f3de65575a" } modify_external_catalogs: true
I20260811 06:17:05.253132 11362 raft_consensus.cc:348] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.253898 11362 raft_consensus.cc:374] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.254140 11362 raft_consensus.cc:729] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.254088 11663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_6e61e223c12c4b6ebc75c0d5d04491c0" } modify_external_catalogs: true
I20260811 06:17:05.254583 11362 consensus_queue.cc:260] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.255502 11362 ts_tablet_manager.cc:1428] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.027s user 0.000s sys 0.003s
I20260811 06:17:05.256021 11362 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.267402 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:05.268883 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.269845 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.272580 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.269078 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:05.274314 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.274941 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:05.276305 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 61d60602164540e4bbfabe00351809ee (DEFAULT_TABLE table=default.Table_06b0354f6caf43b89e9cccafc05ae8e4 [id=672d4aefe43448b182b60a05b6c86188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.289057 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.289743 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet d668bcfbeff54181ba3b4407b1eb5704 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.290215 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.289659 12728 ts_tablet_manager.cc:1918] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:05.290657 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet a378a6f20c564eb685b655a762b638ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.290937 11361 ts_tablet_manager.cc:1397] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.279s user 0.002s sys 0.011s
I20260811 06:17:05.290884 12728 log.cc:1196] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/3250276181a24e58a2db92376b7520e7
I20260811 06:17:05.291982 11361 raft_consensus.cc:348] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.292471 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.292836 12728 ts_tablet_manager.cc:1939] T 3250276181a24e58a2db92376b7520e7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.293582 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.294291 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.295022 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ac8c5daeb3249e38d863ee94f1267b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8bd026d2c6064a67b1c432efa4474a0e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.296211 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet ea4eb7f5db2e4e75818bfb228b64ed0d with delete_type TABLET_DATA_DELETED (replaced by tablet 0813b34919a14a2481857e9f87b217c8) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.299072 10634 tablet_service.cc:1467] Processing CreateTablet for tablet f010c30e91f1463d8206b961e2550484 (DEFAULT_TABLE table=default.Table_cec5b49f1dee44e785c6ef74c5ca41fe [id=f3507f24ef314f6da2833df8d36d961b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.299129 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 524db95e51fe444497aa1c558bd4539a (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.300062 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 824922c54d7e4e6bbc98c1002e7bff22 (DEFAULT_TABLE table=default.Table_66bf56dc63cc4ebe91984891082c9c8c [id=c910122406fb46798c5cce228188750e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.300994 10880 tablet_service.cc:1467] Processing CreateTablet for tablet f010c30e91f1463d8206b961e2550484 (DEFAULT_TABLE table=default.Table_cec5b49f1dee44e785c6ef74c5ca41fe [id=f3507f24ef314f6da2833df8d36d961b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.301141 10610 tablet_service.cc:1467] Processing CreateTablet for tablet b23c8754701444db93ceb1131a98b1dc (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.301811 12727 ts_tablet_manager.cc:1918] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.302011 12727 log.cc:1196] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/52953438e7c248b1a758ee219405d7da
I20260811 06:17:05.302248 12821 raft_consensus.cc:482] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56a371f7ed104f68a5db9ca097eb237e)
I20260811 06:17:05.300673 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 524db95e51fe444497aa1c558bd4539a (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.302567 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 61d60602164540e4bbfabe00351809ee (DEFAULT_TABLE table=default.Table_06b0354f6caf43b89e9cccafc05ae8e4 [id=672d4aefe43448b182b60a05b6c86188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.302784 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303078 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.302994 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 814b7a212b164b4f8551ece59f57fafd (DEFAULT_TABLE table=default.Table_e13f1a2d6d924970ae68d9a31b0f6903 [id=3a2515f63b5a43748aa881e7670ad943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.303251 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61d60602164540e4bbfabe00351809ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.303246 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303288 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 824922c54d7e4e6bbc98c1002e7bff22 (DEFAULT_TABLE table=default.Table_66bf56dc63cc4ebe91984891082c9c8c [id=c910122406fb46798c5cce228188750e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.303524 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f010c30e91f1463d8206b961e2550484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.303563 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303601 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 285b85c854bf400295b288314947840e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303761 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303892 11361 raft_consensus.cc:374] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.303923 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 67f458dba9444bfa8841a84cdb798588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.303884 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 524db95e51fe444497aa1c558bd4539a (DEFAULT_TABLE table=default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.303998 11361 raft_consensus.cc:729] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.304070 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bbf657cb27f4da9a4f595242864163a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.304208 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c5fa9633057485b917f117819d79398 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.304390 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.304417 10853 tablet_service.cc:1467] Processing CreateTablet for tablet b23c8754701444db93ceb1131a98b1dc (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.304555 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.304723 11118 tablet_service.cc:1467] Processing CreateTablet for tablet 814b7a212b164b4f8551ece59f57fafd (DEFAULT_TABLE table=default.Table_e13f1a2d6d924970ae68d9a31b0f6903 [id=3a2515f63b5a43748aa881e7670ad943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.304998 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 814b7a212b164b4f8551ece59f57fafd (DEFAULT_TABLE table=default.Table_e13f1a2d6d924970ae68d9a31b0f6903 [id=3a2515f63b5a43748aa881e7670ad943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.305128 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efe8eb16e84575abd18a5079aad2c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:05.305294 11109 tablet_service.cc:1467] Processing CreateTablet for tablet f010c30e91f1463d8206b961e2550484 (DEFAULT_TABLE table=default.Table_cec5b49f1dee44e785c6ef74c5ca41fe [id=f3507f24ef314f6da2833df8d36d961b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.305641 11128 tablet_service.cc:1467] Processing CreateTablet for tablet 61d60602164540e4bbfabe00351809ee (DEFAULT_TABLE table=default.Table_06b0354f6caf43b89e9cccafc05ae8e4 [id=672d4aefe43448b182b60a05b6c86188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.305990 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 824922c54d7e4e6bbc98c1002e7bff22 (DEFAULT_TABLE table=default.Table_66bf56dc63cc4ebe91984891082c9c8c [id=c910122406fb46798c5cce228188750e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.306708 12821 raft_consensus.cc:504] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:05.309237 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524db95e51fe444497aa1c558bd4539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.309515 11109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f010c30e91f1463d8206b961e2550484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.309566 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824922c54d7e4e6bbc98c1002e7bff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.309681 11115 tablet_service.cc:1467] Processing CreateTablet for tablet b23c8754701444db93ceb1131a98b1dc (DEFAULT_TABLE table=default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.310139 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b23c8754701444db93ceb1131a98b1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.312337 11362 tablet_bootstrap.cc:654] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.313622 12821 leader_election.cc:288] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:05.313998 10564 leader_election.cc:341] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:05.316098 10915 raft_consensus.cc:3037] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.319396 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61d60602164540e4bbfabe00351809ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.320698 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824922c54d7e4e6bbc98c1002e7bff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.321332 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f010c30e91f1463d8206b961e2550484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.321825 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b23c8754701444db93ceb1131a98b1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.324913 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:05.325955 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61d60602164540e4bbfabe00351809ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.326604 11118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814b7a212b164b4f8551ece59f57fafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.326594 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:05.328116 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:05.304400 11361 consensus_queue.cc:260] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.329087 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:05.329298 11361 ts_tablet_manager.cc:1428] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260811 06:17:05.329795 11361 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.330296 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:05.330976 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 824922c54d7e4e6bbc98c1002e7bff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.332983 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:05.333956 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524db95e51fe444497aa1c558bd4539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.335245 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:05.336122 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:05.336949 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:05.337982 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b23c8754701444db93ceb1131a98b1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.338620 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:05.339640 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:05.340297 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:05.341473 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:05.342533 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:05.343590 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]). Expected version 1 got 0
I20260811 06:17:05.343998 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:05.344486 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:05.345749 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:05.346182 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:05.346661 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:05.347172 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:05.347626 12727 ts_tablet_manager.cc:1939] T 52953438e7c248b1a758ee219405d7da P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.347785 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:05.348522 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:05.348614 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 82) took 3096 ms. Trace:
I20260811 06:17:05.348744 12727 rpcz_store.cc:276] 0811 06:17:02.252624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.253054 (+ 430us) service_pool.cc:227] Handling call
0811 06:17:04.960540 (+2707486us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:17:04.960553 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.040369 (+ 79816us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.290563 (+250194us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.348570 (+ 58007us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2706616}
I20260811 06:17:05.348990 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:05.349270 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 83) took 3095 ms. Trace:
I20260811 06:17:05.349416 12727 rpcz_store.cc:276] 0811 06:17:02.253425 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.253480 (+ 55us) service_pool.cc:227] Handling call
0811 06:17:05.349082 (+3095602us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:17:05.349094 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.349237 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3094881}
I20260811 06:17:05.349699 12727 tablet_replica.cc:330] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.349956 12727 raft_consensus.cc:2229] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.350147 12727 raft_consensus.cc:2258] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.351092 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:05.352032 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:05.352870 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:05.353823 13132 consensus_queue.cc:1035] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.354312 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814b7a212b164b4f8551ece59f57fafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.354328 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:05.354753 13132 consensus_queue.cc:1035] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.355095 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:05.356081 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:05.356681 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:05.357494 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:05.358378 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8123e24a8bbf4bd6a9344a83ca2163fc (table default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb]). Expected version 3 got 0
W20260811 06:17:05.358764 10555 leader_election.cc:341] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:05.360858 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:05.361575 11655 catalog_manager.cc:5495] T 3b658d1cd9b74251981fe1ff3959033a P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:05.363183 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:05.363633 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:05.365159 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:05.365578 11365 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:05.365578 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:05.366814 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 52953438e7c248b1a758ee219405d7da (table default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]) successfully deleted
W20260811 06:17:05.367312 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ad5529d4844f61b0888624e7c8b3ce already in progress: creating tablet
I20260811 06:17:05.367928 11365 ts_tablet_manager.cc:1397] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.253s user 0.011s sys 0.004s
I20260811 06:17:05.370076 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 524db95e51fe444497aa1c558bd4539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.374207 10613 tablet_service.cc:1467] Processing CreateTablet for tablet c7e350aaabbe42968eb8afb509bd8f4e (DEFAULT_TABLE table=default.Table_befcafaab1e245148bebd1c621529067 [id=31262d66a31e4a34a9fef4ba1a065cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.374789 11121 tablet_service.cc:1467] Processing CreateTablet for tablet c7e350aaabbe42968eb8afb509bd8f4e (DEFAULT_TABLE table=default.Table_befcafaab1e245148bebd1c621529067 [id=31262d66a31e4a34a9fef4ba1a065cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.375247 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7e350aaabbe42968eb8afb509bd8f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.375283 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814b7a212b164b4f8551ece59f57fafd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.376104 11105 tablet_service.cc:1467] Processing CreateTablet for tablet 3e18efafb7d44746917564c571171838 (DEFAULT_TABLE table=default.Table_4a2b60315e3c40e4bb277aab3d4e95a2 [id=714e4940130248e382bb3039f3b05408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.376535 11105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e18efafb7d44746917564c571171838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.377451 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad (DEFAULT_TABLE table=default.Table_dbdcfb64222a463388e5d6de872051e3 [id=d46383f077cd4045a300287fc0b8b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.377919 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.378707 12484 consensus_queue.cc:1035] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.383082 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:05.383404 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 3e18efafb7d44746917564c571171838 (DEFAULT_TABLE table=default.Table_4a2b60315e3c40e4bb277aab3d4e95a2 [id=714e4940130248e382bb3039f3b05408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.376801 11365 raft_consensus.cc:348] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.384204 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad (DEFAULT_TABLE table=default.Table_dbdcfb64222a463388e5d6de872051e3 [id=d46383f077cd4045a300287fc0b8b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.385257 10555 leader_election.cc:302] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:05.385658 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 66581.2us
I20260811 06:17:05.382607 12727 ts_tablet_manager.cc:1905] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.382556 13132 consensus_queue.cc:1035] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.387203 13284 raft_consensus.cc:2726] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:05.388298 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7e350aaabbe42968eb8afb509bd8f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.388639 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e18efafb7d44746917564c571171838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.389356 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.392731 11362 tablet_bootstrap.cc:492] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.392997 11362 ts_tablet_manager.cc:1397] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.137s user 0.004s sys 0.017s
I20260811 06:17:05.395913 11362 raft_consensus.cc:348] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.396158 11362 raft_consensus.cc:374] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.396289 11362 raft_consensus.cc:729] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.396493 11362 consensus_queue.cc:260] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.397080 11362 ts_tablet_manager.cc:1428] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260811 06:17:05.401247 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:05.401741 11655 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:05.417477 12774 raft_consensus.cc:482] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.417796 12944 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.417886 11362 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.417938 12944 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.418615 12944 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.419571 12774 raft_consensus.cc:504] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.420202 12774 leader_election.cc:288] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.420433 11362 tablet_bootstrap.cc:654] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.421815 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.422184 10651 raft_consensus.cc:2454] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:05.422817 10810 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:05.423106 12944 raft_consensus.cc:2781] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:05.423187 12944 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.423246 12944 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.426220 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad (DEFAULT_TABLE table=default.Table_dbdcfb64222a463388e5d6de872051e3 [id=d46383f077cd4045a300287fc0b8b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.426710 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8fd9d5b01b4b3e990a1030cc5748ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.427352 12944 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.428764 12944 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.428915 10879 tablet_service.cc:1467] Processing CreateTablet for tablet c7e350aaabbe42968eb8afb509bd8f4e (DEFAULT_TABLE table=default.Table_befcafaab1e245148bebd1c621529067 [id=31262d66a31e4a34a9fef4ba1a065cb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.429320 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7e350aaabbe42968eb8afb509bd8f4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.429839 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.401422 12484 raft_consensus.cc:482] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56a371f7ed104f68a5db9ca097eb237e)
I20260811 06:17:05.430864 12484 raft_consensus.cc:504] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.431308 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 3e18efafb7d44746917564c571171838 (DEFAULT_TABLE table=default.Table_4a2b60315e3c40e4bb277aab3d4e95a2 [id=714e4940130248e382bb3039f3b05408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:05.431677 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e18efafb7d44746917564c571171838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:05.433864 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
W20260811 06:17:05.433830 11046 leader_election.cc:341] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
W20260811 06:17:05.444150 10072 leader_election.cc:334] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Timed out: RequestConsensusVote RPC to 127.9.203.124:45045 timed out after 0.646s (SENT)
I20260811 06:17:05.444638 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
I20260811 06:17:05.430213 10662 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.430442 11365 raft_consensus.cc:374] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.446574 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 79) took 3219 ms. Trace:
I20260811 06:17:05.447198 11361 tablet_bootstrap.cc:654] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.447172 12728 rpcz_store.cc:276] 0811 06:17:02.277881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.278182 (+ 301us) service_pool.cc:227] Handling call
0811 06:17:05.152252 (+2874070us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:17:05.152266 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.242425 (+ 90159us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.288826 (+ 46401us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.446544 (+157718us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2873586}
I20260811 06:17:05.447947 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 3250276181a24e58a2db92376b7520e7 (table default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]) successfully deleted
I20260811 06:17:05.450946 11365 raft_consensus.cc:729] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.453403 11365 consensus_queue.cc:260] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.460287 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.467454 11365 ts_tablet_manager.cc:1428] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.090s user 0.004s sys 0.000s
I20260811 06:17:05.468042 11365 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:05.473399 13303 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 06:17:05.475585 12821 consensus_queue.cc:1035] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.479173 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 80) took 3200 ms. Trace:
I20260811 06:17:05.492215 12484 leader_election.cc:288] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.480679 12728 rpcz_store.cc:276] 0811 06:17:02.278127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.280078 (+ 1951us) service_pool.cc:227] Handling call
0811 06:17:05.447579 (+3167501us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:17:05.476178 (+ 28599us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.478886 (+ 2708us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167019}
W20260811 06:17:05.492688 11047 leader_election.cc:341] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:05.493173 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet adc2d99019384c33840f16cbe98d336c because the tablet was not found. No further retry: Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
I20260811 06:17:05.500702 10662 raft_consensus.cc:2454] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:05.502775 10810 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:05.502908 12728 tablet_replica.cc:330] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:05.503501 12726 ts_tablet_manager.cc:1918] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260811 06:17:05.503892 12726 log.cc:1196] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/adc2d99019384c33840f16cbe98d336c
I20260811 06:17:05.504813 12726 ts_tablet_manager.cc:1939] T adc2d99019384c33840f16cbe98d336c P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:05.505478 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 65) took 3169 ms. Trace:
I20260811 06:17:05.505694 12726 rpcz_store.cc:276] 0811 06:17:02.335667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.335716 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:05.077218 (+2741502us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:17:05.077234 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.247266 (+170032us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.503325 (+256059us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.505419 (+ 2094us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2741073}
I20260811 06:17:05.506289 12728 raft_consensus.cc:2229] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.506629 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet adc2d99019384c33840f16cbe98d336c (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:17:05.507213 12726 tablet_replica.cc:330] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:05.507191 12728 raft_consensus.cc:2258] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.507745 12726 raft_consensus.cc:2229] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.508246 12726 raft_consensus.cc:2258] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.519328 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:05.519659 11159 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.522450 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:05.522454 12728 ts_tablet_manager.cc:1905] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.525746 11159 raft_consensus.cc:2454] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:05.527140 12944 raft_consensus.cc:2781] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.527467 12944 raft_consensus.cc:686] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
W20260811 06:17:05.539556 11047 leader_election.cc:341] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
I20260811 06:17:05.539738 11047 leader_election.cc:302] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.543470 12727 ts_tablet_manager.cc:1918] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260811 06:17:05.543618 12727 log.cc:1196] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/adc2d99019384c33840f16cbe98d336c
I20260811 06:17:05.544054 12727 ts_tablet_manager.cc:1939] T adc2d99019384c33840f16cbe98d336c P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.550382 12094 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.550540 12094 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.551210 12094 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.558085 12774 consensus_queue.cc:1035] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.534649 13284 consensus_queue.cc:1035] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.537266 11365 tablet_bootstrap.cc:654] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.552958 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.561930 10661 raft_consensus.cc:2454] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:05.562021 12484 raft_consensus.cc:2726] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:05.562448 11046 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:05.562860 12484 raft_consensus.cc:2781] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 06:17:05.562960 12484 raft_consensus.cc:482] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.563036 12484 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:17:05.563113 12726 ts_tablet_manager.cc:1905] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.439096 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.565568 10651 raft_consensus.cc:2454] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:05.566197 11046 leader_election.cc:302] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.566623 12774 raft_consensus.cc:2781] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:05.566695 12774 raft_consensus.cc:482] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.566752 12774 raft_consensus.cc:3037] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:05.558647 13293 log.cc:924] Time spent T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260811 06:17:05.570073 12774 raft_consensus.cc:504] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.570786 12774 leader_election.cc:288] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.572570 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.573052 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.574219 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:05.575791 12484 raft_consensus.cc:504] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:05.577636 11047 leader_election.cc:341] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.582082 10659 raft_consensus.cc:3037] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.583060 12484 leader_election.cc:288] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.583727 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:05.583570 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1981dc26be24ec5afaa3c0bb5c46c8c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.589039 11361 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.589192 11361 ts_tablet_manager.cc:1397] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.260s user 0.004s sys 0.004s
I20260811 06:17:05.590510 11361 raft_consensus.cc:348] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.590761 11361 raft_consensus.cc:374] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.590821 11361 raft_consensus.cc:729] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.592164 11361 consensus_queue.cc:260] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.592738 11361 ts_tablet_manager.cc:1428] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:05.593006 11361 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.596408 11361 tablet_bootstrap.cc:654] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.527834 12944 consensus_queue.cc:237] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.599793 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 84) took 3343 ms. Trace:
I20260811 06:17:05.603482 12727 rpcz_store.cc:276] 0811 06:17:02.256154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.256203 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:05.349637 (+3093434us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:17:05.349648 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.518787 (+169139us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.543338 (+ 24551us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.599764 (+ 56426us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54780,"tablet-delete.queue_time_us":3093063}
I20260811 06:17:05.604121 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 85) took 3347 ms. Trace:
I20260811 06:17:05.604167 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet adc2d99019384c33840f16cbe98d336c (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:17:05.604216 12727 rpcz_store.cc:276] 0811 06:17:02.256901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.256947 (+ 46us) service_pool.cc:227] Handling call
0811 06:17:05.603875 (+3346928us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:17:05.603889 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.604101 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3346636}
I20260811 06:17:05.604669 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 86) took 3347 ms. Trace:
I20260811 06:17:05.604758 12727 rpcz_store.cc:276] 0811 06:17:02.257543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.257585 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:05.604488 (+3346903us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:17:05.604499 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.604650 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3346418}
I20260811 06:17:05.605014 12727 tablet_replica.cc:330] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:05.605065 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:05.605211 12727 raft_consensus.cc:2229] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.605520 12727 raft_consensus.cc:2258] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:05.605937 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
I20260811 06:17:05.606153 12727 ts_tablet_manager.cc:1905] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.606637 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:05.607228 13103 raft_consensus.cc:482] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.607410 13103 raft_consensus.cc:504] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.609050 13103 leader_election.cc:288] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.608263 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:05.612798 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:05.614997 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:05.619019 12728 ts_tablet_manager.cc:1918] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.619144 12728 log.cc:1196] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/37e73b8798b2455baf642abc532a5d8c
I20260811 06:17:05.619606 12728 ts_tablet_manager.cc:1939] T 37e73b8798b2455baf642abc532a5d8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.620396 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 81) took 3339 ms. Trace:
I20260811 06:17:05.620483 12728 rpcz_store.cc:276] 0811 06:17:02.280878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.282845 (+ 1967us) service_pool.cc:227] Handling call
0811 06:17:05.494700 (+3211855us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:17:05.494717 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.610447 (+115730us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.618913 (+ 8466us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.620376 (+ 1463us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2476,"tablet-delete.queue_time_us":3211344}
I20260811 06:17:05.628204 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 37e73b8798b2455baf642abc532a5d8c (table default.Table_24b24206598e4f27a32cabb7ed03ed3e [id=4bc106defb5246f6b2ceed8c51ba1516]) successfully deleted
I20260811 06:17:05.630264 10651 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:17:05.630841 12728 tablet_replica.cc:330] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:17:05.631062 10813 leader_election.cc:341] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:05.632218 12727 ts_tablet_manager.cc:1918] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.632337 12727 log.cc:1196] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6dee9af5a4504b8284c9150298ab3462
I20260811 06:17:05.632753 12727 ts_tablet_manager.cc:1939] T 6dee9af5a4504b8284c9150298ab3462 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.633271 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 87) took 3374 ms. Trace:
I20260811 06:17:05.633360 12727 rpcz_store.cc:276] 0811 06:17:02.258421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.258464 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:05.604973 (+3346509us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:17:05.604982 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.626310 (+ 21328us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.632103 (+ 5793us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.633254 (+ 1151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3346204}
I20260811 06:17:05.633759 12727 tablet_replica.cc:330] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.631059 12728 raft_consensus.cc:2229] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.633926 12728 pending_rounds.cc:62] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:05.633961 12727 raft_consensus.cc:2229] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.633988 12728 pending_rounds.cc:68] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213283889565696 op_type: NO_OP noop_request { }
I20260811 06:17:05.634174 12728 raft_consensus.cc:2866] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:05.634286 12727 pending_rounds.cc:62] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:05.634346 12728 raft_consensus.cc:2258] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.634341 12727 pending_rounds.cc:68] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213259560689664 op_type: NO_OP noop_request { }
I20260811 06:17:05.634449 12727 raft_consensus.cc:2866] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:05.634531 12727 raft_consensus.cc:2258] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.634990 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 6dee9af5a4504b8284c9150298ab3462 (table default.Table_ac3235af8d1f42d29a220ec551aa448a [id=3b92a2f628794cb3827f5015816baa11]) successfully deleted
I20260811 06:17:05.637332 12727 ts_tablet_manager.cc:1905] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:05.639986 10555 consensus_peers.cc:487] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.635818 12728 ts_tablet_manager.cc:1905] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:05.636915 10810 leader_election.cc:341] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:05.642163 10810 leader_election.cc:302] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.646262 12727 ts_tablet_manager.cc:1918] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.646236 12728 ts_tablet_manager.cc:1918] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.646390 12727 log.cc:1196] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/516021603ee24b3f9bdffd1e30e5ea9d
I20260811 06:17:05.646446 12728 log.cc:1196] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2f243c792a634abf83484aef820dbb48
I20260811 06:17:05.646796 12727 ts_tablet_manager.cc:1939] T 516021603ee24b3f9bdffd1e30e5ea9d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.646844 12728 ts_tablet_manager.cc:1939] T 2f243c792a634abf83484aef820dbb48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.647639 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 88) took 3388 ms. Trace:
I20260811 06:17:05.647652 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 82) took 3364 ms. Trace:
I20260811 06:17:05.647738 12728 rpcz_store.cc:276] 0811 06:17:02.283411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.285034 (+ 1623us) service_pool.cc:227] Handling call
0811 06:17:05.628128 (+3343094us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:17:05.630791 (+ 2663us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.644043 (+ 13252us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.646143 (+ 2100us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.647631 (+ 1488us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3342653}
I20260811 06:17:05.647737 12727 rpcz_store.cc:276] 0811 06:17:02.259107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.259152 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:05.633700 (+3374548us) ts_tablet_manager.cc:1145] Deleting tablet 516021603ee24b3f9bdffd1e30e5ea9d
0811 06:17:05.633725 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.640884 (+ 7159us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.646158 (+ 5274us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.647616 (+ 1458us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3374161}
I20260811 06:17:05.648274 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2f243c792a634abf83484aef820dbb48 (table default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]) successfully deleted
I20260811 06:17:05.648434 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 83) took 3362 ms. Trace:
I20260811 06:17:05.648517 12728 rpcz_store.cc:276] 0811 06:17:02.285755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.286632 (+ 877us) service_pool.cc:227] Handling call
0811 06:17:05.648271 (+3361639us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:17:05.648285 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.648416 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3361272}
I20260811 06:17:05.648672 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 516021603ee24b3f9bdffd1e30e5ea9d (table default.Table_64c34f7955a74a59ac3a81ca903e25f3 [id=9ead873f818d428d989ee530a0993eb9]) successfully deleted
I20260811 06:17:05.648978 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 84) took 3361 ms. Trace:
W20260811 06:17:05.649044 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
I20260811 06:17:05.649050 12728 rpcz_store.cc:276] 0811 06:17:02.287205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.287491 (+ 286us) service_pool.cc:227] Handling call
0811 06:17:05.648868 (+3361377us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:17:05.648879 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.648964 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358315}
I20260811 06:17:05.649423 12728 tablet_replica.cc:330] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:17:05.649463 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532208d7a02d448e8dac702ffe6c2ffc already in progress: creating tablet
I20260811 06:17:05.649621 12728 raft_consensus.cc:2229] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.649962 12728 raft_consensus.cc:2258] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.650543 12728 ts_tablet_manager.cc:1905] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:05.654559 11046 consensus_peers.cc:487] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.660181 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:05.662616 11361 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.662811 11361 ts_tablet_manager.cc:1397] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.003s
I20260811 06:17:05.663676 12944 raft_consensus.cc:2726] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.663797 11361 raft_consensus.cc:348] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.664047 11361 raft_consensus.cc:374] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.664111 11361 raft_consensus.cc:729] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.664458 11361 consensus_queue.cc:260] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.623343 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:05.666635 10659 raft_consensus.cc:2454] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:05.667438 11361 ts_tablet_manager.cc:1428] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:17:05.670440 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:05.668170 11046 leader_election.cc:302] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.671623 13306 raft_consensus.cc:2781] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.671499 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:05.671761 13306 raft_consensus.cc:686] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:05.672005 13306 consensus_queue.cc:237] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.672396 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:05.673825 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 89) took 3414 ms. Trace:
I20260811 06:17:05.673839 13282 raft_consensus.cc:482] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.673946 12727 rpcz_store.cc:276] 0811 06:17:02.259813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.259869 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:05.673591 (+3413722us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:05.673604 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.673801 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3413298}
I20260811 06:17:05.674134 13282 raft_consensus.cc:504] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:05.674676 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 217f60a1ca044af38f9ee9093e021c27 already in progress: creating tablet
I20260811 06:17:05.674762 13282 leader_election.cc:288] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.675307 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:05.675830 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:05.675966 11362 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.676106 11362 ts_tablet_manager.cc:1397] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.279s user 0.015s sys 0.021s
I20260811 06:17:05.676159 12727 tablet_replica.cc:330] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.676352 12727 raft_consensus.cc:2229] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.676680 12727 pending_rounds.cc:62] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:05.676730 12727 pending_rounds.cc:68] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213257923465216 op_type: NO_OP noop_request { }
I20260811 06:17:05.676849 12727 raft_consensus.cc:2866] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:05.676949 12727 raft_consensus.cc:2258] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.676872 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.677158 11362 raft_consensus.cc:348] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.677436 11362 raft_consensus.cc:374] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.677501 11362 raft_consensus.cc:729] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.677508 12727 ts_tablet_manager.cc:1905] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.678445 11362 consensus_queue.cc:260] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.679298 11362 ts_tablet_manager.cc:1428] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:05.679625 11362 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.681666 11362 tablet_bootstrap.cc:654] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.682289 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:05.682670 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
W20260811 06:17:05.683064 11047 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.684319 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:05.684629 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:05.685122 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:05.685456 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:05.685899 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:05.686257 11361 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.686456 12728 ts_tablet_manager.cc:1918] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.686466 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:05.686779 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:05.686975 12728 log.cc:1196] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6c706bf0455341a0a953d937f9778b5f
I20260811 06:17:05.687106 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:05.692873 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:05.693271 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:05.693795 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:05.694644 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:05.695092 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:05.695099 13306 consensus_queue.cc:1035] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:05.695796 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:05.696574 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:05.697067 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:05.697583 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:05.697914 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:05.698170 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:05.698571 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:05.698982 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:05.699838 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:05.700215 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:05.700474 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:05.700701 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:05.700964 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:05.701116 12728 ts_tablet_manager.cc:1939] T 6c706bf0455341a0a953d937f9778b5f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.701175 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:05.701476 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:05.703959 12727 ts_tablet_manager.cc:1918] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.704106 12727 log.cc:1196] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7a00b0b51f574bfb843b65c0876ab4fc
I20260811 06:17:05.704485 12727 ts_tablet_manager.cc:1939] T 7a00b0b51f574bfb843b65c0876ab4fc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.704692 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 85) took 3414 ms. Trace:
I20260811 06:17:05.705273 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 90) took 3444 ms. Trace:
I20260811 06:17:05.705360 12727 rpcz_store.cc:276] 0811 06:17:02.260635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.264302 (+ 3667us) service_pool.cc:227] Handling call
0811 06:17:05.676109 (+3411807us) ts_tablet_manager.cc:1145] Deleting tablet 7a00b0b51f574bfb843b65c0876ab4fc
0811 06:17:05.676121 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.689145 (+ 13024us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.703843 (+ 14698us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.705254 (+ 1411us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3411444}
I20260811 06:17:05.705693 12727 tablet_replica.cc:330] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.705907 12727 raft_consensus.cc:2229] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.706087 12727 raft_consensus.cc:2258] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.706120 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7a00b0b51f574bfb843b65c0876ab4fc (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]) successfully deleted
I20260811 06:17:05.706643 12727 ts_tablet_manager.cc:1905] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.706660 13284 raft_consensus.cc:482] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.706749 11361 tablet_bootstrap.cc:654] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.707031 13284 raft_consensus.cc:504] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.706067 12728 rpcz_store.cc:276] 0811 06:17:02.290381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.297808 (+ 7427us) service_pool.cc:227] Handling call
0811 06:17:05.649367 (+3351559us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:17:05.649391 (+ 24us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.653942 (+ 4551us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.656909 (+ 2967us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.704673 (+ 47764us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3351167}
I20260811 06:17:05.707976 13284 leader_election.cc:288] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.708354 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6c706bf0455341a0a953d937f9778b5f (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]) successfully deleted
I20260811 06:17:05.708990 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:05.710053 10555 leader_election.cc:341] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.710456 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 86) took 3412 ms. Trace:
I20260811 06:17:05.710558 12728 rpcz_store.cc:276] 0811 06:17:02.298467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.298532 (+ 65us) service_pool.cc:227] Handling call
0811 06:17:05.709539 (+3411007us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:17:05.709551 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.710428 (+ 877us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3410755}
W20260811 06:17:05.711166 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:05.711129 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:05.711460 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:05.711721 12728 tablet_replica.cc:330] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:05.712602 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:05.713023 12728 raft_consensus.cc:2229] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.715049 11365 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:05.715291 12728 raft_consensus.cc:2258] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.715950 12728 ts_tablet_manager.cc:1905] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:05.717280 10564 leader_election.cc:341] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.717454 10564 leader_election.cc:302] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.717818 13284 raft_consensus.cc:2726] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.717851 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.718199 10651 raft_consensus.cc:2454] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 2.
W20260811 06:17:05.718779 11046 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.718911 11046 leader_election.cc:302] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.720221 11365 ts_tablet_manager.cc:1397] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.247s user 0.008s sys 0.009s
I20260811 06:17:05.720912 11046 leader_election.cc:302] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.721335 13132 raft_consensus.cc:2726] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:05.721510 13132 raft_consensus.cc:2781] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 06:17:05.721606 13132 raft_consensus.cc:686] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:05.716086 11362 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.721853 11362 ts_tablet_manager.cc:1397] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.001s
I20260811 06:17:05.721848 13132 consensus_queue.cc:237] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.722745 12727 ts_tablet_manager.cc:1918] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.722875 12727 log.cc:1196] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/006d3214480c47babe390496b335de70
I20260811 06:17:05.722783 11362 raft_consensus.cc:348] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.723094 11362 raft_consensus.cc:374] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.723155 11362 raft_consensus.cc:729] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.723254 12727 ts_tablet_manager.cc:1939] T 006d3214480c47babe390496b335de70 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.723721 11362 consensus_queue.cc:260] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.724403 11362 ts_tablet_manager.cc:1428] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:05.724682 11362 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.726547 11362 tablet_bootstrap.cc:654] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.730850 11365 raft_consensus.cc:348] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.732287 11365 raft_consensus.cc:374] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.732447 11365 raft_consensus.cc:729] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.734827 11365 consensus_queue.cc:260] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.735586 11365 ts_tablet_manager.cc:1428] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260811 06:17:05.739459 11365 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:05.751310 12944 raft_consensus.cc:482] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.751673 12944 raft_consensus.cc:504] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.753379 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.755218 11361 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.755470 11361 ts_tablet_manager.cc:1397] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.005s
I20260811 06:17:05.755864 10651 raft_consensus.cc:2454] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:05.758531 11361 raft_consensus.cc:348] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.761039 11361 raft_consensus.cc:374] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.761380 11361 raft_consensus.cc:729] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.761963 11361 consensus_queue.cc:260] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.752348 12944 leader_election.cc:288] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.756543 10810 leader_election.cc:302] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:05.764446 12944 raft_consensus.cc:2781] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:05.764528 12944 raft_consensus.cc:482] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.764597 12944 raft_consensus.cc:3037] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.765091 11361 ts_tablet_manager.cc:1428] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:17:05.763830 12728 ts_tablet_manager.cc:1918] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:05.767532 12944 raft_consensus.cc:504] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.773169 12728 log.cc:1196] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/b0d203f652b24b4897e62fc8c03d32df
I20260811 06:17:05.773707 12728 ts_tablet_manager.cc:1939] T b0d203f652b24b4897e62fc8c03d32df P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.774133 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:05.774287 12944 leader_election.cc:288] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.774549 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 88) took 3466 ms. Trace:
I20260811 06:17:05.774633 12728 rpcz_store.cc:276] 0811 06:17:02.307729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.308252 (+ 523us) service_pool.cc:227] Handling call
0811 06:17:05.711672 (+3403420us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:17:05.711684 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.735005 (+ 23321us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.763719 (+ 28714us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.774529 (+ 10810us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3362023}
I20260811 06:17:05.775228 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet b0d203f652b24b4897e62fc8c03d32df (table default.Table_8041eb9d4b2f475ca05f2a96278befd8 [id=90300626ac5742358dc29caf32dc323d]) successfully deleted
I20260811 06:17:05.775224 12944 consensus_queue.cc:1035] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:05.775686 10813 leader_election.cc:341] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.777628 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:05.780212 11361 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.780676 11362 tablet_bootstrap.cc:492] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.780826 11362 ts_tablet_manager.cc:1397] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260811 06:17:05.782543 11361 tablet_bootstrap.cc:654] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.782305 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 91) took 3517 ms. Trace:
I20260811 06:17:05.783288 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 90) took 3429 ms. Trace:
I20260811 06:17:05.783413 12728 rpcz_store.cc:276] 0811 06:17:02.345428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.345569 (+ 141us) service_pool.cc:227] Handling call
0811 06:17:05.774906 (+3429337us) ts_tablet_manager.cc:1145] Deleting tablet 2b0ae9a1d3b74c3985637439819b63ef
0811 06:17:05.774919 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.775023 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3425025}
W20260811 06:17:05.783674 10813 leader_election.cc:341] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.782913 12727 rpcz_store.cc:276] 0811 06:17:02.264963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.265012 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:05.705646 (+3440634us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:17:05.705658 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.709566 (+ 3908us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.722632 (+ 13066us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.782101 (+ 59469us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3440275}
I20260811 06:17:05.783752 12728 tablet_replica.cc:330] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:05.784132 12728 raft_consensus.cc:2229] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.784695 12728 raft_consensus.cc:2258] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.784787 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 006d3214480c47babe390496b335de70 (table default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]) successfully deleted
I20260811 06:17:05.785166 12727 tablet_replica.cc:330] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:05.785939 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:05.786131 12728 ts_tablet_manager.cc:1905] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.786085 12727 raft_consensus.cc:2229] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.787352 12727 raft_consensus.cc:2258] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.790050 11365 tablet_bootstrap.cc:654] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.790544 12727 ts_tablet_manager.cc:1905] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.790666 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.791018 11362 raft_consensus.cc:348] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.791245 11362 raft_consensus.cc:374] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.791296 11362 raft_consensus.cc:729] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.791493 11362 consensus_queue.cc:260] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.792030 11362 ts_tablet_manager.cc:1428] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260811 06:17:05.792315 11362 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.795842 11361 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.796041 11361 ts_tablet_manager.cc:1397] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260811 06:17:05.801548 12727 ts_tablet_manager.cc:1918] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.801818 12727 log.cc:1196] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/fe5eea681072477ab52a822d721629cf
I20260811 06:17:05.802503 12727 ts_tablet_manager.cc:1939] T fe5eea681072477ab52a822d721629cf P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.802518 11361 raft_consensus.cc:348] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.802976 11361 raft_consensus.cc:374] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.803129 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 92) took 3537 ms. Trace:
I20260811 06:17:05.803197 11361 raft_consensus.cc:729] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.803750 11361 consensus_queue.cc:260] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.804610 10651 raft_consensus.cc:3037] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:05.807673 10813 consensus_peers.cc:487] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 006d3214480c47babe390496b335de70. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.809027 11362 tablet_bootstrap.cc:654] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:05.812213 10810 consensus_peers.cc:487] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.803231 12727 rpcz_store.cc:276] 0811 06:17:02.265582 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.265625 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:05.784909 (+3519284us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:17:05.785023 (+ 114us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.796145 (+ 11122us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.801324 (+ 5179us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.803110 (+ 1786us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3518683}
I20260811 06:17:05.817830 11361 ts_tablet_manager.cc:1428] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.022s user 0.002s sys 0.002s
I20260811 06:17:05.818037 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet fe5eea681072477ab52a822d721629cf (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
I20260811 06:17:05.818115 12727 tablet_replica.cc:330] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.818755 11361 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.818804 12727 raft_consensus.cc:2229] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:05.818975 10651 raft_consensus.cc:2454] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:05.819713 10810 leader_election.cc:302] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:05.820143 13241 raft_consensus.cc:2781] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.819980 12727 raft_consensus.cc:2258] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.820254 13241 raft_consensus.cc:686] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:05.820502 13241 consensus_queue.cc:237] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.822400 12727 ts_tablet_manager.cc:1905] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.828058 11361 tablet_bootstrap.cc:654] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.843921 12727 ts_tablet_manager.cc:1918] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.844588 12727 log.cc:1196] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f12c8618198f4413b2727d04f850a10f
I20260811 06:17:05.846705 12727 ts_tablet_manager.cc:1939] T f12c8618198f4413b2727d04f850a10f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.847718 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:05.848302 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:05.848572 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:05.848941 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:05.849570 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:05.849813 11362 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.850013 11362 ts_tablet_manager.cc:1397] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.006s
I20260811 06:17:05.851087 11362 raft_consensus.cc:348] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.851369 11362 raft_consensus.cc:374] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.851469 11362 raft_consensus.cc:729] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.851723 11362 consensus_queue.cc:260] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.852358 11362 ts_tablet_manager.cc:1428] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:05.850548 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 93) took 3583 ms. Trace:
I20260811 06:17:05.853227 12727 rpcz_store.cc:276] 0811 06:17:02.266602 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.266649 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:05.818032 (+3551383us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:17:05.818044 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.834062 (+ 16018us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.843439 (+ 9377us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.850433 (+ 6994us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3550998}
I20260811 06:17:05.854910 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f12c8618198f4413b2727d04f850a10f (table default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]) successfully deleted
I20260811 06:17:05.857231 12727 tablet_replica.cc:330] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.858173 12727 raft_consensus.cc:2229] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.858932 12727 raft_consensus.cc:2258] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.862084 12727 ts_tablet_manager.cc:1905] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.862527 12726 ts_tablet_manager.cc:1918] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.864099 11362 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.865909 11361 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.866082 11361 ts_tablet_manager.cc:1397] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.048s user 0.014s sys 0.000s
I20260811 06:17:05.867026 11365 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:05.867234 11365 ts_tablet_manager.cc:1397] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.128s user 0.005s sys 0.005s
I20260811 06:17:05.867136 11361 raft_consensus.cc:348] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.867394 11361 raft_consensus.cc:374] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.867482 11361 raft_consensus.cc:729] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.867620 11362 tablet_bootstrap.cc:654] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.867707 11361 consensus_queue.cc:260] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.868216 11365 raft_consensus.cc:348] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.868592 11365 raft_consensus.cc:374] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.868744 11365 raft_consensus.cc:729] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.869261 11365 consensus_queue.cc:260] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.870267 11361 ts_tablet_manager.cc:1428] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:05.870667 11361 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.870887 11365 ts_tablet_manager.cc:1428] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 06:17:05.871616 11365 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:05.873672 13241 raft_consensus.cc:482] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.873827 13241 raft_consensus.cc:504] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.874457 13241 leader_election.cc:288] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.875037 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:05.875526 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:05.875715 11361 tablet_bootstrap.cc:654] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.875969 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e873e2f7b3d34988856b3be044de1ed7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:05.876191 11159 raft_consensus.cc:2454] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:05.876690 10813 leader_election.cc:302] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:05.876966 13241 raft_consensus.cc:2781] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 06:17:05.877003 10813 consensus_peers.cc:487] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52953438e7c248b1a758ee219405d7da. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:05.877049 13241 raft_consensus.cc:482] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.877113 13241 raft_consensus.cc:3037] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.880191 12727 ts_tablet_manager.cc:1918] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.880491 12727 log.cc:1196] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/dc6254bf781740019c3f71b26179f25d
I20260811 06:17:05.880509 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:05.880772 13241 raft_consensus.cc:504] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.881229 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:05.881347 12727 ts_tablet_manager.cc:1939] T dc6254bf781740019c3f71b26179f25d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.881736 13241 leader_election.cc:288] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:05.881942 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 94) took 3614 ms. Trace:
I20260811 06:17:05.882128 12727 rpcz_store.cc:276] 0811 06:17:02.267157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.267197 (+ 40us) service_pool.cc:227] Handling call
0811 06:17:05.856973 (+3589776us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:17:05.857085 (+ 112us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.868496 (+ 11411us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.879998 (+ 11502us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.881898 (+ 1900us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3587480}
I20260811 06:17:05.882411 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e873e2f7b3d34988856b3be044de1ed7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:05.882684 11159 raft_consensus.cc:3037] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.885133 11159 raft_consensus.cc:2454] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:05.885527 10813 leader_election.cc:302] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:05.885803 13241 raft_consensus.cc:2781] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.886531 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet dc6254bf781740019c3f71b26179f25d (table default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]) successfully deleted
I20260811 06:17:05.886631 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:05.886610 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 95) took 3618 ms. Trace:
I20260811 06:17:05.886790 13241 raft_consensus.cc:686] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:05.887132 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:05.886749 12727 rpcz_store.cc:276] 0811 06:17:02.267729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.268825 (+ 1096us) service_pool.cc:227] Handling call
0811 06:17:05.886339 (+3617514us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:17:05.886352 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.886566 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3617195}
I20260811 06:17:05.887071 13241 consensus_queue.cc:237] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.887591 12727 tablet_replica.cc:330] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.888031 12727 raft_consensus.cc:2229] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.889017 12727 raft_consensus.cc:2258] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.865623 12726 log.cc:1196] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/b39dfcd1a66b4241bc6f5c38e930f048
W20260811 06:17:05.891567 10810 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:05.892832 12727 ts_tablet_manager.cc:1905] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.895750 12728 ts_tablet_manager.cc:1918] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.895978 12728 log.cc:1196] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f2bdb349406a46629e6c307e1ebfd9dc
W20260811 06:17:05.896392 10810 leader_election.cc:341] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:05.896857 12728 ts_tablet_manager.cc:1939] T f2bdb349406a46629e6c307e1ebfd9dc P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.898257 12726 ts_tablet_manager.cc:1939] T b39dfcd1a66b4241bc6f5c38e930f048 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:05.900568 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 67) took 3564 ms. Trace:
I20260811 06:17:05.900954 12726 rpcz_store.cc:276] 0811 06:17:02.336040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336790 (+ 750us) service_pool.cc:227] Handling call
0811 06:17:05.507052 (+3170262us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:17:05.507064 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.762536 (+255472us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.858112 (+ 95576us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.900479 (+ 42367us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3165417}
I20260811 06:17:05.902307 12726 tablet_replica.cc:330] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:05.904347 12726 raft_consensus.cc:2229] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.905186 12726 raft_consensus.cc:2258] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.907785 12726 ts_tablet_manager.cc:1905] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.923373 11365 tablet_bootstrap.cc:654] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.925559 12727 ts_tablet_manager.cc:1918] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.926213 12727 log.cc:1196] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6119212ae4be4204852a5d9437dcee72
W20260811 06:17:05.887562 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 227bc4fd6cd84e5eb2043c52f95d606d already in progress: creating tablet
I20260811 06:17:05.902626 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet b39dfcd1a66b4241bc6f5c38e930f048 (table default.Table_0d2536cbb5f54439a910d4be40e09f1b [id=b7cf6a3830f44f28ad1b0941700ce2a7]) successfully deleted
I20260811 06:17:05.927027 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:05.927170 13306 raft_consensus.cc:482] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.927313 13306 raft_consensus.cc:504] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.927618 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:05.927959 13306 leader_election.cc:288] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:05.928057 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0cec2c3e143a4834a07aef7a31340d9c consensus state has no leader
I20260811 06:17:05.928022 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 91) took 3578 ms. Trace:
I20260811 06:17:05.928572 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:05.928777 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.928969 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:05.929391 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:05.929881 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
W20260811 06:17:05.929852 11047 leader_election.cc:341] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.930275 12727 ts_tablet_manager.cc:1939] T 6119212ae4be4204852a5d9437dcee72 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.931972 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 96) took 3660 ms. Trace:
I20260811 06:17:05.932256 12727 rpcz_store.cc:276] 0811 06:17:02.271769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.271824 (+ 55us) service_pool.cc:227] Handling call
0811 06:17:05.887522 (+3615698us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:17:05.887558 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.912864 (+ 25306us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.925154 (+ 12290us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.931947 (+ 6793us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3615428}
I20260811 06:17:05.933238 12727 tablet_replica.cc:330] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:05.928188 12728 rpcz_store.cc:276] 0811 06:17:02.349175 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.349227 (+ 52us) service_pool.cc:227] Handling call
0811 06:17:05.783699 (+3434472us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:17:05.783711 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.842045 (+ 58334us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.895538 (+ 53493us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.927956 (+ 32418us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3433378}
I20260811 06:17:05.935102 12727 raft_consensus.cc:2229] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.935464 12727 raft_consensus.cc:2258] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.936285 12728 tablet_replica.cc:330] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:05.936483 12727 ts_tablet_manager.cc:1905] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.937819 12728 raft_consensus.cc:2229] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:05.939236 12728 raft_consensus.cc:2258] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:05.933066 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 6119212ae4be4204852a5d9437dcee72 (table default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]) successfully deleted
I20260811 06:17:05.935297 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f2bdb349406a46629e6c307e1ebfd9dc (table default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]) successfully deleted
I20260811 06:17:05.941334 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:05.941833 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.942265 11361 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:05.942217 10651 raft_consensus.cc:2454] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:05.942487 11361 ts_tablet_manager.cc:1397] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.002s
I20260811 06:17:05.942802 11046 leader_election.cc:302] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.943274 13306 raft_consensus.cc:2781] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:05.943369 13306 raft_consensus.cc:482] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.943441 13306 raft_consensus.cc:3037] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.943908 11361 raft_consensus.cc:348] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.944154 11361 raft_consensus.cc:374] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.944240 11361 raft_consensus.cc:729] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.944504 11361 consensus_queue.cc:260] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.945475 12728 ts_tablet_manager.cc:1905] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:05.946061 13306 raft_consensus.cc:504] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.947090 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:05.947732 11047 leader_election.cc:341] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.948088 13306 leader_election.cc:288] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.950639 11361 ts_tablet_manager.cc:1428] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260811 06:17:05.951135 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.951438 10651 raft_consensus.cc:3037] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.955840 10651 raft_consensus.cc:2454] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:05.956270 11361 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:05.956337 11046 leader_election.cc:302] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.956722 13306 raft_consensus.cc:2781] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.956948 13306 raft_consensus.cc:686] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:05.959623 12726 ts_tablet_manager.cc:1918] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.960707 12726 log.cc:1196] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/97b348d30dc44fa383a27d9097c2e598
I20260811 06:17:05.960922 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:05.961632 12726 ts_tablet_manager.cc:1939] T 97b348d30dc44fa383a27d9097c2e598 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:05.962632 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 72) took 3623 ms. Trace:
I20260811 06:17:05.962942 12726 rpcz_store.cc:276] 0811 06:17:02.339338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.339420 (+ 82us) service_pool.cc:227] Handling call
0811 06:17:05.902046 (+3562626us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:05.902148 (+ 102us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.925205 (+ 23057us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.959466 (+ 34261us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.962567 (+ 3101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3559355}
I20260811 06:17:05.963590 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 97b348d30dc44fa383a27d9097c2e598 (table default.Table_dd5a9f221bf94e10a6b32d763d44281b [id=5324723ba4ac4631ac127ce6648b33a4]) successfully deleted
I20260811 06:17:05.966070 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5322caea49aa4b648b74c7692d6e0372 (table default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d]). Expected version 2 got 0
I20260811 06:17:05.966418 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 66) took 3630 ms. Trace:
I20260811 06:17:05.966641 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:05.966679 11362 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:05.966651 12726 rpcz_store.cc:276] 0811 06:17:02.335821 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336762 (+ 941us) service_pool.cc:227] Handling call
0811 06:17:05.966088 (+3629326us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:05.966101 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.966234 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3622151}
I20260811 06:17:05.966858 11362 ts_tablet_manager.cc:1397] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.103s user 0.011s sys 0.030s
W20260811 06:17:05.967694 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 217f60a1ca044af38f9ee9093e021c27 already in progress: creating tablet
I20260811 06:17:05.967993 13282 raft_consensus.cc:482] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:05.968146 13282 raft_consensus.cc:504] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.968358 11362 raft_consensus.cc:348] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.968576 11362 raft_consensus.cc:374] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.967769 12726 tablet_replica.cc:330] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:05.967252 11656 catalog_manager.cc:5495] T a1da7a10783f4bb9aadb20668aee95c2 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:05.957203 13306 consensus_queue.cc:237] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.972958 13282 leader_election.cc:288] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.973758 11362 raft_consensus.cc:729] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.973768 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:05.973798 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:05.974080 11362 consensus_queue.cc:260] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.974714 11362 ts_tablet_manager.cc:1428] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260811 06:17:05.974815 11047 leader_election.cc:341] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.974941 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:05.975356 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:05.975636 10651 raft_consensus.cc:2454] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:05.975818 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:05.976249 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:05.976246 11046 leader_election.cc:302] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.976680 13282 raft_consensus.cc:2781] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:05.976706 11362 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:05.976754 13282 raft_consensus.cc:482] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:05.976809 13282 raft_consensus.cc:3037] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.980530 13282 raft_consensus.cc:504] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.982183 13282 leader_election.cc:288] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:05.983031 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:05.983623 11047 leader_election.cc:341] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:05.983994 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:05.984210 10651 raft_consensus.cc:3037] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:05.985383 12728 ts_tablet_manager.cc:1918] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:05.985508 12728 log.cc:1196] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:05.986701 12728 ts_tablet_manager.cc:1939] T 7fbdda840466420f8d67a8cb5868ba03 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:05.987121 10651 raft_consensus.cc:2454] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:05.987540 11046 leader_election.cc:302] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:05.987648 11361 tablet_bootstrap.cc:654] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.987761 11362 tablet_bootstrap.cc:654] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:05.988265 13282 raft_consensus.cc:2781] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:05.988584 13282 raft_consensus.cc:686] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:05.988960 13282 consensus_queue.cc:237] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.992527 11365 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:05.992707 11365 ts_tablet_manager.cc:1397] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.006s
I20260811 06:17:05.980706 12727 ts_tablet_manager.cc:1918] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:05.993914 12727 log.cc:1196] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/3025339a6c9e4e07bba4104006206bb8
I20260811 06:17:05.993981 11365 raft_consensus.cc:348] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.994284 11365 raft_consensus.cc:374] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:05.994366 11365 raft_consensus.cc:729] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:05.994620 11365 consensus_queue.cc:260] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:05.994978 12727 ts_tablet_manager.cc:1939] T 3025339a6c9e4e07bba4104006206bb8 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:05.995491 11365 ts_tablet_manager.cc:1428] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:05.996912 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:05.998843 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 97) took 3723 ms. Trace:
I20260811 06:17:05.999490 12727 rpcz_store.cc:276] 0811 06:17:02.272341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.272381 (+ 40us) service_pool.cc:227] Handling call
0811 06:17:05.933130 (+3660749us) ts_tablet_manager.cc:1145] Deleting tablet 3025339a6c9e4e07bba4104006206bb8
0811 06:17:05.933172 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.960303 (+ 27131us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.980584 (+ 20281us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.995459 (+ 14875us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3660574}
W20260811 06:17:06.000303 10813 consensus_peers.cc:487] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc6254bf781740019c3f71b26179f25d. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.000514 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 89) took 3655 ms. Trace:
I20260811 06:17:06.000613 12728 rpcz_store.cc:276] 0811 06:17:02.344699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.344754 (+ 55us) service_pool.cc:227] Handling call
0811 06:17:05.935840 (+3591086us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:17:05.936214 (+ 374us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:05.970882 (+ 34668us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:05.977633 (+ 6751us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.000492 (+ 22859us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3584999}
I20260811 06:17:06.001252 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 98) took 3728 ms. Trace:
I20260811 06:17:06.002345 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 92) took 3642 ms. Trace:
I20260811 06:17:06.002769 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 3025339a6c9e4e07bba4104006206bb8 (table default.Table_88237316c36548428404ae24db07eee6 [id=38608eecd4ea4c92a3cedbfad1d631a6]) successfully deleted
I20260811 06:17:06.003912 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 7fbdda840466420f8d67a8cb5868ba03 (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]) successfully deleted
I20260811 06:17:06.004243 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:06.004456 12727 rpcz_store.cc:276] 0811 06:17:02.272726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.272771 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:06.001076 (+3728305us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:17:06.001087 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.001233 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3728001}
I20260811 06:17:06.007052 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:06.007903 12727 tablet_replica.cc:330] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.010193 13284 raft_consensus.cc:482] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.010349 13284 raft_consensus.cc:504] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.010577 12727 raft_consensus.cc:2229] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.010762 12727 raft_consensus.cc:2258] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.011003 13284 leader_election.cc:288] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.011373 12727 ts_tablet_manager.cc:1905] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.011534 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b282afe70184b0fb68d0e7cdcbcd2b7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.011659 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b282afe70184b0fb68d0e7cdcbcd2b7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:06.012192 10564 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:06.012373 10555 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.012498 10555 leader_election.cc:302] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.012730 13284 raft_consensus.cc:2726] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:06.007647 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
I20260811 06:17:06.015614 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:06.002439 12728 rpcz_store.cc:276] 0811 06:17:02.360095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.360370 (+ 275us) service_pool.cc:227] Handling call
0811 06:17:06.002207 (+3641837us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:06.002223 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.002327 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3641017}
I20260811 06:17:06.018666 12728 tablet_replica.cc:330] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.018883 12728 raft_consensus.cc:2229] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.019284 12728 raft_consensus.cc:2258] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.019944 12728 ts_tablet_manager.cc:1905] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:06.018699 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 217f60a1ca044af38f9ee9093e021c27 already in progress: creating tablet
I20260811 06:17:06.020613 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:06.023481 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6d0f4cb9da96451ab351e1ad1aff7530 (table default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9]). Expected version 2 got 0
I20260811 06:17:06.025427 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:06.025802 13306 raft_consensus.cc:482] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.025964 13306 raft_consensus.cc:504] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.026554 13306 leader_election.cc:288] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.027426 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcf7c7a470144c0a084aebc2032d896" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:06.028047 11047 leader_election.cc:341] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.028867 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcf7c7a470144c0a084aebc2032d896" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.029116 10651 raft_consensus.cc:2454] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.029750 11046 leader_election.cc:302] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.030340 13306 raft_consensus.cc:2781] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.030419 13306 raft_consensus.cc:482] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.030476 13306 raft_consensus.cc:3037] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.031608 11361 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.031724 11361 ts_tablet_manager.cc:1397] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.076s user 0.000s sys 0.005s
I20260811 06:17:06.032886 11361 raft_consensus.cc:348] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.033154 11361 raft_consensus.cc:374] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.033208 11361 raft_consensus.cc:729] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.033128 13306 raft_consensus.cc:504] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.033766 11361 consensus_queue.cc:260] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.034358 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcf7c7a470144c0a084aebc2032d896" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.035146 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fcf7c7a470144c0a084aebc2032d896" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:06.035255 11047 leader_election.cc:341] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.035372 10651 raft_consensus.cc:3037] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.036873 11361 ts_tablet_manager.cc:1428] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:17:06.037201 11361 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.040555 13306 leader_election.cc:288] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.040896 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:06.042474 10651 raft_consensus.cc:2454] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.044390 11362 tablet_bootstrap.cc:492] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.044595 11362 ts_tablet_manager.cc:1397] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.005s
I20260811 06:17:06.045276 11046 leader_election.cc:302] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.045707 13306 raft_consensus.cc:2781] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.045778 11362 raft_consensus.cc:348] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.046195 11362 raft_consensus.cc:374] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.046214 13284 raft_consensus.cc:482] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.046387 11362 raft_consensus.cc:729] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.046156 13306 raft_consensus.cc:686] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.046373 13284 raft_consensus.cc:504] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.046686 11362 consensus_queue.cc:260] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.047273 13284 leader_election.cc:288] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.047642 11362 ts_tablet_manager.cc:1428] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:06.047643 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:06.047981 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.048182 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:06.048620 11362 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.048763 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
W20260811 06:17:06.048836 10555 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.049157 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:06.049474 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:06.049643 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.049950 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
W20260811 06:17:06.050330 10564 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.050359 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:06.050473 10564 leader_election.cc:302] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.050738 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:06.050881 13284 raft_consensus.cc:2726] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.051115 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:06.051631 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 2fcf7c7a470144c0a084aebc2032d896
I20260811 06:17:06.052264 11670 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 54) took 4185 ms. Trace:
I20260811 06:17:06.052819 11361 tablet_bootstrap.cc:654] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.052451 11670 rpcz_store.cc:276] 0811 06:17:01.866668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.218252 (+3351584us) service_pool.cc:227] Handling call
0811 06:17:05.241470 (+ 23218us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:05.241635 (+ 165us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:05.241703 (+ 68us) catalog_manager.cc:2761] Locking tablets
0811 06:17:05.416625 (+174922us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:05.426457 (+ 9832us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:05.426557 (+ 100us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:06.051400 (+624843us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:06.052191 (+ 791us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.417477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.417601 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.417609 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:05.417612 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:05.417769 (+ 157us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.417785 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.417790 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:05.417903 (+ 113us) tablet.cc:699] Row locks acquired
0811 06:17:05.417905 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:05.417946 (+ 41us) write_op.cc:270] Start()
0811 06:17:05.417983 (+ 37us) write_op.cc:276] Timestamp: P: 1786429025417908 usec, L: 0
0811 06:17:05.417988 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.418189 (+ 201us) log.cc:842] Serialized 759 byte log entry
0811 06:17:05.424899 (+ 6710us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.425014 (+ 115us) write_op.cc:301] APPLY: starting
0811 06:17:05.425031 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.425081 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.425108 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.425188 (+ 80us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.425225 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:05.425230 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:05.425319 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:05.425384 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.425407 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:05.425414 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.425567 (+ 153us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.425574 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":622,"apply.run_wall_time_us":622,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":817,"prepare.run_wall_time_us":818,"raft.queue_time_us":526,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":306,"replication_time_us":6885}]]}
I20260811 06:17:06.054010 11679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 79f307f50e044435be880079219170d8
I20260811 06:17:06.054363 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:06.054751 11679 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 55) took 4024 ms. Trace:
I20260811 06:17:06.055068 11679 rpcz_store.cc:276] 0811 06:17:02.030181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.220792 (+3190611us) service_pool.cc:227] Handling call
0811 06:17:05.250206 (+ 29414us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:05.250358 (+ 152us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:05.250477 (+ 119us) catalog_manager.cc:2761] Locking tablets
0811 06:17:05.456113 (+205636us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:05.464413 (+ 8300us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:05.464522 (+ 109us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:06.053832 (+589310us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:06.054612 (+ 780us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.457109 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.457263 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.457271 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:05.457273 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:05.457405 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.457421 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.457456 (+ 35us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:05.457600 (+ 144us) tablet.cc:699] Row locks acquired
0811 06:17:05.457603 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:05.457649 (+ 46us) write_op.cc:270] Start()
0811 06:17:05.457688 (+ 39us) write_op.cc:276] Timestamp: P: 1786429025457607 usec, L: 0
0811 06:17:05.457692 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.457933 (+ 241us) log.cc:842] Serialized 728 byte log entry
0811 06:17:05.462963 (+ 5030us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.463096 (+ 133us) write_op.cc:301] APPLY: starting
0811 06:17:05.463113 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.463165 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.463220 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.463318 (+ 98us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.463359 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:05.463366 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:05.463503 (+ 137us) log.cc:842] Serialized 29 byte log entry
0811 06:17:05.463577 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.463598 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:05.463605 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.463661 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.463664 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":621,"apply.run_wall_time_us":620,"num_ops":2,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":936,"prepare.run_wall_time_us":935,"raft.queue_time_us":483,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":243,"replication_time_us":5244}]]}
I20260811 06:17:06.053627 13306 consensus_queue.cc:237] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.057943 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_97d2925aeaee4b19a82c011e43fe3969 [id=7ec0fe7be82b41ca9ad638a1fdcf7d99] alter complete (version 1)
I20260811 06:17:06.061272 13282 raft_consensus.cc:482] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.061430 13282 raft_consensus.cc:504] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.061802 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:06.062038 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:06.062115 13282 leader_election.cc:288] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.063057 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:06.062939 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.063225 10923 raft_consensus.cc:2454] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.064059 11047 leader_election.cc:302] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.064538 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.064811 10651 raft_consensus.cc:2454] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.065482 13282 raft_consensus.cc:2781] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.065567 13282 raft_consensus.cc:482] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.065632 13282 raft_consensus.cc:3037] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.066337 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:06.066428 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:06.068905 13282 raft_consensus.cc:504] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.069521 11684 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990] alter complete (version 1)
I20260811 06:17:06.070144 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.070341 10651 raft_consensus.cc:3037] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.076561 10651 raft_consensus.cc:2454] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.076702 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d9a3943d3e7406fb0e41f3a9f5c5255" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.076925 10923 raft_consensus.cc:3037] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.076992 11046 leader_election.cc:302] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.077258 13132 raft_consensus.cc:2781] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.077379 13132 raft_consensus.cc:686] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.077620 13132 consensus_queue.cc:237] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.078787 13284 raft_consensus.cc:482] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.078928 13284 raft_consensus.cc:504] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.079092 12727 ts_tablet_manager.cc:1918] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.079196 12727 log.cc:1196] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/58fdb5920003438d983987ff242f6dce
I20260811 06:17:06.079540 13284 leader_election.cc:288] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.079576 12727 ts_tablet_manager.cc:1939] T 58fdb5920003438d983987ff242f6dce P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.080051 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 99) took 3806 ms. Trace:
I20260811 06:17:06.080135 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.080135 12727 rpcz_store.cc:276] 0811 06:17:02.273278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.273373 (+ 95us) service_pool.cc:227] Handling call
0811 06:17:06.007829 (+3734456us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:17:06.007856 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.041994 (+ 34138us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.078982 (+ 36988us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.080029 (+ 1047us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3734202}
I20260811 06:17:06.080265 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.080597 12727 tablet_replica.cc:330] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.080711 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 58fdb5920003438d983987ff242f6dce (table default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]) successfully deleted
W20260811 06:17:06.080781 10564 leader_election.cc:341] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.080906 12727 raft_consensus.cc:2229] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.081101 10923 raft_consensus.cc:2454] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.081096 12727 raft_consensus.cc:2258] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:06.081598 10555 leader_election.cc:341] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.081755 10555 leader_election.cc:302] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.081795 12727 ts_tablet_manager.cc:1905] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.082103 13284 raft_consensus.cc:2726] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.082653 13241 raft_consensus.cc:482] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.082787 13241 raft_consensus.cc:504] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.083422 13241 leader_election.cc:288] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.082824 13282 leader_election.cc:288] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.083913 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.084481 11159 raft_consensus.cc:2454] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:06.085875 11365 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.088634 11365 tablet_bootstrap.cc:654] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.088977 10813 leader_election.cc:302] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.089882 13241 raft_consensus.cc:2781] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.089977 13241 raft_consensus.cc:482] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.090044 13241 raft_consensus.cc:3037] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.090045 11683 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 53) took 4238 ms. Trace:
I20260811 06:17:06.090265 11683 rpcz_store.cc:276] 0811 06:17:01.851424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.214358 (+3362934us) service_pool.cc:227] Handling call
0811 06:17:05.241796 (+ 27438us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:05.244836 (+ 3040us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:05.246519 (+ 1683us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:05.246607 (+ 88us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:05.270270 (+ 23663us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:06.089899 (+819629us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.247348 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.247462 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.247473 (+ 11us) write_op.cc:435] Acquired schema lock
0811 06:17:05.247476 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:05.247598 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.247613 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.247617 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:05.247690 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:05.247693 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:05.247731 (+ 38us) write_op.cc:270] Start()
0811 06:17:05.247768 (+ 37us) write_op.cc:276] Timestamp: P: 1786429025247711 usec, L: 0
0811 06:17:05.247772 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.248002 (+ 230us) log.cc:842] Serialized 405 byte log entry
0811 06:17:05.260518 (+ 12516us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.269320 (+ 8802us) write_op.cc:301] APPLY: starting
0811 06:17:05.269345 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.269391 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.269422 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.269491 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.269528 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:05.269534 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:05.269638 (+ 104us) log.cc:842] Serialized 23 byte log entry
0811 06:17:05.270029 (+ 391us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.270055 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:05.270063 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.270133 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.270136 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":8691,"apply.run_cpu_time_us":594,"apply.run_wall_time_us":897,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":769,"prepare.run_wall_time_us":770,"raft.queue_time_us":810,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":763,"replication_time_us":12715}]]}
I20260811 06:17:06.092943 13241 raft_consensus.cc:504] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.094429 13241 leader_election.cc:288] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.096262 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:06.096489 11159 raft_consensus.cc:3037] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.098879 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.099805 11159 raft_consensus.cc:2454] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:06.104635 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet b79f635593b04cd59d43d54f702a8cc6
I20260811 06:17:06.105520 11653 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 52) took 4552 ms. Trace:
W20260811 06:17:06.100327 10810 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.106096 10810 leader_election.cc:302] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:06.105846 11653 rpcz_store.cc:276] 0811 06:17:01.552948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.168627 (+3615679us) service_pool.cc:227] Handling call
0811 06:17:05.189071 (+ 20444us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:05.198647 (+ 9576us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:05.198794 (+ 147us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:05.198869 (+ 75us) catalog_manager.cc:2761] Locking tablets
0811 06:17:05.227606 (+ 28737us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:05.234610 (+ 7004us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:05.241901 (+ 7291us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:06.104482 (+862581us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:06.105356 (+ 874us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.228455 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.228556 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.228563 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:05.228565 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:05.228730 (+ 165us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.228746 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.228752 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:05.228885 (+ 133us) tablet.cc:699] Row locks acquired
0811 06:17:05.228887 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:05.228945 (+ 58us) write_op.cc:270] Start()
0811 06:17:05.228987 (+ 42us) write_op.cc:276] Timestamp: P: 1786429025228913 usec, L: 0
0811 06:17:05.228991 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.229204 (+ 213us) log.cc:842] Serialized 728 byte log entry
0811 06:17:05.232758 (+ 3554us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.233651 (+ 893us) write_op.cc:301] APPLY: starting
0811 06:17:05.233673 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.233744 (+ 71us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.233780 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.233869 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.233912 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:05.233919 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:05.234021 (+ 102us) log.cc:842] Serialized 29 byte log entry
0811 06:17:05.234325 (+ 304us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.234403 (+ 78us) write_op.cc:454] Released schema lock
0811 06:17:05.234413 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.234476 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.234480 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":46362368,"child_traces":[["op",{"apply.queue_time_us":820,"apply.run_cpu_time_us":646,"apply.run_wall_time_us":898,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":873,"prepare.run_wall_time_us":873,"raft.queue_time_us":97,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":666,"replication_time_us":3740}]]}
I20260811 06:17:06.106489 13103 raft_consensus.cc:2781] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.106608 13103 raft_consensus.cc:686] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:06.106848 13103 consensus_queue.cc:237] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.108354 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:06.108403 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:06.108665 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 9a79e23d311a447480c70393259cbfae
I20260811 06:17:06.109360 11663 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 56) took 4074 ms. Trace:
I20260811 06:17:06.109617 11663 rpcz_store.cc:276] 0811 06:17:02.035210 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.235200 (+3199990us) service_pool.cc:227] Handling call
0811 06:17:05.254398 (+ 19198us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:05.254552 (+ 154us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:05.254617 (+ 65us) catalog_manager.cc:2761] Locking tablets
0811 06:17:05.573446 (+318829us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:05.589781 (+ 16335us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:05.589952 (+ 171us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:06.108490 (+518538us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:06.109218 (+ 728us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.574592 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.574739 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.574746 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:05.574748 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:05.574878 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.574894 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.574899 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:05.575057 (+ 158us) tablet.cc:699] Row locks acquired
0811 06:17:05.575060 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:05.575105 (+ 45us) write_op.cc:270] Start()
0811 06:17:05.575145 (+ 40us) write_op.cc:276] Timestamp: P: 1786429025575052 usec, L: 0
0811 06:17:05.575149 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.575368 (+ 219us) log.cc:842] Serialized 728 byte log entry
0811 06:17:05.588843 (+ 13475us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.589069 (+ 226us) write_op.cc:301] APPLY: starting
0811 06:17:05.589087 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.589137 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.589246 (+ 109us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.589342 (+ 96us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.589382 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:05.589389 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:05.589474 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:05.589544 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.589565 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:05.589571 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.589631 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.589634 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":168,"apply.run_cpu_time_us":623,"apply.run_wall_time_us":623,"num_ops":2,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":880,"prepare.run_wall_time_us":881,"raft.queue_time_us":85,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":216,"replication_time_us":13661}]]}
I20260811 06:17:06.113394 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:06.116024 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:06.116367 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:06.116606 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:06.118062 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_90e19188370640aea2f976c2cd7ec2da [id=f4e741c74f0a430cb9b21deec24831fa] alter complete (version 2)
I20260811 06:17:06.118747 12726 raft_consensus.cc:2229] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.119626 12726 raft_consensus.cc:2258] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.124089 11361 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.124337 11361 ts_tablet_manager.cc:1397] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.006s
I20260811 06:17:06.125542 11361 raft_consensus.cc:348] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.125787 11361 raft_consensus.cc:374] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.125844 11361 raft_consensus.cc:729] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.126102 11361 consensus_queue.cc:260] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.126780 11361 ts_tablet_manager.cc:1428] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:06.127050 11361 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.132377 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0cdc826a1d8460aba1aae684c13131d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:06.133805 10810 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.138890 11361 tablet_bootstrap.cc:654] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.139735 11362 tablet_bootstrap.cc:654] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.140559 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:06.140985 12726 ts_tablet_manager.cc:1905] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.144500 12728 ts_tablet_manager.cc:1918] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.144631 12728 log.cc:1196] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/16674be53bd54f9395b650e19edd3cf4
I20260811 06:17:06.145021 12728 ts_tablet_manager.cc:1939] T 16674be53bd54f9395b650e19edd3cf4 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.145386 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 93) took 3783 ms. Trace:
I20260811 06:17:06.145488 12728 rpcz_store.cc:276] 0811 06:17:02.361499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.362452 (+ 953us) service_pool.cc:227] Handling call
0811 06:17:06.018606 (+3656154us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:17:06.018618 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.028529 (+ 9911us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.144384 (+115855us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.145366 (+ 982us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3655830}
I20260811 06:17:06.146193 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 16674be53bd54f9395b650e19edd3cf4 (table default.Table_a64d6f4bab3143d38f8607e0bcd63898 [id=2b421f86f2ea4c92a7b124bbf300a02e]) successfully deleted
I20260811 06:17:06.147604 13284 raft_consensus.cc:482] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.147771 13284 raft_consensus.cc:504] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.148391 13284 leader_election.cc:288] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.149008 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.149144 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:06.149648 10564 leader_election.cc:341] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:06.149986 10555 leader_election.cc:341] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.150097 10555 leader_election.cc:302] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.150516 13284 raft_consensus.cc:2726] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.157673 12727 ts_tablet_manager.cc:1918] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.157909 12727 log.cc:1196] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:17:06.161005 11653 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ec74453aafb6436c825c8333c1f0f468" } new_table_name: "default.Table_9073ee4ab0a549d9aac211766fc56887" modify_external_catalogs: true
I20260811 06:17:06.161235 11361 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.161741 11361 ts_tablet_manager.cc:1397] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.003s
I20260811 06:17:06.164744 11361 raft_consensus.cc:348] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.165153 11361 raft_consensus.cc:374] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.165508 11361 raft_consensus.cc:729] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.168658 11663 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_94c5412ff7bf4f4d8c39e2f67b18f1ac" } new_table_name: "default.Table_eea4fffd66b24b51a38504075b4d284a" modify_external_catalogs: true
I20260811 06:17:06.171929 11361 consensus_queue.cc:260] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.172837 11361 ts_tablet_manager.cc:1428] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260811 06:17:06.177855 13284 raft_consensus.cc:482] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.178052 13284 raft_consensus.cc:504] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.178826 13284 leader_election.cc:288] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.179768 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.180058 10915 raft_consensus.cc:2454] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:06.181108 10555 leader_election.cc:302] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:06.181555 13284 raft_consensus.cc:2781] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.181636 13284 raft_consensus.cc:482] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.181696 13284 raft_consensus.cc:3037] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.184873 13284 raft_consensus.cc:504] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.186420 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.186689 10915 raft_consensus.cc:3037] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.190084 10915 raft_consensus.cc:2454] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:06.191179 10555 leader_election.cc:302] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:06.191416 11362 tablet_bootstrap.cc:492] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.191561 11362 ts_tablet_manager.cc:1397] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.143s user 0.000s sys 0.004s
I20260811 06:17:06.192199 13284 leader_election.cc:288] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.192412 11362 raft_consensus.cc:348] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.192627 11362 raft_consensus.cc:374] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.192684 11362 raft_consensus.cc:729] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.192951 13284 raft_consensus.cc:2781] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.192903 11362 consensus_queue.cc:260] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.193508 11362 ts_tablet_manager.cc:1428] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:06.194095 13284 raft_consensus.cc:686] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:06.194815 13284 consensus_queue.cc:237] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.198267 11365 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.198451 11365 ts_tablet_manager.cc:1397] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.113s user 0.001s sys 0.010s
I20260811 06:17:06.199280 11365 raft_consensus.cc:348] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.199527 11365 raft_consensus.cc:374] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.199586 11365 raft_consensus.cc:729] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.203409 11361 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.203966 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:06.205281 10564 leader_election.cc:341] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.203370 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:06.207837 10564 leader_election.cc:341] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.173910 12727 ts_tablet_manager.cc:1939] T f2bdb349406a46629e6c307e1ebfd9dc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.209280 13306 raft_consensus.cc:482] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.209957 13306 raft_consensus.cc:504] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.211432 11365 consensus_queue.cc:260] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.212695 11361 tablet_bootstrap.cc:654] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.213227 11362 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.206588 12728 tablet_replica.cc:330] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.218580 12728 raft_consensus.cc:2229] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.219105 12728 raft_consensus.cc:2258] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.219796 12728 ts_tablet_manager.cc:1905] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.225613 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 101) took 3949 ms. Trace:
I20260811 06:17:06.232775 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.232838 13306 leader_election.cc:288] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
W20260811 06:17:06.233470 11047 leader_election.cc:341] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.226035 12727 rpcz_store.cc:276] 0811 06:17:02.275696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.275744 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:06.080547 (+3804803us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:17:06.080559 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.136166 (+ 55607us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.157227 (+ 21061us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.225548 (+ 68321us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1048,"tablet-delete.queue_time_us":3802935}
I20260811 06:17:06.238828 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f2bdb349406a46629e6c307e1ebfd9dc (table default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]) successfully deleted
I20260811 06:17:06.238799 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.239071 10662 raft_consensus.cc:2454] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.239249 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 102) took 3963 ms. Trace:
I20260811 06:17:06.239468 11046 leader_election.cc:302] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.239605 12727 rpcz_store.cc:276] 0811 06:17:02.276210 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.276261 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:06.238857 (+3962596us) ts_tablet_manager.cc:1145] Deleting tablet 1349b0ea48b848398d4bdda528358c30
0811 06:17:06.238874 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.239227 (+ 353us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3961151}
W20260811 06:17:06.240414 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:06.240691 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 103) took 3963 ms. Trace:
I20260811 06:17:06.240752 13381 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20260811 06:17:06.241967 13282 raft_consensus.cc:2781] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.242174 13282 raft_consensus.cc:482] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.242424 13282 raft_consensus.cc:3037] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:06.242918 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 51778.4us
W20260811 06:17:06.244082 10555 consensus_peers.cc:487] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fbdda840466420f8d67a8cb5868ba03. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.246891 13282 raft_consensus.cc:504] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.239429 13379 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20260811 06:17:06.247669 13282 leader_election.cc:288] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.248127 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.248339 10662 raft_consensus.cc:3037] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.251287 10662 raft_consensus.cc:2454] T 4d4d5c19d1aa486fa6415907628e6f57 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.251803 11046 leader_election.cc:302] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.253130 13282 raft_consensus.cc:2781] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.253651 13282 raft_consensus.cc:686] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.254000 13282 consensus_queue.cc:237] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.240850 12727 rpcz_store.cc:276] 0811 06:17:02.276880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.276932 (+ 52us) service_pool.cc:227] Handling call
0811 06:17:06.240325 (+3963393us) ts_tablet_manager.cc:1145] Deleting tablet 5ca903ee846a4e5baf3dbb4302607c1f
0811 06:17:06.240337 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.240639 (+ 302us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3962593}
I20260811 06:17:06.259917 12727 tablet_replica.cc:330] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.260300 12727 raft_consensus.cc:2229] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.260546 12727 raft_consensus.cc:2258] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.261315 12727 ts_tablet_manager.cc:1905] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:06.262068 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca903ee846a4e5baf3dbb4302607c1f already in progress: creating tablet
I20260811 06:17:06.248504 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:06.263484 11047 leader_election.cc:341] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.266788 11365 ts_tablet_manager.cc:1428] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.068s user 0.001s sys 0.004s
I20260811 06:17:06.268011 12728 ts_tablet_manager.cc:1918] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.268147 12728 log.cc:1196] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/006d3214480c47babe390496b335de70
I20260811 06:17:06.271952 12728 ts_tablet_manager.cc:1939] T 006d3214480c47babe390496b335de70 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.272809 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 94) took 3909 ms. Trace:
I20260811 06:17:06.272912 12728 rpcz_store.cc:276] 0811 06:17:02.363291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.363422 (+ 131us) service_pool.cc:227] Handling call
0811 06:17:06.206512 (+3843090us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:17:06.206529 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.235750 (+ 29221us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.267876 (+ 32126us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.272789 (+ 4913us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3842675}
I20260811 06:17:06.273262 12728 tablet_replica.cc:330] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.273471 12728 raft_consensus.cc:2229] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.273475 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 006d3214480c47babe390496b335de70 (table default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]) successfully deleted
I20260811 06:17:06.273818 12728 raft_consensus.cc:2258] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.274392 12728 ts_tablet_manager.cc:1905] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.277212 11365 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.282305 11362 tablet_bootstrap.cc:654] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.293669 13387 tablet.cc:1722] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20260811 06:17:06.298070 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:06.303102 12728 ts_tablet_manager.cc:1918] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.303263 12728 log.cc:1196] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2875318863584e659e2b76ad2a72ca45
I20260811 06:17:06.303638 12728 ts_tablet_manager.cc:1939] T 2875318863584e659e2b76ad2a72ca45 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.306617 11361 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.307153 11361 ts_tablet_manager.cc:1397] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.104s user 0.006s sys 0.000s
I20260811 06:17:06.309613 11361 raft_consensus.cc:348] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.306676 12727 ts_tablet_manager.cc:1918] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.310011 11361 raft_consensus.cc:374] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.310226 12727 log.cc:1196] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:06.311321 12727 ts_tablet_manager.cc:1939] T 7fbdda840466420f8d67a8cb5868ba03 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.310735 11361 raft_consensus.cc:729] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.311954 11361 consensus_queue.cc:260] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.312762 11361 ts_tablet_manager.cc:1428] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:17:06.313618 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:06.314049 11365 tablet_bootstrap.cc:654] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.314769 12726 ts_tablet_manager.cc:1918] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.314982 12726 log.cc:1196] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/37e73b8798b2455baf642abc532a5d8c
I20260811 06:17:06.315424 12726 ts_tablet_manager.cc:1939] T 37e73b8798b2455baf642abc532a5d8c P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.317858 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 73) took 3974 ms. Trace:
I20260811 06:17:06.317997 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 100) took 4043 ms. Trace:
I20260811 06:17:06.318185 12727 rpcz_store.cc:276] 0811 06:17:02.273942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.275169 (+ 1227us) service_pool.cc:227] Handling call
0811 06:17:06.259856 (+3984687us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:17:06.259870 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.293321 (+ 33451us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.306537 (+ 13216us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.317836 (+ 11299us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3981993}
I20260811 06:17:06.318658 12727 tablet_replica.cc:330] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.318894 12727 raft_consensus.cc:2229] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.318704 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7fbdda840466420f8d67a8cb5868ba03 (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]) successfully deleted
I20260811 06:17:06.319254 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 95) took 3955 ms. Trace:
I20260811 06:17:06.319324 12727 raft_consensus.cc:2258] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.319367 12728 rpcz_store.cc:276] 0811 06:17:02.364137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.365171 (+ 1034us) service_pool.cc:227] Handling call
0811 06:17:06.273212 (+3908041us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:17:06.273224 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.295662 (+ 22438us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.302984 (+ 7322us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.319224 (+ 16240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3907644}
I20260811 06:17:06.319972 12728 tablet_replica.cc:330] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.319996 12727 ts_tablet_manager.cc:1905] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.319965 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2875318863584e659e2b76ad2a72ca45 (table default.Table_3aeade8d5c694298954b38d3d3ed01bb [id=2f798d3676d5463da80a81e029017dd9]) successfully deleted
I20260811 06:17:06.320181 12728 raft_consensus.cc:2229] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.320358 12728 raft_consensus.cc:2258] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.321014 12728 ts_tablet_manager.cc:1905] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.321240 12726 rpcz_store.cc:276] 0811 06:17:02.343580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.343957 (+ 377us) service_pool.cc:227] Handling call
0811 06:17:05.967484 (+3623527us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:17:05.967494 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.283180 (+315686us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.311780 (+ 28600us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.317837 (+ 6057us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623165}
I20260811 06:17:06.321791 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:06.323407 12726 tablet_replica.cc:330] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.322716 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 37e73b8798b2455baf642abc532a5d8c (table default.Table_24b24206598e4f27a32cabb7ed03ed3e [id=4bc106defb5246f6b2ceed8c51ba1516]) successfully deleted
I20260811 06:17:06.324776 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:06.325650 12726 raft_consensus.cc:2229] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.326993 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:06.327266 12726 raft_consensus.cc:2258] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.327682 11362 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.327978 11362 ts_tablet_manager.cc:1397] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.115s user 0.005s sys 0.004s
I20260811 06:17:06.328534 12726 ts_tablet_manager.cc:1905] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.331074 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:06.332623 11361 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.328002 12728 ts_tablet_manager.cc:1918] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.330174 11362 raft_consensus.cc:348] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.333788 12728 log.cc:1196] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/22cac1c339574b1fa26555b18811539b
I20260811 06:17:06.334143 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:06.334244 12728 ts_tablet_manager.cc:1939] T 22cac1c339574b1fa26555b18811539b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.333581 11362 raft_consensus.cc:374] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.334368 11362 raft_consensus.cc:729] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.336660 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 96) took 3970 ms. Trace:
I20260811 06:17:06.336762 12728 rpcz_store.cc:276] 0811 06:17:02.365989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.366406 (+ 417us) service_pool.cc:227] Handling call
0811 06:17:06.319899 (+3953493us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:17:06.319913 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.324573 (+ 4660us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.327894 (+ 3321us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.336640 (+ 8746us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3953045}
I20260811 06:17:06.337313 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 97) took 3970 ms. Trace:
I20260811 06:17:06.337402 12728 rpcz_store.cc:276] 0811 06:17:02.367166 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.367886 (+ 720us) service_pool.cc:227] Handling call
0811 06:17:06.337182 (+3969296us) ts_tablet_manager.cc:1145] Deleting tablet 1349b0ea48b848398d4bdda528358c30
0811 06:17:06.337194 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.337298 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968258}
I20260811 06:17:06.337828 12728 tablet_replica.cc:330] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.338033 12728 raft_consensus.cc:2229] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.339201 11361 tablet_bootstrap.cc:654] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.338335 12728 raft_consensus.cc:2258] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.343292 12728 ts_tablet_manager.cc:1905] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.336881 11362 consensus_queue.cc:260] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.337196 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 22cac1c339574b1fa26555b18811539b (table default.Table_d8cc9675043642d78621843c4e0c7600 [id=a6f198699e044c0baffbc5d9d9023fa6]) successfully deleted
W20260811 06:17:06.347901 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:06.348464 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:06.348680 11362 ts_tablet_manager.cc:1428] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260811 06:17:06.350687 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:06.353080 11362 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.360757 12727 ts_tablet_manager.cc:1918] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.361068 12727 log.cc:1196] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f88af70bbada49309a0e7cc7c333d6f0
I20260811 06:17:06.361850 12727 ts_tablet_manager.cc:1939] T f88af70bbada49309a0e7cc7c333d6f0 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.362349 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 104) took 4084 ms. Trace:
I20260811 06:17:06.362514 12727 rpcz_store.cc:276] 0811 06:17:02.277504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.278021 (+ 517us) service_pool.cc:227] Handling call
0811 06:17:06.318508 (+4040487us) ts_tablet_manager.cc:1145] Deleting tablet f88af70bbada49309a0e7cc7c333d6f0
0811 06:17:06.318519 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.345509 (+ 26990us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.360579 (+ 15070us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.362307 (+ 1728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4036064}
I20260811 06:17:06.363126 12727 tablet_replica.cc:330] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.363416 12727 raft_consensus.cc:2229] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.363662 12727 raft_consensus.cc:2258] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.364403 12727 ts_tablet_manager.cc:1905] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.364715 11365 tablet_bootstrap.cc:492] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.365053 11365 ts_tablet_manager.cc:1397] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.008s
I20260811 06:17:06.363170 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f88af70bbada49309a0e7cc7c333d6f0 (table default.Table_5158afff0daf485d8ebd8e03934c96b9 [id=d69efd0f2d58483fa432041de974afee]) successfully deleted
I20260811 06:17:06.367281 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:06.367789 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:06.367421 11365 raft_consensus.cc:348] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.368074 11365 raft_consensus.cc:374] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.368216 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:06.368335 11365 raft_consensus.cc:729] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.369170 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:06.369449 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:06.370113 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:06.370738 12728 ts_tablet_manager.cc:1918] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.370891 12728 log.cc:1196] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/dc6254bf781740019c3f71b26179f25d
I20260811 06:17:06.371320 12728 ts_tablet_manager.cc:1939] T dc6254bf781740019c3f71b26179f25d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.371881 12727 ts_tablet_manager.cc:1918] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.369292 11365 consensus_queue.cc:260] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.372105 12727 log.cc:1196] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/16674be53bd54f9395b650e19edd3cf4
I20260811 06:17:06.372208 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 98) took 4003 ms. Trace:
I20260811 06:17:06.372313 12728 rpcz_store.cc:276] 0811 06:17:02.368451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.369173 (+ 722us) service_pool.cc:227] Handling call
0811 06:17:06.337783 (+3968610us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:17:06.337794 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.363728 (+ 25934us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.370612 (+ 6884us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.372183 (+ 1571us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968235}
I20260811 06:17:06.372633 12727 ts_tablet_manager.cc:1939] T 16674be53bd54f9395b650e19edd3cf4 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.373014 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet dc6254bf781740019c3f71b26179f25d (table default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]) successfully deleted
I20260811 06:17:06.373466 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 105) took 4089 ms. Trace:
I20260811 06:17:06.373605 12727 rpcz_store.cc:276] 0811 06:17:02.284230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.284281 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:06.363032 (+4078751us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:17:06.363044 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.368470 (+ 5426us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.371741 (+ 3271us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.373401 (+ 1660us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4078406}
I20260811 06:17:06.374243 12727 tablet_replica.cc:330] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.374521 12727 raft_consensus.cc:2229] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.374756 12727 raft_consensus.cc:2258] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.374877 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 99) took 4005 ms. Trace:
I20260811 06:17:06.374969 12728 rpcz_store.cc:276] 0811 06:17:02.369834 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.370087 (+ 253us) service_pool.cc:227] Handling call
0811 06:17:06.374710 (+4004623us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:17:06.374726 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.374856 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4004211}
I20260811 06:17:06.375398 12727 ts_tablet_manager.cc:1905] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.375495 12728 tablet_replica.cc:330] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:17:06.375517 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 227bc4fd6cd84e5eb2043c52f95d606d already in progress: creating tablet
I20260811 06:17:06.375782 13378 raft_consensus.cc:482] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.375893 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 16674be53bd54f9395b650e19edd3cf4 (table default.Table_a64d6f4bab3143d38f8607e0bcd63898 [id=2b421f86f2ea4c92a7b124bbf300a02e]) successfully deleted
I20260811 06:17:06.375910 13378 raft_consensus.cc:504] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.376605 13378 leader_election.cc:288] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.376750 12728 raft_consensus.cc:2229] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.376945 12728 raft_consensus.cc:2258] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.377575 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.377333 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.377880 10915 raft_consensus.cc:2454] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:06.378260 10555 leader_election.cc:302] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:06.378959 13378 raft_consensus.cc:2781] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.379032 13378 raft_consensus.cc:482] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.379082 13378 raft_consensus.cc:3037] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.381213 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
W20260811 06:17:06.381865 10564 leader_election.cc:341] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.382539 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:06.383047 13378 raft_consensus.cc:504] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.385654 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.385915 10915 raft_consensus.cc:3037] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.386456 12726 ts_tablet_manager.cc:1918] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.386560 12727 ts_tablet_manager.cc:1918] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.386734 12727 log.cc:1196] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2875318863584e659e2b76ad2a72ca45
I20260811 06:17:06.388669 10915 raft_consensus.cc:2454] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:06.385180 11683 catalog_manager.cc:5495] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } }
I20260811 06:17:06.389926 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:06.390492 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:06.389045 10555 leader_election.cc:302] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:06.391151 13284 raft_consensus.cc:2781] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.391283 13284 raft_consensus.cc:686] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:06.391516 13284 consensus_queue.cc:237] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.391750 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:06.391940 13378 leader_election.cc:288] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.393347 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:06.393115 11365 ts_tablet_manager.cc:1428] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.028s user 0.000s sys 0.004s
I20260811 06:17:06.391634 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
W20260811 06:17:06.394559 10564 leader_election.cc:341] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.394829 11159 raft_consensus.cc:1226] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 LEADER]: Rejecting Update request from peer 56a371f7ed104f68a5db9ca097eb237e for earlier term 1. Current term is 2. Ops: []
I20260811 06:17:06.395402 13103 consensus_queue.cc:1046] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:06.395668 13103 consensus_queue.cc:1225] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Peer f8dcf15ece3a4389932aa672079442b6 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260811 06:17:06.395792 13103 raft_consensus.cc:3032] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Stepping down as leader of term 1
I20260811 06:17:06.395892 13103 raft_consensus.cc:729] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:06.395834 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:06.396189 13103 consensus_queue.cc:260] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.397955 11365 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.398640 13103 raft_consensus.cc:3037] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Advancing to term 2
I20260811 06:17:06.400315 11361 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.404160 11362 tablet_bootstrap.cc:654] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.409547 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:06.391287 12726 log.cc:1196] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:06.412402 12726 ts_tablet_manager.cc:1939] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.414047 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 64) took 4078 ms. Trace:
I20260811 06:17:06.418604 12726 rpcz_store.cc:276] 0811 06:17:02.335546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336865 (+ 1319us) service_pool.cc:227] Handling call
0811 06:17:06.323355 (+3986490us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:06.323370 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.344318 (+ 20948us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.386371 (+ 42053us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.414024 (+ 27653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3978637}
I20260811 06:17:06.419207 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 68) took 4083 ms. Trace:
I20260811 06:17:06.419373 12726 rpcz_store.cc:276] 0811 06:17:02.336241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336883 (+ 642us) service_pool.cc:227] Handling call
0811 06:17:06.419072 (+4082189us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:06.419083 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.419191 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4073978}
I20260811 06:17:06.419409 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (table default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]) successfully deleted
I20260811 06:17:06.419775 12726 tablet_replica.cc:330] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.420039 12726 raft_consensus.cc:2229] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.420054 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:06.420288 12726 raft_consensus.cc:2258] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.420948 12726 ts_tablet_manager.cc:1905] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.421180 12727 ts_tablet_manager.cc:1939] T 2875318863584e659e2b76ad2a72ca45 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.422281 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 106) took 4137 ms. Trace:
I20260811 06:17:06.422385 12727 rpcz_store.cc:276] 0811 06:17:02.284857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.284904 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:06.374050 (+4089146us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:17:06.374061 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.383078 (+ 9017us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.386360 (+ 3282us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.422260 (+ 35900us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4087585}
W20260811 06:17:06.420393 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:06.422920 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 2875318863584e659e2b76ad2a72ca45 (table default.Table_3aeade8d5c694298954b38d3d3ed01bb [id=2f798d3676d5463da80a81e029017dd9]) successfully deleted
I20260811 06:17:06.423139 11365 tablet_bootstrap.cc:654] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.424095 12727 tablet_replica.cc:330] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.424332 12727 raft_consensus.cc:2229] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.424666 12727 raft_consensus.cc:2258] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.426388 12727 ts_tablet_manager.cc:1905] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.426471 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:06.426817 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:06.427484 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:06.431275 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:06.438506 12726 ts_tablet_manager.cc:1918] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.438589 12727 ts_tablet_manager.cc:1918] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.438724 12727 log.cc:1196] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/847df543db4244a6b2900fc16fea7c07
I20260811 06:17:06.438953 12726 log.cc:1196] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/006d3214480c47babe390496b335de70
I20260811 06:17:06.439123 12727 ts_tablet_manager.cc:1939] T 847df543db4244a6b2900fc16fea7c07 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.439437 12726 ts_tablet_manager.cc:1939] T 006d3214480c47babe390496b335de70 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.439558 11362 tablet_bootstrap.cc:492] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.439891 11362 ts_tablet_manager.cc:1397] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.005s
I20260811 06:17:06.439980 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 108) took 4153 ms. Trace:
I20260811 06:17:06.440083 12727 rpcz_store.cc:276] 0811 06:17:02.286918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.289525 (+ 2607us) service_pool.cc:227] Handling call
0811 06:17:06.424040 (+4134515us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:17:06.424054 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.432823 (+ 8769us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.438473 (+ 5650us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.439958 (+ 1485us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4134063}
I20260811 06:17:06.440598 12727 tablet_replica.cc:330] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.440611 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 847df543db4244a6b2900fc16fea7c07 (table default.Table_f87e6f04862c4ce69e2d6650e87e0618 [id=984fbc452ec24ab6ab362a27179e1623]) successfully deleted
I20260811 06:17:06.440717 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 71) took 4103 ms. Trace:
I20260811 06:17:06.440785 12727 raft_consensus.cc:2229] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.440806 12726 rpcz_store.cc:276] 0811 06:17:02.336698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336834 (+ 136us) service_pool.cc:227] Handling call
0811 06:17:06.419727 (+4082893us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:17:06.419742 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.428196 (+ 8454us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.438363 (+ 10167us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.440600 (+ 2237us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4074266}
I20260811 06:17:06.441177 12727 raft_consensus.cc:2258] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.441430 12726 tablet_replica.cc:330] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.441394 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 006d3214480c47babe390496b335de70 (table default.Table_6ae50c6bd40447b191f2b98dc7c35552 [id=29c853f64326440696fd2c41b8306f18]) successfully deleted
I20260811 06:17:06.441685 12726 raft_consensus.cc:2229] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.441746 12727 ts_tablet_manager.cc:1905] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.441956 12726 raft_consensus.cc:2258] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.442049 11362 raft_consensus.cc:348] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.442595 11362 raft_consensus.cc:374] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.442749 11362 raft_consensus.cc:729] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.443480 12728 ts_tablet_manager.cc:1905] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.442533 12726 ts_tablet_manager.cc:1905] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.440927 11683 catalog_manager.cc:5495] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } }
I20260811 06:17:06.445245 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:06.445989 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:06.446352 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:06.446725 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]). Expected version 7 got 6
I20260811 06:17:06.447217 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:06.447419 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:06.447856 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:06.448021 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:06.448213 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:06.448567 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:06.448866 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:06.449118 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:06.449301 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:06.449632 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:06.449640 12726 ts_tablet_manager.cc:1918] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.449774 12726 log.cc:1196] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/681736b44af04718b800d503ca645c1a
I20260811 06:17:06.450129 12726 ts_tablet_manager.cc:1939] T 681736b44af04718b800d503ca645c1a P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.450901 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 69) took 4114 ms. Trace:
I20260811 06:17:06.456845 12728 ts_tablet_manager.cc:1918] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.457074 12728 log.cc:1196] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6dee9af5a4504b8284c9150298ab3462
I20260811 06:17:06.443290 11362 consensus_queue.cc:260] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.447221 13103 raft_consensus.cc:482] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.458076 13103 raft_consensus.cc:504] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.458768 13103 leader_election.cc:288] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.459925 11362 ts_tablet_manager.cc:1428] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260811 06:17:06.460841 11362 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.461787 13132 raft_consensus.cc:482] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.461958 13132 raft_consensus.cc:504] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.470397 11362 tablet_bootstrap.cc:654] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.457530 12728 ts_tablet_manager.cc:1939] T 6dee9af5a4504b8284c9150298ab3462 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.475378 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 100) took 4104 ms. Trace:
I20260811 06:17:06.459264 11365 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.475665 12726 rpcz_store.cc:276] 0811 06:17:02.336440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336814 (+ 374us) service_pool.cc:227] Handling call
0811 06:17:06.441387 (+4104573us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:17:06.441397 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.446769 (+ 5372us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.449552 (+ 2783us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.450876 (+ 1324us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3990727}
I20260811 06:17:06.464021 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.475934 11365 ts_tablet_manager.cc:1397] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.006s
I20260811 06:17:06.476048 10651 raft_consensus.cc:2454] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:06.476296 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 681736b44af04718b800d503ca645c1a (table default.Table_ecbfc78f213d4d2f9efe02b95e85e6ef [id=2590d2d487344033b794724044194981]) successfully deleted
I20260811 06:17:06.476313 12726 tablet_replica.cc:330] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.476639 10810 leader_election.cc:302] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:06.475488 12728 rpcz_store.cc:276] 0811 06:17:02.370808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.371027 (+ 219us) service_pool.cc:227] Handling call
0811 06:17:06.375445 (+4004418us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:17:06.375457 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.454031 (+ 78574us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.456751 (+ 2720us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.475353 (+ 18602us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4004143}
I20260811 06:17:06.477106 12726 raft_consensus.cc:2229] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.477303 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6dee9af5a4504b8284c9150298ab3462 (table default.Table_ac3235af8d1f42d29a220ec551aa448a [id=3b92a2f628794cb3827f5015816baa11]) successfully deleted
I20260811 06:17:06.477373 12726 raft_consensus.cc:2258] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.477538 12728 tablet_replica.cc:330] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.478174 12726 ts_tablet_manager.cc:1905] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.478561 12728 raft_consensus.cc:2229] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.478778 12728 raft_consensus.cc:2258] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.477692 12944 raft_consensus.cc:2781] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.479259 12944 raft_consensus.cc:482] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.479362 12944 raft_consensus.cc:3037] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.479382 12728 ts_tablet_manager.cc:1905] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.478399 11365 raft_consensus.cc:348] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.479919 11365 raft_consensus.cc:374] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.480074 11365 raft_consensus.cc:729] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.480577 11365 consensus_queue.cc:260] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.482402 11365 ts_tablet_manager.cc:1428] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260811 06:17:06.489586 11365 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.490640 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.490870 10651 raft_consensus.cc:2454] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.491472 11046 leader_election.cc:302] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.483381 12944 raft_consensus.cc:504] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.491789 13306 raft_consensus.cc:2781] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.491909 13306 raft_consensus.cc:482] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.491984 13306 raft_consensus.cc:3037] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.493191 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.493382 10651 raft_consensus.cc:3037] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.494457 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:06.494765 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:06.495157 13306 raft_consensus.cc:504] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.496126 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.496269 10662 raft_consensus.cc:3037] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.496260 13306 leader_election.cc:288] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.496481 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:06.498766 13132 leader_election.cc:288] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.500166 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.500362 10915 raft_consensus.cc:3037] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.500511 11361 ts_tablet_manager.cc:1397] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.169s user 0.021s sys 0.004s
I20260811 06:17:06.500703 12726 ts_tablet_manager.cc:1918] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.500821 12726 log.cc:1196] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f4f14a0add084048b92a501476ad6588
I20260811 06:17:06.501204 12726 ts_tablet_manager.cc:1939] T f4f14a0add084048b92a501476ad6588 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.501183 11361 raft_consensus.cc:348] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.502000 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 70) took 4165 ms. Trace:
I20260811 06:17:06.502095 12726 rpcz_store.cc:276] 0811 06:17:02.336576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.336650 (+ 74us) service_pool.cc:227] Handling call
0811 06:17:06.476259 (+4139609us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:17:06.476274 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.497754 (+ 21480us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.500595 (+ 2841us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.501978 (+ 1383us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4025391}
I20260811 06:17:06.502610 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f4f14a0add084048b92a501476ad6588 (table default.Table_e8e359f459ab4b79a079b6f990345a9a [id=7792bcddbdd44cad988860223ed4e05e]) successfully deleted
I20260811 06:17:06.503135 10915 raft_consensus.cc:2454] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.503993 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.500145 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb437660103845aa98af100aef1c3021" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.504366 10923 raft_consensus.cc:2362] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1. Re-sending same reply.
I20260811 06:17:06.505051 11361 raft_consensus.cc:374] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.505143 11361 raft_consensus.cc:729] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.505336 11361 consensus_queue.cc:260] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.505802 11047 leader_election.cc:302] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.505903 11361 ts_tablet_manager.cc:1428] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:06.506191 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:06.506301 13282 raft_consensus.cc:2781] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.506421 13282 raft_consensus.cc:686] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.506579 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:06.506592 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:06.506664 13282 consensus_queue.cc:237] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.506834 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:06.507102 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:06.507258 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:06.507246 13132 consensus_queue.cc:1035] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:06.507462 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:06.507929 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:06.508293 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:06.506822 11361 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:06.511051 10813 leader_election.cc:341] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.512854 11361 tablet_bootstrap.cc:654] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:06.516223 10813 leader_election.cc:341] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.517438 12728 ts_tablet_manager.cc:1918] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.517565 12728 log.cc:1196] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f12c8618198f4413b2727d04f850a10f
I20260811 06:17:06.520006 12727 ts_tablet_manager.cc:1918] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.520125 12727 log.cc:1196] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/5119e9bb88844329aea123dc3805d91d
I20260811 06:17:06.520479 12727 ts_tablet_manager.cc:1939] T 5119e9bb88844329aea123dc3805d91d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.520450 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:06.520795 10662 raft_consensus.cc:2454] T eb437660103845aa98af100aef1c3021 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.520810 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 109) took 4233 ms. Trace:
I20260811 06:17:06.520980 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:06.520889 12727 rpcz_store.cc:276] 0811 06:17:02.287107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.290013 (+ 2906us) service_pool.cc:227] Handling call
0811 06:17:06.440545 (+4150532us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:17:06.440557 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.444659 (+ 4102us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.519890 (+ 75231us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.520793 (+ 903us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4150258}
I20260811 06:17:06.521272 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:06.495952 10651 raft_consensus.cc:2454] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:06.521633 12727 tablet_replica.cc:330] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.522140 10810 leader_election.cc:302] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.522256 12727 raft_consensus.cc:2229] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.522442 13103 raft_consensus.cc:2781] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.522565 13103 raft_consensus.cc:686] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:06.522581 12727 raft_consensus.cc:2258] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.522712 12726 tablet_replica.cc:330] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.522789 13103 consensus_queue.cc:237] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.523281 12727 ts_tablet_manager.cc:1905] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.523237 11365 tablet_bootstrap.cc:654] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.526470 12726 raft_consensus.cc:2229] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.522480 12728 ts_tablet_manager.cc:1939] T f12c8618198f4413b2727d04f850a10f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.527046 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 101) took 4155 ms. Trace:
I20260811 06:17:06.528776 13306 raft_consensus.cc:482] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.528936 13306 raft_consensus.cc:504] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.529580 13306 leader_election.cc:288] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.530385 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.533742 10651 raft_consensus.cc:2454] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.534194 11046 leader_election.cc:302] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.534127 12728 rpcz_store.cc:276] 0811 06:17:02.371725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.372015 (+ 290us) service_pool.cc:227] Handling call
0811 06:17:06.476964 (+4104949us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:17:06.476976 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.504391 (+ 27415us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.517322 (+ 12931us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.527025 (+ 9703us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4104519}
I20260811 06:17:06.534006 12726 raft_consensus.cc:2258] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.521377 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 5119e9bb88844329aea123dc3805d91d (table default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]) successfully deleted
I20260811 06:17:06.534729 13306 raft_consensus.cc:2781] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.534806 13306 raft_consensus.cc:482] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.534864 13306 raft_consensus.cc:3037] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.534873 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f12c8618198f4413b2727d04f850a10f (table default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]) successfully deleted
I20260811 06:17:06.535998 12726 ts_tablet_manager.cc:1905] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.537047 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:06.527807 12944 leader_election.cc:288] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.530216 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.541414 12728 tablet_replica.cc:330] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.541677 12728 raft_consensus.cc:2229] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.541901 12728 raft_consensus.cc:2258] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.542549 12728 ts_tablet_manager.cc:1905] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.544708 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:06.551465 12726 ts_tablet_manager.cc:1918] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.551975 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:06.552621 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:06.553176 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
W20260811 06:17:06.553666 11047 consensus_peers.cc:487] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:06.553894 11047 leader_election.cc:341] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.554766 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:06.555377 13306 raft_consensus.cc:504] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.556720 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:06.557024 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:06.557626 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:06.558050 13306 leader_election.cc:288] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.558830 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:06.559571 11047 leader_election.cc:341] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.559583 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:06.560164 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:06.561422 12727 ts_tablet_manager.cc:1918] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.561560 12727 log.cc:1196] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ab32f96671984766a54b5ee904c465f7
I20260811 06:17:06.562023 12727 ts_tablet_manager.cc:1939] T ab32f96671984766a54b5ee904c465f7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.562340 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 110) took 4275 ms. Trace:
I20260811 06:17:06.562433 12727 rpcz_store.cc:276] 0811 06:17:02.287319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.290326 (+ 3007us) service_pool.cc:227] Handling call
0811 06:17:06.521584 (+4231258us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:17:06.521595 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.555788 (+ 34193us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.561326 (+ 5538us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.562323 (+ 997us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4230992}
I20260811 06:17:06.562978 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ab32f96671984766a54b5ee904c465f7 (table default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]) successfully deleted
I20260811 06:17:06.563333 12727 tablet_replica.cc:330] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.563647 12727 raft_consensus.cc:2229] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.563839 12727 raft_consensus.cc:2258] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.564378 12727 ts_tablet_manager.cc:1905] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.566095 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:06.554245 13284 raft_consensus.cc:482] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.566399 13284 raft_consensus.cc:504] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.567189 13284 leader_election.cc:288] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.558614 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad5529d4844f61b0888624e7c8b3ce" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.567368 10659 raft_consensus.cc:3037] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.568542 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.568702 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:06.569268 10555 leader_election.cc:341] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:06.569594 10564 leader_election.cc:341] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.569914 12726 log.cc:1196] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2f243c792a634abf83484aef820dbb48
I20260811 06:17:06.570571 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:06.571650 12728 ts_tablet_manager.cc:1918] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.572209 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:06.572901 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:06.573125 12728 log.cc:1196] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:06.573602 12728 ts_tablet_manager.cc:1939] T bc3091f8a8f9442da50b17d4752cedb0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.574012 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]). Expected version 7 got 6
I20260811 06:17:06.575014 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:06.576198 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 102) took 4203 ms. Trace:
I20260811 06:17:06.576352 12728 rpcz_store.cc:276] 0811 06:17:02.372811 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.373210 (+ 399us) service_pool.cc:227] Handling call
0811 06:17:06.534467 (+4161257us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:06.541349 (+ 6882us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.561117 (+ 19768us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.571523 (+ 10406us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.576176 (+ 4653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4160863}
I20260811 06:17:06.575666 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:06.577140 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:06.577492 12728 tablet_replica.cc:330] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.577756 12728 raft_consensus.cc:2229] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.577947 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bc3091f8a8f9442da50b17d4752cedb0 (table default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]) successfully deleted
I20260811 06:17:06.578269 12727 ts_tablet_manager.cc:1918] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.578294 12728 raft_consensus.cc:2258] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.578404 12727 log.cc:1196] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ae1e42440ff14857b297621ca6031835
I20260811 06:17:06.578071 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:06.579543 12728 ts_tablet_manager.cc:1905] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.579767 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:06.580293 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:06.581517 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:06.587014 12727 ts_tablet_manager.cc:1939] T ae1e42440ff14857b297621ca6031835 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.587423 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 111) took 4299 ms. Trace:
I20260811 06:17:06.587525 12727 rpcz_store.cc:276] 0811 06:17:02.287507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.290626 (+ 3119us) service_pool.cc:227] Handling call
0811 06:17:06.563279 (+4272653us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:17:06.563292 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.575292 (+ 12000us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.578165 (+ 2873us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.587405 (+ 9240us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4272240}
I20260811 06:17:06.587882 12727 tablet_replica.cc:330] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.588104 12727 raft_consensus.cc:2229] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.588219 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ae1e42440ff14857b297621ca6031835 (table default.Table_8f4b4732c67448209df33512a2495a25 [id=23ec4328fe004a8ab2e8cff534a30e0b]) successfully deleted
I20260811 06:17:06.588194 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:06.588536 12727 raft_consensus.cc:2258] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.588749 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:06.589051 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:06.589205 12727 ts_tablet_manager.cc:1905] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.594604 11361 tablet_bootstrap.cc:492] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.594792 11361 ts_tablet_manager.cc:1397] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.002s
I20260811 06:17:06.595507 11361 raft_consensus.cc:348] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.595724 11361 raft_consensus.cc:374] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.595795 11361 raft_consensus.cc:729] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.595986 11361 consensus_queue.cc:260] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.596669 11361 ts_tablet_manager.cc:1428] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:06.596971 11361 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.599141 11362 tablet_bootstrap.cc:492] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.599310 11362 ts_tablet_manager.cc:1397] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.139s user 0.005s sys 0.004s
I20260811 06:17:06.600235 11362 raft_consensus.cc:348] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.600485 11362 raft_consensus.cc:374] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.600551 11362 raft_consensus.cc:729] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.600770 11362 consensus_queue.cc:260] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.602118 11362 ts_tablet_manager.cc:1428] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:06.603324 11362 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.569694 10564 leader_election.cc:302] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.607841 12728 ts_tablet_manager.cc:1918] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.608073 12728 log.cc:1196] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/847df543db4244a6b2900fc16fea7c07
I20260811 06:17:06.608568 12728 ts_tablet_manager.cc:1939] T 847df543db4244a6b2900fc16fea7c07 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.610631 11362 tablet_bootstrap.cc:654] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.611749 12726 ts_tablet_manager.cc:1939] T 2f243c792a634abf83484aef820dbb48 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.612051 11361 tablet_bootstrap.cc:654] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.616441 12727 ts_tablet_manager.cc:1918] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.616573 12727 log.cc:1196] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:06.616891 12727 ts_tablet_manager.cc:1939] T bc3091f8a8f9442da50b17d4752cedb0 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.617614 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 112) took 4329 ms. Trace:
I20260811 06:17:06.617764 13376 raft_consensus.cc:2726] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.617743 12727 rpcz_store.cc:276] 0811 06:17:02.287660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.291072 (+ 3412us) service_pool.cc:227] Handling call
0811 06:17:06.587836 (+4296764us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:06.587847 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.592847 (+ 5000us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.616323 (+ 23476us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.617590 (+ 1267us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4296345}
I20260811 06:17:06.618079 12727 tablet_replica.cc:330] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.618268 12727 raft_consensus.cc:2229] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.618430 12727 raft_consensus.cc:2258] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.618432 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bc3091f8a8f9442da50b17d4752cedb0 (table default.Table_4cb530bc98f0491895f0802931cba06c [id=3d23ed2f14e44d2b92bc0a0caf699a94]) successfully deleted
I20260811 06:17:06.619091 12727 ts_tablet_manager.cc:1905] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.622720 10659 raft_consensus.cc:2454] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:06.623030 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 74) took 4166 ms. Trace:
I20260811 06:17:06.623126 12726 rpcz_store.cc:276] 0811 06:17:02.450983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.451057 (+ 74us) service_pool.cc:227] Handling call
0811 06:17:06.522034 (+4070977us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:17:06.522049 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.548191 (+ 26142us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.551345 (+ 3154us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.617608 (+ 66263us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4070575}
I20260811 06:17:06.623524 12726 tablet_replica.cc:330] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.623734 12726 raft_consensus.cc:2229] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.623956 12726 pending_rounds.cc:62] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Trying to abort 1 pending ops.
I20260811 06:17:06.624004 12726 pending_rounds.cc:68] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213291309764608 op_type: NO_OP noop_request { }
I20260811 06:17:06.624126 12726 raft_consensus.cc:2866] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:06.624210 12726 raft_consensus.cc:2258] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.624869 10651 raft_consensus.cc:1261] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Refusing update from remote peer f8dcf15ece3a4389932aa672079442b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260811 06:17:06.624869 11365 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.625303 11365 ts_tablet_manager.cc:1397] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.136s user 0.010s sys 0.008s
W20260811 06:17:06.625646 10813 consensus_peers.cc:487] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.625751 12726 ts_tablet_manager.cc:1905] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.627389 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2f243c792a634abf83484aef820dbb48 (table default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]) successfully deleted
I20260811 06:17:06.628260 11046 leader_election.cc:302] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.628811 13306 raft_consensus.cc:2781] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.628950 13306 raft_consensus.cc:686] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.628899 13282 consensus_queue.cc:1035] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:06.629179 13306 consensus_queue.cc:237] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.638923 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 103) took 4265 ms. Trace:
I20260811 06:17:06.643400 12726 ts_tablet_manager.cc:1918] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260811 06:17:06.641140 10813 consensus_peers.cc:487] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae1e42440ff14857b297621ca6031835. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.644485 13103 raft_consensus.cc:482] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.644615 12728 rpcz_store.cc:276] 0811 06:17:02.373853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.374143 (+ 290us) service_pool.cc:227] Handling call
0811 06:17:06.577425 (+4203282us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:17:06.577441 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.584877 (+ 7436us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.607709 (+ 22832us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.638890 (+ 31181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4202927}
I20260811 06:17:06.644650 13103 raft_consensus.cc:504] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.645331 13103 leader_election.cc:288] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.645660 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 847df543db4244a6b2900fc16fea7c07 (table default.Table_f87e6f04862c4ce69e2d6650e87e0618 [id=984fbc452ec24ab6ab362a27179e1623]) successfully deleted
I20260811 06:17:06.645870 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.646968 12728 tablet_replica.cc:330] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.647537 12728 raft_consensus.cc:2229] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.647734 12728 raft_consensus.cc:2258] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.649106 12727 ts_tablet_manager.cc:1918] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.649233 12727 log.cc:1196] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:06.649536 12727 ts_tablet_manager.cc:1939] T e873e2f7b3d34988856b3be044de1ed7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.649423 11362 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.649852 11362 ts_tablet_manager.cc:1397] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.004s
I20260811 06:17:06.650151 12728 ts_tablet_manager.cc:1905] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.655447 11362 raft_consensus.cc:348] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.659332 11361 tablet_bootstrap.cc:492] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.658627 11362 raft_consensus.cc:374] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.659449 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:06.644083 11365 raft_consensus.cc:348] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.646660 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a17ccd48c8c460cb7ff59abf7ea19d9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.659691 11361 ts_tablet_manager.cc:1397] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.008s
I20260811 06:17:06.659758 10659 raft_consensus.cc:2379] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:06.659677 11365 raft_consensus.cc:374] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.659868 11365 raft_consensus.cc:729] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:17:06.650389 10564 consensus_peers.cc:487] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fbdda840466420f8d67a8cb5868ba03. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.660362 12726 log.cc:1196] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:06.660847 11361 raft_consensus.cc:348] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.661123 11361 raft_consensus.cc:374] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.660270 10810 leader_election.cc:302] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.661224 11361 raft_consensus.cc:729] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.661605 11361 consensus_queue.cc:260] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.662366 11361 ts_tablet_manager.cc:1428] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:06.662681 11361 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.664330 11361 tablet_bootstrap.cc:654] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.664968 12726 ts_tablet_manager.cc:1939] T a0e5b4cdeb464861ada487eeb1b901a6 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.659729 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:06.666005 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 75) took 4214 ms. Trace:
I20260811 06:17:06.666220 12726 rpcz_store.cc:276] 0811 06:17:02.451209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.451725 (+ 516us) service_pool.cc:227] Handling call
0811 06:17:06.623450 (+4171725us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:17:06.623463 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.636775 (+ 13312us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.643284 (+ 6509us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.665980 (+ 22696us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4170108}
I20260811 06:17:06.666522 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:06.666906 12726 tablet_replica.cc:330] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.667164 12726 raft_consensus.cc:2229] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.667460 12726 raft_consensus.cc:2258] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.667311 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a0e5b4cdeb464861ada487eeb1b901a6 (table default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]) successfully deleted
I20260811 06:17:06.668087 12726 ts_tablet_manager.cc:1905] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.668112 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:06.661769 13103 raft_consensus.cc:3037] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.671304 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 113) took 4383 ms. Trace:
I20260811 06:17:06.671401 12727 rpcz_store.cc:276] 0811 06:17:02.287843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.291536 (+ 3693us) service_pool.cc:227] Handling call
0811 06:17:06.618030 (+4326494us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:17:06.618042 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.645987 (+ 27945us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.648988 (+ 3001us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.671284 (+ 22296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4326150}
I20260811 06:17:06.661301 11362 raft_consensus.cc:729] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.671845 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet e873e2f7b3d34988856b3be044de1ed7 (table default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]) successfully deleted
I20260811 06:17:06.672824 13103 raft_consensus.cc:2726] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.673997 10923 raft_consensus.cc:1261] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 2 FOLLOWER]: Refusing update from remote peer f8dcf15ece3a4389932aa672079442b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260811 06:17:06.674088 10923 pending_rounds.cc:76] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Aborting all ops after (but not including) 0
I20260811 06:17:06.674144 10923 pending_rounds.cc:97] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260811 06:17:06.674250 10923 raft_consensus.cc:2866] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260811 06:17:06.674396 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 114) took 4386 ms. Trace:
I20260811 06:17:06.674481 12727 rpcz_store.cc:276] 0811 06:17:02.288108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.291927 (+ 3819us) service_pool.cc:227] Handling call
0811 06:17:06.674252 (+4382325us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:17:06.674265 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.674375 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4381993}
W20260811 06:17:06.675020 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
I20260811 06:17:06.672832 11362 consensus_queue.cc:260] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.676409 13132 consensus_queue.cc:1035] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:06.677240 12727 tablet_replica.cc:330] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.677446 12727 raft_consensus.cc:2229] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.677606 12727 raft_consensus.cc:2258] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.678198 12727 ts_tablet_manager.cc:1905] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.679795 11362 ts_tablet_manager.cc:1428] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.030s user 0.004s sys 0.001s
I20260811 06:17:06.660519 11365 consensus_queue.cc:260] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.683173 11365 ts_tablet_manager.cc:1428] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.058s user 0.004s sys 0.000s
I20260811 06:17:06.683856 11365 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.688702 11362 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.687906 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:06.694036 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:06.694510 11365 tablet_bootstrap.cc:654] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.694975 11361 tablet_bootstrap.cc:492] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.695103 11361 ts_tablet_manager.cc:1397] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260811 06:17:06.695616 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:06.696064 11361 raft_consensus.cc:348] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.696385 11361 raft_consensus.cc:374] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.696388 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:06.696528 11361 raft_consensus.cc:729] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.696607 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:06.696856 11361 consensus_queue.cc:260] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.697504 11361 ts_tablet_manager.cc:1428] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:06.697921 11361 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.699860 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:06.700103 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:06.700569 11361 tablet_bootstrap.cc:654] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.703482 13132 raft_consensus.cc:482] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.703625 13132 raft_consensus.cc:504] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.704327 13132 leader_election.cc:288] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.705137 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.705236 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d165ac025ce845c6b2b3621caaf01894" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.705473 10651 raft_consensus.cc:2379] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:06.706089 11046 leader_election.cc:302] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.706336 13306 raft_consensus.cc:3037] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.708911 13306 raft_consensus.cc:2726] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.709177 12728 ts_tablet_manager.cc:1918] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.709358 12728 log.cc:1196] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/5119e9bb88844329aea123dc3805d91d
I20260811 06:17:06.709831 12728 ts_tablet_manager.cc:1939] T 5119e9bb88844329aea123dc3805d91d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.710341 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 104) took 4335 ms. Trace:
I20260811 06:17:06.710817 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:06.711289 12728 rpcz_store.cc:276] 0811 06:17:02.374795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.374949 (+ 154us) service_pool.cc:227] Handling call
0811 06:17:06.646905 (+4271956us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:17:06.646923 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.663950 (+ 17027us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.708908 (+ 44958us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.710325 (+ 1417us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4270003}
I20260811 06:17:06.711598 12727 ts_tablet_manager.cc:1918] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.711714 12727 log.cc:1196] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/b0cdc826a1d8460aba1aae684c13131d
I20260811 06:17:06.712033 12727 ts_tablet_manager.cc:1939] T b0cdc826a1d8460aba1aae684c13131d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.711954 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 5119e9bb88844329aea123dc3805d91d (table default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]) successfully deleted
I20260811 06:17:06.712208 12728 tablet_replica.cc:330] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.712409 12728 raft_consensus.cc:2229] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.712603 12728 raft_consensus.cc:2258] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.712823 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 115) took 4424 ms. Trace:
I20260811 06:17:06.712932 12727 rpcz_store.cc:276] 0811 06:17:02.288244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.292294 (+ 4050us) service_pool.cc:227] Handling call
0811 06:17:06.677194 (+4384900us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:17:06.677206 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.692731 (+ 15525us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.711497 (+ 18766us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.712789 (+ 1292us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4384636}
I20260811 06:17:06.713191 12728 ts_tablet_manager.cc:1905] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.713405 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet b0cdc826a1d8460aba1aae684c13131d (table default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]) successfully deleted
I20260811 06:17:06.712884 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:06.714179 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:06.718573 12727 tablet_replica.cc:330] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.718803 12727 raft_consensus.cc:2229] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.718631 11362 tablet_bootstrap.cc:654] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.719053 12727 pending_rounds.cc:62] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:06.719097 12727 pending_rounds.cc:68] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213290455179264 op_type: NO_OP noop_request { }
I20260811 06:17:06.719206 12727 raft_consensus.cc:2866] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:06.719286 12727 raft_consensus.cc:2258] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.720337 13103 consensus_queue.cc:1035] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:06.720522 11361 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.720654 11361 ts_tablet_manager.cc:1397] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260811 06:17:06.721568 11361 raft_consensus.cc:348] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.721894 11361 raft_consensus.cc:374] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.722008 11361 raft_consensus.cc:729] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.722539 11361 consensus_queue.cc:260] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.723388 11361 ts_tablet_manager.cc:1428] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:06.724891 12727 ts_tablet_manager.cc:1905] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.732728 13376 raft_consensus.cc:482] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.732903 13376 raft_consensus.cc:504] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.734179 13376 leader_election.cc:288] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.734848 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.735055 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:06.735725 10564 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:06.736147 10555 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.736246 10555 leader_election.cc:302] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.736747 13376 raft_consensus.cc:2726] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.737381 11365 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.737825 11365 ts_tablet_manager.cc:1397] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.007s
I20260811 06:17:06.738443 12726 ts_tablet_manager.cc:1918] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.739559 12726 log.cc:1196] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:06.740056 12726 ts_tablet_manager.cc:1939] T ecd1a22b6d2b4e9fb29860a4fa3a5045 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.740341 11365 raft_consensus.cc:348] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.741034 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 79) took 4288 ms. Trace:
I20260811 06:17:06.740825 11365 raft_consensus.cc:374] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.741845 11365 raft_consensus.cc:729] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.741763 12726 rpcz_store.cc:276] 0811 06:17:02.452283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.452382 (+ 99us) service_pool.cc:227] Handling call
0811 06:17:06.666852 (+4214470us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:17:06.666864 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.696685 (+ 29821us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.738315 (+ 41630us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.741016 (+ 2701us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4213262}
I20260811 06:17:06.743341 11365 consensus_queue.cc:260] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.743738 12726 tablet_replica.cc:330] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.746048 12726 raft_consensus.cc:2229] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.746511 12726 raft_consensus.cc:2258] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.746680 13132 raft_consensus.cc:482] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.746845 13132 raft_consensus.cc:504] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.747136 12726 ts_tablet_manager.cc:1905] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.747433 13132 leader_election.cc:288] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.748090 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.748370 10659 raft_consensus.cc:2454] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.748865 11046 leader_election.cc:302] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:06.749181 13132 raft_consensus.cc:2781] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.749255 13132 raft_consensus.cc:482] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.749320 13132 raft_consensus.cc:3037] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.749678 11365 ts_tablet_manager.cc:1428] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.012s user 0.000s sys 0.004s
I20260811 06:17:06.749848 13376 raft_consensus.cc:482] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.750955 13376 raft_consensus.cc:504] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.751502 13376 leader_election.cc:288] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.752159 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.746680 12727 ts_tablet_manager.cc:1918] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.752686 12727 log.cc:1196] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a67daf4bdf45464b916905f432f0ec9c
W20260811 06:17:06.753140 10564 leader_election.cc:341] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.753270 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:06.753898 10555 leader_election.cc:341] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.754004 10555 leader_election.cc:302] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.754427 13284 raft_consensus.cc:2726] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.755435 11362 tablet_bootstrap.cc:492] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.755759 11362 ts_tablet_manager.cc:1397] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.006s
I20260811 06:17:06.752159 13132 raft_consensus.cc:504] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.757323 13132 leader_election.cc:288] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:06.757341 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:06.743846 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 (table default.Table_412dd522d392407980cd5633bfba2091 [id=cea155abce97412c971968c57c035287]) successfully deleted
W20260811 06:17:06.757891 11047 leader_election.cc:341] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.759799 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:06.759737 11365 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.758989 11362 raft_consensus.cc:348] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.761507 11362 raft_consensus.cc:374] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.761992 11362 raft_consensus.cc:729] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.762836 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:06.762960 11361 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.763293 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:06.762984 11362 consensus_queue.cc:260] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.763644 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:06.765254 11361 tablet_bootstrap.cc:654] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.766273 11362 ts_tablet_manager.cc:1428] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s
I20260811 06:17:06.766981 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:06.767194 10651 raft_consensus.cc:3037] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.772766 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:06.773967 12727 ts_tablet_manager.cc:1939] T a67daf4bdf45464b916905f432f0ec9c P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.774309 12944 raft_consensus.cc:482] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.774318 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 116) took 4485 ms. Trace:
I20260811 06:17:06.774403 12727 rpcz_store.cc:276] 0811 06:17:02.288446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.292596 (+ 4150us) service_pool.cc:227] Handling call
0811 06:17:06.718517 (+4425921us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:17:06.718527 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.738861 (+ 20334us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.746571 (+ 7710us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.774301 (+ 27730us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4425462}
I20260811 06:17:06.774446 12944 raft_consensus.cc:504] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.774839 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 117) took 4486 ms. Trace:
I20260811 06:17:06.774914 12727 rpcz_store.cc:276] 0811 06:17:02.288571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.293093 (+ 4522us) service_pool.cc:227] Handling call
0811 06:17:06.774673 (+4481580us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:17:06.774684 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.774819 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4481354}
I20260811 06:17:06.775117 12944 leader_election.cc:288] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.775174 12727 tablet_replica.cc:330] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.775349 12727 raft_consensus.cc:2229] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.775638 12727 raft_consensus.cc:2258] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.776254 12727 ts_tablet_manager.cc:1905] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.776288 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a67daf4bdf45464b916905f432f0ec9c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.776559 10662 raft_consensus.cc:2379] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:06.775802 11362 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:06.777387 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45ebef95922f4e7f93533b54c07b7cec" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.777673 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a67daf4bdf45464b916905f432f0ec9c (table default.Table_0ba41638313a4d03b85b8ddac01ce6eb [id=65bf032e717442739e4e712f716e0fb8]) successfully deleted
I20260811 06:17:06.771919 10651 raft_consensus.cc:2454] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:06.778270 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:17:06.778633 11046 leader_election.cc:302] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:06.779006 13306 raft_consensus.cc:2781] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:06.779124 13306 raft_consensus.cc:686] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:06.779343 13306 consensus_queue.cc:237] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:06.779574 11047 leader_election.cc:341] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:06.780036 10813 leader_election.cc:341] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: a67daf4bdf45464b916905f432f0ec9c
I20260811 06:17:06.780139 10813 leader_election.cc:302] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.780602 13241 raft_consensus.cc:3037] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:06.782603 12728 ts_tablet_manager.cc:1918] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.782725 12728 log.cc:1196] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ab32f96671984766a54b5ee904c465f7
I20260811 06:17:06.783079 12728 ts_tablet_manager.cc:1939] T ab32f96671984766a54b5ee904c465f7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.783869 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 105) took 4408 ms. Trace:
I20260811 06:17:06.783968 12728 rpcz_store.cc:276] 0811 06:17:02.376328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.376412 (+ 84us) service_pool.cc:227] Handling call
0811 06:17:06.712153 (+4335741us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:17:06.712167 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.744776 (+ 32609us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.782495 (+ 37719us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.783847 (+ 1352us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4335334}
I20260811 06:17:06.784303 12728 tablet_replica.cc:330] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.784524 12728 raft_consensus.cc:2229] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.784765 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ab32f96671984766a54b5ee904c465f7 (table default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]) successfully deleted
I20260811 06:17:06.784862 12728 raft_consensus.cc:2258] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.785410 12728 ts_tablet_manager.cc:1905] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.789839 13241 raft_consensus.cc:2726] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.791301 11365 tablet_bootstrap.cc:654] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:06.793082 10813 consensus_peers.cc:487] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.801220 12726 ts_tablet_manager.cc:1918] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.801779 11362 tablet_bootstrap.cc:654] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.802219 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:06.802822 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:06.803082 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:06.805750 12726 log.cc:1196] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/59c4e76ecde14d0a86fedc84815e78a7
I20260811 06:17:06.806260 12726 ts_tablet_manager.cc:1939] T 59c4e76ecde14d0a86fedc84815e78a7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.809911 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 78) took 4357 ms. Trace:
I20260811 06:17:06.808666 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:06.810103 12726 rpcz_store.cc:276] 0811 06:17:02.452179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.452342 (+ 163us) service_pool.cc:227] Handling call
0811 06:17:06.743689 (+4291347us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:06.743701 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.787174 (+ 43473us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.801101 (+ 13927us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.809884 (+ 8783us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":207,"tablet-delete.queue_time_us":4289874}
I20260811 06:17:06.810691 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 76) took 4359 ms. Trace:
I20260811 06:17:06.810827 12726 rpcz_store.cc:276] 0811 06:17:02.451382 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.451700 (+ 318us) service_pool.cc:227] Handling call
0811 06:17:06.810551 (+4358851us) ts_tablet_manager.cc:1145] Deleting tablet 0813b34919a14a2481857e9f87b217c8
0811 06:17:06.810566 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.810673 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4356625}
I20260811 06:17:06.810894 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 59c4e76ecde14d0a86fedc84815e78a7 (table default.Table_9fc91bec335145b987dbe074ac9af84c [id=dd42ee7602454afc9b1a9de67c56b4a0]) successfully deleted
I20260811 06:17:06.811844 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:06.811968 12726 tablet_replica.cc:330] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.812177 12726 raft_consensus.cc:2229] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.812919 12726 raft_consensus.cc:2258] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.813544 12726 ts_tablet_manager.cc:1905] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.815693 12727 ts_tablet_manager.cc:1918] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.815835 12727 log.cc:1196] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:17:06.816197 12727 ts_tablet_manager.cc:1939] T f9fd17e8c6264f898493c15b0aa5518d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:06.812064 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:06.816998 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 118) took 4528 ms. Trace:
I20260811 06:17:06.817099 12727 rpcz_store.cc:276] 0811 06:17:02.288932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.293703 (+ 4771us) service_pool.cc:227] Handling call
0811 06:17:06.775132 (+4481429us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:17:06.775142 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.803796 (+ 28654us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.815577 (+ 11781us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.816977 (+ 1400us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4481160}
I20260811 06:17:06.817618 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f9fd17e8c6264f898493c15b0aa5518d (table default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]) successfully deleted
W20260811 06:17:06.822768 10810 consensus_peers.cc:487] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:06.823189 12728 ts_tablet_manager.cc:1918] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.823324 12728 log.cc:1196] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ae1e42440ff14857b297621ca6031835
I20260811 06:17:06.823689 12728 ts_tablet_manager.cc:1939] T ae1e42440ff14857b297621ca6031835 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.824131 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_ec74453aafb6436c825c8333c1f0f468 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 1 got 0
I20260811 06:17:06.824255 11361 tablet_bootstrap.cc:492] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.824414 11361 ts_tablet_manager.cc:1397] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.009s
I20260811 06:17:06.825170 11361 raft_consensus.cc:348] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.825409 11361 raft_consensus.cc:374] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.825508 11361 raft_consensus.cc:729] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.825791 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 106) took 4448 ms. Trace:
I20260811 06:17:06.825781 11361 consensus_queue.cc:260] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.826500 11361 ts_tablet_manager.cc:1428] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:06.826836 11361 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.829566 12726 ts_tablet_manager.cc:1918] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.825903 12728 rpcz_store.cc:276] 0811 06:17:02.377109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.378663 (+ 1554us) service_pool.cc:227] Handling call
0811 06:17:06.784259 (+4405596us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:17:06.784271 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.813813 (+ 29542us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.823085 (+ 9272us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.825769 (+ 2684us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4403600}
I20260811 06:17:06.831303 11361 tablet_bootstrap.cc:654] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.833499 12728 tablet_replica.cc:330] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.833736 12728 raft_consensus.cc:2229] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.833779 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ae1e42440ff14857b297621ca6031835 (table default.Table_8f4b4732c67448209df33512a2495a25 [id=23ec4328fe004a8ab2e8cff534a30e0b]) successfully deleted
I20260811 06:17:06.834034 12728 pending_rounds.cc:62] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:06.834086 12728 pending_rounds.cc:68] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213290037886976 op_type: NO_OP noop_request { }
I20260811 06:17:06.834201 12728 raft_consensus.cc:2866] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:06.834298 12728 raft_consensus.cc:2258] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.835772 12728 ts_tablet_manager.cc:1905] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.836158 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 119) took 4547 ms. Trace:
I20260811 06:17:06.837916 11362 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.838399 12727 rpcz_store.cc:276] 0811 06:17:02.289094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.294012 (+ 4918us) service_pool.cc:227] Handling call
0811 06:17:06.836016 (+4542004us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:17:06.836029 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.836135 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4541783}
I20260811 06:17:06.838886 11362 ts_tablet_manager.cc:1397] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.002s
W20260811 06:17:06.839753 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dab2b8209e5401c84a187882ef21e08 already in progress: creating tablet
I20260811 06:17:06.840292 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 120) took 4551 ms. Trace:
I20260811 06:17:06.840545 12726 log.cc:1196] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/532208d7a02d448e8dac702ffe6c2ffc
I20260811 06:17:06.837355 11365 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.841069 12726 ts_tablet_manager.cc:1939] T 532208d7a02d448e8dac702ffe6c2ffc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.841006 11365 ts_tablet_manager.cc:1397] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.006s
I20260811 06:17:06.841508 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 77) took 4389 ms. Trace:
I20260811 06:17:06.841661 12726 rpcz_store.cc:276] 0811 06:17:02.451574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.451630 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:06.811918 (+4360288us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:17:06.811930 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.821616 (+ 9686us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.829451 (+ 7835us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.841488 (+ 12037us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4356445}
I20260811 06:17:06.842447 12726 tablet_replica.cc:330] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.842615 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 532208d7a02d448e8dac702ffe6c2ffc (table default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]) successfully deleted
I20260811 06:17:06.842756 12726 raft_consensus.cc:2229] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.842954 12726 raft_consensus.cc:2258] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.842939 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:06.843406 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]). Expected version 7 got 6
I20260811 06:17:06.843627 12726 ts_tablet_manager.cc:1905] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.844456 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:06.844237 11365 raft_consensus.cc:348] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.844955 12727 rpcz_store.cc:276] 0811 06:17:02.289272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.294265 (+ 4993us) service_pool.cc:227] Handling call
0811 06:17:06.840163 (+4545898us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:17:06.840174 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.840274 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4545675}
I20260811 06:17:06.844928 11365 raft_consensus.cc:374] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.846138 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 107) took 4559 ms. Trace:
I20260811 06:17:06.845501 11365 raft_consensus.cc:729] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.846262 12727 rpcz_store.cc:276] 0811 06:17:02.286660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.295246 (+ 8586us) service_pool.cc:227] Handling call
0811 06:17:06.845970 (+4550724us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:17:06.845984 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.846076 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4550517}
I20260811 06:17:06.846840 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 121) took 3963 ms. Trace:
I20260811 06:17:06.846918 12727 rpcz_store.cc:276] 0811 06:17:02.883024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.883184 (+ 160us) service_pool.cc:227] Handling call
0811 06:17:06.846720 (+3963536us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:06.846732 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.846824 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3963157}
I20260811 06:17:06.848697 12728 ts_tablet_manager.cc:1918] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.848814 12728 log.cc:1196] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:06.849170 12728 ts_tablet_manager.cc:1939] T e873e2f7b3d34988856b3be044de1ed7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.849970 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 122) took 3414 ms. Trace:
I20260811 06:17:06.850004 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 107) took 4466 ms. Trace:
I20260811 06:17:06.850096 12728 rpcz_store.cc:276] 0811 06:17:02.383842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.409670 (+ 25828us) service_pool.cc:227] Handling call
0811 06:17:06.833446 (+4423776us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:17:06.833458 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.838970 (+ 5512us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.848582 (+ 9612us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.849982 (+ 1400us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4423329}
I20260811 06:17:06.850482 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 108) took 4440 ms. Trace:
I20260811 06:17:06.850054 12727 rpcz_store.cc:276] 0811 06:17:03.435289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.435362 (+ 73us) service_pool.cc:227] Handling call
0811 06:17:06.849839 (+3414477us) ts_tablet_manager.cc:1145] Deleting tablet 1f48707b4fb746f49eaaf91b5b81e814
0811 06:17:06.849851 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.849949 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3414113}
I20260811 06:17:06.850559 12728 rpcz_store.cc:276] 0811 06:17:02.410379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.415780 (+ 5401us) service_pool.cc:227] Handling call
0811 06:17:06.850364 (+4434584us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:17:06.850375 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.850467 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4434183}
I20260811 06:17:06.850793 12728 tablet_replica.cc:330] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.850901 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 127) took 1859 ms. Trace:
I20260811 06:17:06.850987 12728 raft_consensus.cc:2229] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.850979 12727 rpcz_store.cc:276] 0811 06:17:04.991445 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.991847 (+ 402us) service_pool.cc:227] Handling call
0811 06:17:06.850812 (+1858965us) ts_tablet_manager.cc:1145] Deleting tablet 52543aa31a1749d1a0fd5e48cbe30889
0811 06:17:06.850823 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.850886 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1858538}
I20260811 06:17:06.848328 11365 consensus_queue.cc:260] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.852135 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 130) took 1829 ms. Trace:
I20260811 06:17:06.852209 12727 rpcz_store.cc:276] 0811 06:17:05.022741 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.023148 (+ 407us) service_pool.cc:227] Handling call
0811 06:17:06.852026 (+1828878us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:17:06.852037 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.852120 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1828400}
I20260811 06:17:06.853106 12727 tablet_replica.cc:330] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.853291 12727 raft_consensus.cc:2229] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.853569 12727 raft_consensus.cc:2258] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.854285 12727 ts_tablet_manager.cc:1905] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:06.845696 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
W20260811 06:17:06.854813 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 22cac1c339574b1fa26555b18811539b because the tablet was not found. No further retry: Not found: Tablet not found: 22cac1c339574b1fa26555b18811539b
W20260811 06:17:06.855197 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
W20260811 06:17:06.855470 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:06.855857 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 52543aa31a1749d1a0fd5e48cbe30889 because the tablet was not found. No further retry: Not found: Tablet not found: 52543aa31a1749d1a0fd5e48cbe30889
W20260811 06:17:06.856091 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:06.851723 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet e873e2f7b3d34988856b3be044de1ed7 (table default.Table_9db3f79baf3a4a6caba9a984f0fa3866 [id=26cae3ddb94145a9b89d824a018335dc]) successfully deleted
W20260811 06:17:06.856446 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
I20260811 06:17:06.857043 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:06.858078 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:06.858925 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:06.859628 12726 ts_tablet_manager.cc:1918] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.859825 12726 log.cc:1196] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/58fdb5920003438d983987ff242f6dce
I20260811 06:17:06.860052 12728 pending_rounds.cc:62] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:06.860224 11361 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.860424 11361 ts_tablet_manager.cc:1397] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.001s
I20260811 06:17:06.860515 12726 ts_tablet_manager.cc:1939] T 58fdb5920003438d983987ff242f6dce P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.860637 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:06.861410 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 82) took 4404 ms. Trace:
I20260811 06:17:06.861333 11361 raft_consensus.cc:348] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.861544 11361 raft_consensus.cc:374] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.861621 11361 raft_consensus.cc:729] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.861518 12726 rpcz_store.cc:276] 0811 06:17:02.456524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.456669 (+ 145us) service_pool.cc:227] Handling call
0811 06:17:06.842395 (+4385726us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:17:06.842407 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.851359 (+ 8952us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.859528 (+ 8169us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.861384 (+ 1856us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4385377}
I20260811 06:17:06.861950 12728 pending_rounds.cc:68] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213290936803328 op_type: NO_OP noop_request { }
I20260811 06:17:06.861956 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 58fdb5920003438d983987ff242f6dce (table default.Table_22da2514559b4b45ba484d557c75fb21 [id=d86c5c88297b4a659717affa71c9d745]) successfully deleted
I20260811 06:17:06.862113 12728 raft_consensus.cc:2866] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:06.862219 12728 raft_consensus.cc:2258] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.862241 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:06.862360 11361 consensus_queue.cc:260] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.862941 11361 ts_tablet_manager.cc:1428] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:06.862504 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:06.863534 12728 ts_tablet_manager.cc:1905] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.855245 11362 raft_consensus.cc:348] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.864079 11365 ts_tablet_manager.cc:1428] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.023s user 0.002s sys 0.002s
I20260811 06:17:06.864459 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:06.864293 11362 raft_consensus.cc:374] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.865144 11361 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.864853 11362 raft_consensus.cc:729] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.865933 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:06.867120 11365 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.866227 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:06.867334 11362 consensus_queue.cc:260] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.869642 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:06.870705 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:06.870968 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:06.871536 11361 tablet_bootstrap.cc:654] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.871610 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:06.871829 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:06.873279 11362 ts_tablet_manager.cc:1428] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.034s user 0.002s sys 0.002s
I20260811 06:17:06.874670 11362 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:06.876659 11653 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce5f2fa8c64247419f2ca9b26df825b0 consensus state has no leader
I20260811 06:17:06.876929 11653 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 57) took 4687 ms. Trace:
I20260811 06:17:06.877138 11653 rpcz_store.cc:276] 0811 06:17:02.189016 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.106617 (+3917601us) service_pool.cc:227] Handling call
0811 06:17:06.160779 (+ 54162us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:06.161493 (+ 714us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:06.165817 (+ 4324us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:06.171469 (+ 5652us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:06.171565 (+ 96us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:06.231082 (+ 59517us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:06.876846 (+645764us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.213454 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.213574 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.213581 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.213583 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.213697 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.213729 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.213735 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.213811 (+ 76us) tablet.cc:699] Row locks acquired
0811 06:17:06.213814 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.213859 (+ 45us) write_op.cc:270] Start()
0811 06:17:06.213899 (+ 40us) write_op.cc:276] Timestamp: P: 1786429026213796 usec, L: 0
0811 06:17:06.213903 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.214126 (+ 223us) log.cc:842] Serialized 405 byte log entry
0811 06:17:06.228074 (+ 13948us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.229571 (+ 1497us) write_op.cc:301] APPLY: starting
0811 06:17:06.229583 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.229640 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.229701 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.229820 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.229850 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.229856 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:06.230064 (+ 208us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.230302 (+ 238us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.230336 (+ 34us) write_op.cc:454] Released schema lock
0811 06:17:06.230344 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.231166 (+ 822us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.231171 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":123738496,"child_traces":[["op",{"apply.queue_time_us":1443,"apply.run_cpu_time_us":575,"apply.run_wall_time_us":1649,"num_ops":1,"prepare.queue_time_us":38258,"prepare.run_cpu_time_us":822,"prepare.run_wall_time_us":10597,"replication_time_us":14157}]]}
I20260811 06:17:06.881189 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 83) took 4424 ms. Trace:
I20260811 06:17:06.881392 12726 rpcz_store.cc:276] 0811 06:17:02.457165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.457376 (+ 211us) service_pool.cc:227] Handling call
0811 06:17:06.867646 (+4410270us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:17:06.867657 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.881160 (+ 13503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4409934}
I20260811 06:17:06.882681 12726 tablet_replica.cc:330] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:06.882779 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
I20260811 06:17:06.882973 12726 raft_consensus.cc:2229] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:06.883314 12726 raft_consensus.cc:2258] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.883910 12726 ts_tablet_manager.cc:1905] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.884784 11362 tablet_bootstrap.cc:654] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.888564 12727 ts_tablet_manager.cc:1918] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.894790 12728 ts_tablet_manager.cc:1918] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.894939 12728 log.cc:1196] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/b0cdc826a1d8460aba1aae684c13131d
I20260811 06:17:06.895114 12727 log.cc:1196] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:06.895303 12728 ts_tablet_manager.cc:1939] T b0cdc826a1d8460aba1aae684c13131d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.895802 12727 ts_tablet_manager.cc:1939] T d4d44dea35e94ed788b7e1e5a8a24d8e P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:06.896170 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 109) took 4479 ms. Trace:
I20260811 06:17:06.897230 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 131) took 1874 ms. Trace:
I20260811 06:17:06.897600 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965] alter complete (version 1)
W20260811 06:17:06.898065 11663 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eede55349694488b9899ec56a80c8d5b consensus state has no leader
I20260811 06:17:06.898788 11684 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_02fb58052e2d4a0586805d9fa2c0cbc3 [id=7aa63339f43e4b59ab6af32afc629ccd] alter complete (version 4)
I20260811 06:17:06.900583 11365 tablet_bootstrap.cc:654] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.905160 12726 ts_tablet_manager.cc:1918] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.896284 12728 rpcz_store.cc:276] 0811 06:17:02.416473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.417401 (+ 928us) service_pool.cc:227] Handling call
0811 06:17:06.850755 (+4433354us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:17:06.850765 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.887006 (+ 36241us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.894658 (+ 7652us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.896146 (+ 1488us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8793,"tablet-delete.queue_time_us":4423371}
I20260811 06:17:06.905692 12728 tablet_replica.cc:330] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.905987 12728 raft_consensus.cc:2229] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.906035 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet b0cdc826a1d8460aba1aae684c13131d (table default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]) successfully deleted
I20260811 06:17:06.906216 12726 log.cc:1196] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:06.906433 12728 raft_consensus.cc:2258] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.906875 12726 ts_tablet_manager.cc:1939] T 7fbdda840466420f8d67a8cb5868ba03 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.907486 12728 ts_tablet_manager.cc:1905] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.907897 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 84) took 4450 ms. Trace:
I20260811 06:17:06.908789 12726 rpcz_store.cc:276] 0811 06:17:02.457318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.457828 (+ 510us) service_pool.cc:227] Handling call
0811 06:17:06.882626 (+4424798us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:17:06.882640 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.902201 (+ 19561us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.905064 (+ 2863us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.907876 (+ 2812us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4424425}
I20260811 06:17:06.909355 12726 tablet_replica.cc:330] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.909334 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7fbdda840466420f8d67a8cb5868ba03 (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]) successfully deleted
I20260811 06:17:06.909638 12726 raft_consensus.cc:2229] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.912595 12726 raft_consensus.cc:2258] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.898655 11655 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_b5e09f3c2ab94dd8be45a8aaf7697433 [id=8ad2fe8115be403b861c940320695d3b] alter complete (version 1)
I20260811 06:17:06.909889 11683 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_ab403baad4e64a04ae0d8a43983b7a9f [id=ad586796183347dd8029b282665f9a3d] alter complete (version 2)
I20260811 06:17:06.914728 12726 ts_tablet_manager.cc:1905] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.923084 12728 ts_tablet_manager.cc:1918] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.926136 12728 log.cc:1196] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a67daf4bdf45464b916905f432f0ec9c
I20260811 06:17:06.926549 12728 ts_tablet_manager.cc:1939] T a67daf4bdf45464b916905f432f0ec9c P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.927448 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 110) took 4509 ms. Trace:
I20260811 06:17:06.927734 12726 ts_tablet_manager.cc:1918] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.927911 12726 log.cc:1196] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f12c8618198f4413b2727d04f850a10f
I20260811 06:17:06.928398 12726 ts_tablet_manager.cc:1939] T f12c8618198f4413b2727d04f850a10f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.928494 12728 rpcz_store.cc:276] 0811 06:17:02.418121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.423372 (+ 5251us) service_pool.cc:227] Handling call
0811 06:17:06.905636 (+4482264us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:17:06.905650 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.919724 (+ 14074us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.922978 (+ 3254us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.927422 (+ 4444us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4478051}
I20260811 06:17:06.929317 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 111) took 4505 ms. Trace:
I20260811 06:17:06.928834 13376 raft_consensus.cc:482] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.929559 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a67daf4bdf45464b916905f432f0ec9c (table default.Table_0ba41638313a4d03b85b8ddac01ce6eb [id=65bf032e717442739e4e712f716e0fb8]) successfully deleted
I20260811 06:17:06.929522 13376 raft_consensus.cc:504] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.930174 11663 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 58) took 4733 ms. Trace:
I20260811 06:17:06.930258 13376 leader_election.cc:288] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.930377 11663 rpcz_store.cc:276] 0811 06:17:02.197092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.110471 (+3913379us) service_pool.cc:227] Handling call
0811 06:17:06.168518 (+ 58047us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:06.171609 (+ 3091us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:06.174117 (+ 2508us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:06.174313 (+ 196us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:06.174401 (+ 88us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:06.229346 (+ 54945us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:06.930100 (+700754us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.210857 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.211005 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.211012 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.211015 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.211887 (+ 872us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.211907 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.211914 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.212032 (+ 118us) tablet.cc:699] Row locks acquired
0811 06:17:06.212035 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.212089 (+ 54us) write_op.cc:270] Start()
0811 06:17:06.212132 (+ 43us) write_op.cc:276] Timestamp: P: 1786429026212025 usec, L: 0
0811 06:17:06.212136 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.212395 (+ 259us) log.cc:842] Serialized 405 byte log entry
0811 06:17:06.227999 (+ 15604us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.228166 (+ 167us) write_op.cc:301] APPLY: starting
0811 06:17:06.228185 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.228237 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.228458 (+ 221us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.228638 (+ 180us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.228686 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.228694 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:06.228849 (+ 155us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.229205 (+ 356us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.229228 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:06.229237 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.229401 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.229406 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":132537728,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":993,"apply.run_wall_time_us":1345,"num_ops":1,"prepare.queue_time_us":35844,"prepare.run_cpu_time_us":955,"prepare.run_wall_time_us":2551,"replication_time_us":15832}]]}
I20260811 06:17:06.931038 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:06.932554 10555 leader_election.cc:341] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.932874 12728 rpcz_store.cc:276] 0811 06:17:02.424066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.445828 (+ 21762us) service_pool.cc:227] Handling call
0811 06:17:06.929162 (+4483334us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:17:06.929176 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.929298 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4482949}
I20260811 06:17:06.933318 12728 tablet_replica.cc:330] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.933563 12728 raft_consensus.cc:2229] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.933804 12728 raft_consensus.cc:2258] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.934463 12728 ts_tablet_manager.cc:1905] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.940725 11656 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_6746aea0013f4b1abca5aab77881fcee [id=e71c294d8ecb4cb7bba2b41a2153c8bb] alter complete (version 3)
I20260811 06:17:06.941265 12728 ts_tablet_manager.cc:1918] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.941445 12728 log.cc:1196] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:17:06.941915 12728 ts_tablet_manager.cc:1939] T f9fd17e8c6264f898493c15b0aa5518d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:06.942009 11588 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce5f2fa8c64247419f2ca9b26df825b0 consensus state has no leader
W20260811 06:17:06.942317 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:17:06.942864 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 112) took 4496 ms. Trace:
I20260811 06:17:06.942970 12728 rpcz_store.cc:276] 0811 06:17:02.446755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.446827 (+ 72us) service_pool.cc:227] Handling call
0811 06:17:06.933268 (+4486441us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:17:06.933281 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.937642 (+ 4361us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.941063 (+ 3421us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.942842 (+ 1779us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4485843}
I20260811 06:17:06.943161 11365 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:06.943385 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 113) took 4496 ms. Trace:
I20260811 06:17:06.943476 12728 rpcz_store.cc:276] 0811 06:17:02.446998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.448686 (+ 1688us) service_pool.cc:227] Handling call
0811 06:17:06.943258 (+4494572us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:17:06.943271 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.943369 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4494168}
I20260811 06:17:06.943636 11365 ts_tablet_manager.cc:1397] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.005s
I20260811 06:17:06.943746 12728 tablet_replica.cc:330] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:06.943938 12728 raft_consensus.cc:2229] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.944093 12728 raft_consensus.cc:2258] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.944489 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f9fd17e8c6264f898493c15b0aa5518d (table default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]) successfully deleted
I20260811 06:17:06.944617 12728 ts_tablet_manager.cc:1905] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:06.944800 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0dab2b8209e5401c84a187882ef21e08 already in progress: creating tablet
I20260811 06:17:06.950996 12728 ts_tablet_manager.cc:1918] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:06.951123 12728 log.cc:1196] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:06.951985 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 85) took 4493 ms. Trace:
I20260811 06:17:06.952116 12726 rpcz_store.cc:276] 0811 06:17:02.458421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.458475 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:06.909314 (+4450839us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:17:06.909324 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.917975 (+ 8651us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.925996 (+ 8021us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.951912 (+ 25916us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19400,"tablet-delete.queue_time_us":4450494}
I20260811 06:17:06.952507 12726 tablet_replica.cc:330] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:06.952718 12726 raft_consensus.cc:2229] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:06.952912 12726 raft_consensus.cc:2258] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:06.953588 12726 ts_tablet_manager.cc:1905] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.953413 11365 raft_consensus.cc:348] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.954205 11365 raft_consensus.cc:374] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.954587 11365 raft_consensus.cc:729] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.955483 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f12c8618198f4413b2727d04f850a10f (table default.Table_8931139cf95f4c04a45dd28370231a46 [id=c51e928f69584629af4e42531c5dc881]) successfully deleted
I20260811 06:17:06.955156 11365 consensus_queue.cc:260] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.958837 11365 ts_tablet_manager.cc:1428] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.014s user 0.003s sys 0.001s
I20260811 06:17:06.961771 13241 raft_consensus.cc:482] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.961932 13241 raft_consensus.cc:504] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.962594 13241 leader_election.cc:288] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.963008 12726 ts_tablet_manager.cc:1918] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:06.963161 11365 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:06.964931 12726 log.cc:1196] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/dc6254bf781740019c3f71b26179f25d
I20260811 06:17:06.965571 12726 ts_tablet_manager.cc:1939] T dc6254bf781740019c3f71b26179f25d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:06.963920 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.966526 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 86) took 4507 ms. Trace:
I20260811 06:17:06.968420 12726 rpcz_store.cc:276] 0811 06:17:02.459185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.459242 (+ 57us) service_pool.cc:227] Handling call
0811 06:17:06.952413 (+4493171us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:17:06.952426 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.959355 (+ 6929us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.962451 (+ 3096us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.966480 (+ 4029us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4492806}
I20260811 06:17:06.969209 12728 ts_tablet_manager.cc:1939] T 52543aa31a1749d1a0fd5e48cbe30889 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:06.970460 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet dc6254bf781740019c3f71b26179f25d (table default.Table_f2364840e195411d8525c4d0f0f6b7e6 [id=d605d16788de4d1daea5b66d4f138a8c]) successfully deleted
I20260811 06:17:06.970254 11362 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:06.970785 11362 ts_tablet_manager.cc:1397] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.008s
I20260811 06:17:06.971174 13241 raft_consensus.cc:482] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.971315 13241 raft_consensus.cc:504] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.972080 13241 leader_election.cc:288] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:06.972009 11362 raft_consensus.cc:348] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.973579 11362 raft_consensus.cc:374] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.914754 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:06.934639 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.973701 11362 raft_consensus.cc:729] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.963172 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d45055341dab44089b2fc3fe25256073" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:06.974325 10564 leader_election.cc:341] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.974601 10564 leader_election.cc:302] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.975021 13376 raft_consensus.cc:2726] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.973009 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:06.975705 10813 leader_election.cc:302] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:06.976145 10813 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:06.973992 11362 consensus_queue.cc:260] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.976918 12944 raft_consensus.cc:2726] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:06.981842 13306 raft_consensus.cc:482] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.982021 13306 raft_consensus.cc:504] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.982632 13306 leader_election.cc:288] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.982715 11361 tablet_bootstrap.cc:492] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:06.982842 11361 ts_tablet_manager.cc:1397] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.001s
I20260811 06:17:06.983839 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e5b4cdeb464861ada487eeb1b901a6" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.984114 10923 raft_consensus.cc:2379] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:17:06.984059 11361 raft_consensus.cc:348] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.984795 11361 raft_consensus.cc:374] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:06.984872 11361 raft_consensus.cc:729] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:06.985046 11361 consensus_queue.cc:260] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.986001 11361 ts_tablet_manager.cc:1428] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:06.986287 11361 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:06.988240 12727 rpcz_store.cc:276] 0811 06:17:05.023091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.023675 (+ 584us) service_pool.cc:227] Handling call
0811 06:17:06.853051 (+1829376us) ts_tablet_manager.cc:1145] Deleting tablet d4d44dea35e94ed788b7e1e5a8a24d8e
0811 06:17:06.853065 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.857399 (+ 4334us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.888454 (+ 31055us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.897206 (+ 8752us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1828525}
I20260811 06:17:06.988721 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 133) took 1792 ms. Trace:
I20260811 06:17:06.988806 12727 rpcz_store.cc:276] 0811 06:17:05.195970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.196345 (+ 375us) service_pool.cc:227] Handling call
0811 06:17:06.988584 (+1792239us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:17:06.988597 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.988705 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788027}
I20260811 06:17:06.989045 12727 tablet_replica.cc:330] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:06.989380 13306 raft_consensus.cc:482] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.989508 13306 raft_consensus.cc:504] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:06.990119 13306 leader_election.cc:288] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.990962 11365 tablet_bootstrap.cc:654] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.993610 11361 tablet_bootstrap.cc:654] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:06.993729 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet d4d44dea35e94ed788b7e1e5a8a24d8e (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
W20260811 06:17:06.994194 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
W20260811 06:17:06.997025 13074 log.cc:924] Time spent T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Append to log took a long time: real 0.103s user 0.004s sys 0.000s
I20260811 06:17:06.997329 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.997859 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:06.998113 10915 raft_consensus.cc:2454] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.998045 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:06.998346 10659 raft_consensus.cc:2454] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:06.998811 10662 raft_consensus.cc:2454] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:06.999195 10810 leader_election.cc:302] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:06.999579 12944 raft_consensus.cc:2781] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:06.999652 12944 raft_consensus.cc:482] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:06.999718 12944 raft_consensus.cc:3037] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.000588 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 80) took 4544 ms. Trace:
I20260811 06:17:07.000768 12726 rpcz_store.cc:276] 0811 06:17:02.455699 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.460068 (+ 4369us) service_pool.cc:227] Handling call
0811 06:17:06.968966 (+4508898us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:17:06.997185 (+ 28219us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.000503 (+ 3318us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4508480}
W20260811 06:17:07.001391 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:06.994480 13132 raft_consensus.cc:482] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:06.996656 12727 raft_consensus.cc:2229] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.001888 13132 raft_consensus.cc:504] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.002202 12727 raft_consensus.cc:2258] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.002504 13132 leader_election.cc:288] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:07.004197 12726 tablet_replica.cc:330] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.004288 12727 ts_tablet_manager.cc:1905] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.004473 12726 raft_consensus.cc:2229] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.004637 12726 raft_consensus.cc:2258] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.005169 12726 ts_tablet_manager.cc:1905] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:06.996912 12484 consensus_queue.cc:1035] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:07.006769 11046 leader_election.cc:341] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:07.006892 11046 leader_election.cc:302] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:07.007066 11046 raft_consensus.cc:2670] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:17:06.997113 13306 raft_consensus.cc:482] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.007856 13306 raft_consensus.cc:504] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.007963 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.008335 10662 raft_consensus.cc:2379] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:07.008409 13306 leader_election.cc:288] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:06.998615 11047 leader_election.cc:302] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.014657 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.015072 10662 raft_consensus.cc:2454] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.015398 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.015604 10921 raft_consensus.cc:2454] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.015358 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "217f60a1ca044af38f9ee9093e021c27" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.016572 13306 raft_consensus.cc:2781] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.016682 13306 raft_consensus.cc:482] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.016752 13306 raft_consensus.cc:3037] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.019764 13306 raft_consensus.cc:504] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.020453 13306 leader_election.cc:288] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:07.020598 11361 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.020785 11361 ts_tablet_manager.cc:1397] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260811 06:17:07.021112 11046 leader_election.cc:302] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.022032 11361 raft_consensus.cc:348] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.022284 11361 raft_consensus.cc:374] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.022373 11361 raft_consensus.cc:729] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.022614 11361 consensus_queue.cc:260] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.023222 11361 ts_tablet_manager.cc:1428] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:07.023119 12944 raft_consensus.cc:504] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.023532 11361 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.023562 12484 raft_consensus.cc:2781] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.023640 12484 raft_consensus.cc:482] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.023696 12484 raft_consensus.cc:3037] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.026345 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.026726 10662 raft_consensus.cc:3037] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.026619 12484 raft_consensus.cc:504] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.027248 12484 leader_election.cc:288] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:07.028141 12944 leader_election.cc:288] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.029268 12727 ts_tablet_manager.cc:1918] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.029444 10662 raft_consensus.cc:2454] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.031019 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.032907 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.033288 10659 raft_consensus.cc:3037] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.033592 10810 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Illegal state: Tablet not RUNNING: STOPPED
I20260811 06:17:07.037319 10659 raft_consensus.cc:2454] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.040165 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fb02f61b67147f793b3a2f063d8c56c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.040397 10915 raft_consensus.cc:3037] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.041316 12726 ts_tablet_manager.cc:1918] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.041290 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:07.041632 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:07.042349 12726 log.cc:1196] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:07.042815 12726 ts_tablet_manager.cc:1939] T 227bc4fd6cd84e5eb2043c52f95d606d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.043766 10915 raft_consensus.cc:2454] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.044087 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 87) took 4584 ms. Trace:
I20260811 06:17:07.044406 12726 rpcz_store.cc:276] 0811 06:17:02.460022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.460584 (+ 562us) service_pool.cc:227] Handling call
0811 06:17:07.004127 (+4543543us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:17:07.004140 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.014120 (+ 9980us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.041182 (+ 27062us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.044021 (+ 2839us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4543183}
I20260811 06:17:07.045607 12726 tablet_replica.cc:330] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.045975 12726 raft_consensus.cc:2229] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.046350 12726 raft_consensus.cc:2258] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.047188 12726 ts_tablet_manager.cc:1905] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.049088 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a36a644dc4491dad838ce4e19793ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.049368 10915 raft_consensus.cc:3037] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.035468 11047 consensus_peers.cc:487] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:07.035490 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:07.040774 11361 tablet_bootstrap.cc:654] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.050652 11047 leader_election.cc:302] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.051244 12484 raft_consensus.cc:3037] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.044716 11046 leader_election.cc:302] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.051855 13132 raft_consensus.cc:2781] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.051911 11046 leader_election.cc:302] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.051988 13132 raft_consensus.cc:686] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.052243 13132 consensus_queue.cc:237] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.053608 13282 raft_consensus.cc:2781] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.053911 13282 raft_consensus.cc:686] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.054044 12727 log.cc:1196] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:07.054157 13282 consensus_queue.cc:237] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.054351 12727 ts_tablet_manager.cc:1939] T a0e5b4cdeb464861ada487eeb1b901a6 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.054652 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 136) took 1854 ms. Trace:
I20260811 06:17:07.057147 13376 raft_consensus.cc:482] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56a371f7ed104f68a5db9ca097eb237e)
I20260811 06:17:07.057348 13376 raft_consensus.cc:504] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.058281 13376 leader_election.cc:288] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.054728 12727 rpcz_store.cc:276] 0811 06:17:05.200476 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.200654 (+ 178us) service_pool.cc:227] Handling call
0811 06:17:06.989005 (+1788351us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:17:06.989014 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.026243 (+ 37229us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.029163 (+ 2920us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.054636 (+ 25473us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788070}
W20260811 06:17:07.059906 10564 leader_election.cc:341] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 6119212ae4be4204852a5d9437dcee72
I20260811 06:17:07.059973 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 135) took 1863 ms. Trace:
I20260811 06:17:07.060194 12727 rpcz_store.cc:276] 0811 06:17:05.196238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.196400 (+ 162us) service_pool.cc:227] Handling call
0811 06:17:07.059843 (+1863443us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:07.059855 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.059954 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1857462}
W20260811 06:17:07.060315 10813 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.060581 12727 tablet_replica.cc:330] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:07.060688 10813 leader_election.cc:302] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:07.061777 10555 leader_election.cc:341] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 6119212ae4be4204852a5d9437dcee72
I20260811 06:17:07.060915 13446 raft_consensus.cc:482] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.062085 10555 leader_election.cc:302] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.060958 12727 raft_consensus.cc:2229] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:07.062726 13376 raft_consensus.cc:2726] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:07.062810 12727 pending_rounds.cc:62] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:07.062963 12727 pending_rounds.cc:68] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213293690822656 op_type: NO_OP noop_request { }
I20260811 06:17:07.064011 12727 raft_consensus.cc:2866] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:07.065439 12727 raft_consensus.cc:2258] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.062992 13446 raft_consensus.cc:504] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.066581 12727 ts_tablet_manager.cc:1905] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.069150 12944 raft_consensus.cc:2726] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.069762 12726 ts_tablet_manager.cc:1918] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.070955 12726 log.cc:1196] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6dee9af5a4504b8284c9150298ab3462
I20260811 06:17:07.072009 12726 ts_tablet_manager.cc:1939] T 6dee9af5a4504b8284c9150298ab3462 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.072225 13132 raft_consensus.cc:482] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.072369 13132 raft_consensus.cc:504] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.073017 13132 leader_election.cc:288] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.073535 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.074083 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:07.074383 11047 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.074785 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.075014 10662 raft_consensus.cc:2454] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.075960 11046 leader_election.cc:302] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.076413 13132 raft_consensus.cc:2781] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.076538 13132 raft_consensus.cc:482] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.076642 13132 raft_consensus.cc:3037] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.076853 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 88) took 4614 ms. Trace:
I20260811 06:17:07.077360 12726 rpcz_store.cc:276] 0811 06:17:02.461881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.462192 (+ 311us) service_pool.cc:227] Handling call
0811 06:17:07.045419 (+4583227us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:17:07.045432 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.062660 (+ 17228us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.069533 (+ 6873us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.076758 (+ 7225us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4582781}
I20260811 06:17:07.078859 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 89) took 4616 ms. Trace:
I20260811 06:17:07.045233 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 227bc4fd6cd84e5eb2043c52f95d606d (table default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]) successfully deleted
I20260811 06:17:07.079267 12726 rpcz_store.cc:276] 0811 06:17:02.462153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.462736 (+ 583us) service_pool.cc:227] Handling call
0811 06:17:07.078210 (+4615474us) ts_tablet_manager.cc:1145] Deleting tablet 1349b0ea48b848398d4bdda528358c30
0811 06:17:07.078222 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.078334 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4615054}
I20260811 06:17:07.079627 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6dee9af5a4504b8284c9150298ab3462 (table default.Table_ac3235af8d1f42d29a220ec551aa448a [id=3b92a2f628794cb3827f5015816baa11]) successfully deleted
W20260811 06:17:07.079950 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:07.080334 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bd026d2c6064a67b1c432efa4474a0e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.080614 10921 raft_consensus.cc:2379] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 24d29113b2454d9c93e23db3e3dac801 in this term.
I20260811 06:17:07.080628 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 90) took 4617 ms. Trace:
I20260811 06:17:07.079697 13446 leader_election.cc:288] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:07.080803 12726 rpcz_store.cc:276] 0811 06:17:02.463407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.463585 (+ 178us) service_pool.cc:227] Handling call
0811 06:17:07.079992 (+4616407us) ts_tablet_manager.cc:1145] Deleting tablet 2b0ae9a1d3b74c3985637439819b63ef
0811 06:17:07.080003 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.080519 (+ 516us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4616114}
I20260811 06:17:07.061017 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a0e5b4cdeb464861ada487eeb1b901a6 (table default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]) successfully deleted
W20260811 06:17:07.081260 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:07.081705 11047 leader_election.cc:302] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.082015 13306 raft_consensus.cc:3037] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.082260 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:07.082828 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:07.083197 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:07.083448 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:07.083729 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:07.083880 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:07.084072 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:07.084479 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:07.084725 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:07.084872 13306 raft_consensus.cc:2726] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.084968 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:07.085289 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:07.085325 12726 tablet_replica.cc:330] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.085477 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:07.085798 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:07.086238 12726 raft_consensus.cc:2229] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.086498 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:07.086807 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:07.087002 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:07.087373 12726 raft_consensus.cc:2258] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.087348 10915 raft_consensus.cc:2454] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.087919 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:07.088264 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:07.088692 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:07.089186 12726 ts_tablet_manager.cc:1905] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.089010 11653 catalog_manager.cc:5495] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:07.053932 12484 raft_consensus.cc:2726] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.101023 12484 raft_consensus.cc:482] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.101227 12484 raft_consensus.cc:504] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.104717 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.105072 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.105374 10662 raft_consensus.cc:2454] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:07.105377 11047 leader_election.cc:341] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.101037 12727 ts_tablet_manager.cc:1918] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.105993 11046 leader_election.cc:302] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.106782 12727 log.cc:1196] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/45ebef95922f4e7f93533b54c07b7cec
I20260811 06:17:07.106961 12484 leader_election.cc:288] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.107223 12484 raft_consensus.cc:2781] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.107297 12484 raft_consensus.cc:482] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.107363 12484 raft_consensus.cc:3037] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.109110 12726 ts_tablet_manager.cc:1918] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.110261 12726 log.cc:1196] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:17:07.079874 13132 raft_consensus.cc:504] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.111891 12726 ts_tablet_manager.cc:1939] T f2bdb349406a46629e6c307e1ebfd9dc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.112449 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.112341 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4209fc7d2efb415e8794fb33e7f2e5ac" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.112785 10662 raft_consensus.cc:3037] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.113011 11047 leader_election.cc:341] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.113476 12727 ts_tablet_manager.cc:1939] T 45ebef95922f4e7f93533b54c07b7cec P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.113696 11362 ts_tablet_manager.cc:1428] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.143s user 0.000s sys 0.002s
I20260811 06:17:07.114140 11362 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.115760 10662 raft_consensus.cc:2454] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.116236 11046 leader_election.cc:302] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.116602 13446 raft_consensus.cc:2781] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.116747 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 91) took 4653 ms. Trace:
I20260811 06:17:07.116770 13446 raft_consensus.cc:686] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.117046 13446 consensus_queue.cc:237] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.117344 12726 rpcz_store.cc:276] 0811 06:17:02.463548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.463986 (+ 438us) service_pool.cc:227] Handling call
0811 06:17:07.085201 (+4621215us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:17:07.085215 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.097171 (+ 11956us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.108971 (+ 11800us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.116695 (+ 7724us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4620877}
I20260811 06:17:07.118166 12726 tablet_replica.cc:330] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.118183 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f2bdb349406a46629e6c307e1ebfd9dc (table default.Table_4f065771f7724a1fafa66eba960633cb [id=0c9f22e33aaf480fb7553c879333cbcf]) successfully deleted
I20260811 06:17:07.118623 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 138) took 1917 ms. Trace:
I20260811 06:17:07.119330 12727 rpcz_store.cc:276] 0811 06:17:05.201203 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.201422 (+ 219us) service_pool.cc:227] Handling call
0811 06:17:07.060541 (+1859119us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:17:07.060551 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.094489 (+ 33938us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.100930 (+ 6441us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.118603 (+ 17673us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1856597}
I20260811 06:17:07.119685 12726 raft_consensus.cc:2229] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.119890 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 141) took 1917 ms. Trace:
I20260811 06:17:07.120033 12727 rpcz_store.cc:276] 0811 06:17:05.202317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.202558 (+ 241us) service_pool.cc:227] Handling call
0811 06:17:07.119735 (+1917177us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:17:07.119748 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.119871 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913683}
I20260811 06:17:07.120335 12726 raft_consensus.cc:2258] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.120605 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 134) took 1924 ms. Trace:
I20260811 06:17:07.121464 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 114) took 4672 ms. Trace:
I20260811 06:17:07.121577 12728 rpcz_store.cc:276] 0811 06:17:02.449309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.449349 (+ 40us) service_pool.cc:227] Handling call
0811 06:17:06.943704 (+4494355us) ts_tablet_manager.cc:1145] Deleting tablet 52543aa31a1749d1a0fd5e48cbe30889
0811 06:17:06.943713 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:06.947720 (+ 4007us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:06.950895 (+ 3175us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.121437 (+170542us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4493896}
I20260811 06:17:07.121511 12727 rpcz_store.cc:276] 0811 06:17:05.196097 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.196375 (+ 278us) service_pool.cc:227] Handling call
0811 06:17:07.120491 (+1924116us) ts_tablet_manager.cc:1145] Deleting tablet 0813b34919a14a2481857e9f87b217c8
0811 06:17:07.120503 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.120588 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1914201}
I20260811 06:17:07.121984 12726 ts_tablet_manager.cc:1905] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.122004 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 115) took 4653 ms. Trace:
I20260811 06:17:07.122079 12728 rpcz_store.cc:276] 0811 06:17:02.468377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.468654 (+ 277us) service_pool.cc:227] Handling call
0811 06:17:07.121875 (+4653221us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:17:07.121889 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.121986 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4652847}
I20260811 06:17:07.122275 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 52543aa31a1749d1a0fd5e48cbe30889 (table default.Table_081e5e9b7dd24fc5a0723450c844edf2 [id=23e0eb854db141de86f661f7b29c0114]) successfully deleted
I20260811 06:17:07.122392 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 116) took 4649 ms. Trace:
I20260811 06:17:07.122479 12728 rpcz_store.cc:276] 0811 06:17:02.473367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.473468 (+ 101us) service_pool.cc:227] Handling call
0811 06:17:07.122298 (+4648830us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:17:07.122307 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.122378 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4645383}
I20260811 06:17:07.122718 12728 tablet_replica.cc:330] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.122906 12728 raft_consensus.cc:2229] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:17:07.122908 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ad5529d4844f61b0888624e7c8b3ce already in progress: creating tablet
I20260811 06:17:07.123175 12728 raft_consensus.cc:2258] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:07.123493 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
I20260811 06:17:07.123778 12728 ts_tablet_manager.cc:1905] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.123953 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 139) took 1922 ms. Trace:
I20260811 06:17:07.121295 11653 catalog_manager.cc:5495] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:07.124502 12727 rpcz_store.cc:276] 0811 06:17:05.202069 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.202512 (+ 443us) service_pool.cc:227] Handling call
0811 06:17:07.123836 (+1921324us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:17:07.123847 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.123935 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1914714}
I20260811 06:17:07.124850 12727 tablet_replica.cc:330] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:07.125118 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:07.125444 12727 raft_consensus.cc:2229] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 LEADER]: Raft consensus shutting down.
I20260811 06:17:07.126482 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:07.126929 12727 raft_consensus.cc:2258] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.127861 12727 ts_tablet_manager.cc:1905] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.130337 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:07.132682 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:07.126446 13132 leader_election.cc:288] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.133340 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:07.125645 13306 consensus_queue.cc:1035] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.135800 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:07.136335 12944 raft_consensus.cc:482] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8dcf15ece3a4389932aa672079442b6)
I20260811 06:17:07.136503 12944 raft_consensus.cc:504] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.136662 13132 raft_consensus.cc:482] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.136787 13132 raft_consensus.cc:504] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.137176 12944 leader_election.cc:288] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.137987 13132 leader_election.cc:288] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.138065 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
W20260811 06:17:07.138717 11046 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:07.138538 11653 catalog_manager.cc:5495] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
W20260811 06:17:07.139570 10810 leader_election.cc:341] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
I20260811 06:17:07.141213 11362 tablet_bootstrap.cc:654] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.141660 12726 ts_tablet_manager.cc:1918] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.142406 12726 log.cc:1196] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/847df543db4244a6b2900fc16fea7c07
I20260811 06:17:07.143802 12727 ts_tablet_manager.cc:1918] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260811 06:17:07.146438 12726 ts_tablet_manager.cc:1939] T 847df543db4244a6b2900fc16fea7c07 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.147172 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 92) took 4682 ms. Trace:
I20260811 06:17:07.147851 12726 rpcz_store.cc:276] 0811 06:17:02.464619 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.464662 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:07.117946 (+4653284us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:17:07.117958 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.127881 (+ 9923us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.141507 (+ 13626us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.147136 (+ 5629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4652951}
I20260811 06:17:07.148821 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 847df543db4244a6b2900fc16fea7c07 (table default.Table_f87e6f04862c4ce69e2d6650e87e0618 [id=984fbc452ec24ab6ab362a27179e1623]) successfully deleted
I20260811 06:17:07.149031 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 94) took 4683 ms. Trace:
I20260811 06:17:07.149187 12726 rpcz_store.cc:276] 0811 06:17:02.465541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.465768 (+ 227us) service_pool.cc:227] Handling call
0811 06:17:07.148809 (+4683041us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:17:07.148821 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.148967 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4682642}
I20260811 06:17:07.150476 12726 tablet_replica.cc:330] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:07.150442 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
I20260811 06:17:07.151085 12726 raft_consensus.cc:2229] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.151772 12726 raft_consensus.cc:2258] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.152696 12726 ts_tablet_manager.cc:1905] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.154811 12944 raft_consensus.cc:482] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.156291 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 45ebef95922f4e7f93533b54c07b7cec (table default.Table_2dd734f7b4474e44acfdf0e5151b6b21 [id=416217c8551d4037bf36c99fb5572ef7]) successfully deleted
W20260811 06:17:07.156766 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
W20260811 06:17:07.157222 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
W20260811 06:17:07.157549 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:17:07.158320 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:07.158859 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:07.159281 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:07.159572 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:07.160018 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:07.160595 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:07.161092 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:07.162408 12727 log.cc:1196] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:07.161794 11653 catalog_manager.cc:5495] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:07.163393 12727 ts_tablet_manager.cc:1939] T a1981dc26be24ec5afaa3c0bb5c46c8c P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.154958 12944 raft_consensus.cc:504] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.165870 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:07.166304 13306 consensus_queue.cc:1035] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.155078 12484 raft_consensus.cc:504] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.166709 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 140) took 1964 ms. Trace:
I20260811 06:17:07.166837 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:07.167088 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:07.167393 12727 rpcz_store.cc:276] 0811 06:17:05.202197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.202537 (+ 340us) service_pool.cc:227] Handling call
0811 06:17:07.124796 (+1922259us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:17:07.124806 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.140318 (+ 15512us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.143701 (+ 3383us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.166641 (+ 22940us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1915515}
I20260811 06:17:07.168004 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:07.169785 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a1981dc26be24ec5afaa3c0bb5c46c8c (table default.Table_cdfe7577fb6c436cb05499d6ea396a51 [id=328164bbe3754ce7abd0375e1070ee37]) successfully deleted
I20260811 06:17:07.171427 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:07.171909 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:07.171885 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 143) took 1964 ms. Trace:
I20260811 06:17:07.172269 12727 rpcz_store.cc:276] 0811 06:17:05.205947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.206211 (+ 264us) service_pool.cc:227] Handling call
0811 06:17:07.170075 (+1963864us) ts_tablet_manager.cc:1145] Deleting tablet 2b0ae9a1d3b74c3985637439819b63ef
0811 06:17:07.170088 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.170199 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1960708}
W20260811 06:17:07.173254 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
I20260811 06:17:07.173566 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 137) took 1972 ms. Trace:
I20260811 06:17:07.173939 12727 rpcz_store.cc:276] 0811 06:17:05.201048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.201434 (+ 386us) service_pool.cc:227] Handling call
0811 06:17:07.173127 (+1971693us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:17:07.173145 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.173365 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1962794}
I20260811 06:17:07.174757 12727 tablet_replica.cc:330] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:07.174767 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
I20260811 06:17:07.175442 12727 raft_consensus.cc:2229] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.176203 12727 raft_consensus.cc:2258] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.176235 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.176569 10659 raft_consensus.cc:3037] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.179550 10659 raft_consensus.cc:2454] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.180929 11046 leader_election.cc:302] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.180615 12727 ts_tablet_manager.cc:1905] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.190961 12726 ts_tablet_manager.cc:1918] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.191413 12726 log.cc:1196] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/5119e9bb88844329aea123dc3805d91d
I20260811 06:17:07.192045 12726 ts_tablet_manager.cc:1939] T 5119e9bb88844329aea123dc3805d91d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.196942 13306 raft_consensus.cc:2781] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.197151 13306 raft_consensus.cc:686] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.197532 13306 consensus_queue.cc:237] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.176347 12484 leader_election.cc:288] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.208029 11361 tablet_bootstrap.cc:492] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.208361 11361 ts_tablet_manager.cc:1397] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.185s user 0.005s sys 0.037s
I20260811 06:17:07.209517 11361 raft_consensus.cc:348] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.209873 11361 raft_consensus.cc:374] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.210011 11361 raft_consensus.cc:729] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.210326 11361 consensus_queue.cc:260] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.211431 10813 leader_election.cc:341] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
I20260811 06:17:07.212095 11365 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.212764 11365 ts_tablet_manager.cc:1397] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.252s user 0.010s sys 0.038s
I20260811 06:17:07.211572 10813 leader_election.cc:302] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.214452 12944 leader_election.cc:288] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.214601 12944 raft_consensus.cc:2726] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:07.215188 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b282afe70184b0fb68d0e7cdcbcd2b7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.215730 10810 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:07.216549 11365 raft_consensus.cc:348] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.219023 11047 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.219285 11047 leader_election.cc:302] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.219079 11365 raft_consensus.cc:374] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:07.219552 11047 raft_consensus.cc:2670] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:17:07.219470 11365 raft_consensus.cc:729] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.220244 11361 ts_tablet_manager.cc:1428] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.000s sys 0.004s
I20260811 06:17:07.220636 13376 consensus_queue.cc:1035] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.220809 11361 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.221191 13103 raft_consensus.cc:482] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.221957 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:07.222761 11047 leader_election.cc:341] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.222060 11365 consensus_queue.cc:260] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.221413 13103 raft_consensus.cc:504] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.227214 13103 leader_election.cc:288] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.227936 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.228149 10662 raft_consensus.cc:2454] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:07.228607 10810 leader_election.cc:302] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:07.228946 13103 raft_consensus.cc:2781] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.229027 13103 raft_consensus.cc:482] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.229086 13103 raft_consensus.cc:3037] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.230015 10813 leader_election.cc:341] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:07.230123 11365 ts_tablet_manager.cc:1428] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260811 06:17:07.232651 11365 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.230125 10813 leader_election.cc:302] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.236562 12944 raft_consensus.cc:2726] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 06:17:07.237564 11047 consensus_peers.cc:487] T 4d4d5c19d1aa486fa6415907628e6f57 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:07.237660 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:07.238044 11156 raft_consensus.cc:2454] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:07.242799 13103 raft_consensus.cc:504] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.244306 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.244526 10662 raft_consensus.cc:3037] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.246425 11361 tablet_bootstrap.cc:654] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.248298 10662 raft_consensus.cc:2454] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:07.248919 10810 leader_election.cc:302] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:07.249207 12944 raft_consensus.cc:2781] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.249341 12944 raft_consensus.cc:686] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:07.249467 13103 leader_election.cc:288] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.249560 12944 consensus_queue.cc:237] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.250223 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd6584701c23406e83122bd2493b7972" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:07.250509 11156 raft_consensus.cc:3037] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.253736 13450 consensus_queue.cc:1035] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.254490 11156 raft_consensus.cc:2454] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:07.254416 13450 consensus_queue.cc:1035] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.263438 13446 consensus_queue.cc:1035] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.275238 13376 consensus_queue.cc:1035] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.275341 11365 tablet_bootstrap.cc:654] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.286302 13376 raft_consensus.cc:482] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.286520 13376 raft_consensus.cc:504] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.297860 12727 ts_tablet_manager.cc:1918] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.298468 12727 log.cc:1196] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:07.299790 12727 ts_tablet_manager.cc:1939] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.308014 11361 tablet_bootstrap.cc:492] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.309172 11361 ts_tablet_manager.cc:1397] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.004s
I20260811 06:17:07.310550 11362 tablet_bootstrap.cc:492] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.310515 11361 raft_consensus.cc:348] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.311057 11361 raft_consensus.cc:374] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.311199 11361 raft_consensus.cc:729] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.311506 11361 consensus_queue.cc:260] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.311721 11362 ts_tablet_manager.cc:1397] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.197s user 0.000s sys 0.010s
I20260811 06:17:07.312366 11361 ts_tablet_manager.cc:1428] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:07.312758 11361 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.297062 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:07.315629 13376 leader_election.cc:288] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.320379 11365 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.320549 11365 ts_tablet_manager.cc:1397] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.000s
W20260811 06:17:07.322513 10555 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: b0cdc826a1d8460aba1aae684c13131d
I20260811 06:17:07.326848 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 93) took 4861 ms. Trace:
I20260811 06:17:07.327330 11362 raft_consensus.cc:348] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.327703 11362 raft_consensus.cc:374] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.327845 11362 raft_consensus.cc:729] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.328190 11362 consensus_queue.cc:260] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.328811 11362 ts_tablet_manager.cc:1428] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.017s user 0.000s sys 0.001s
I20260811 06:17:07.329181 11362 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.331110 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:07.331533 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:07.332587 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:07.334008 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:07.348361 12728 ts_tablet_manager.cc:1918] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.350154 11362 tablet_bootstrap.cc:654] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.350090 12728 log.cc:1196] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/52953438e7c248b1a758ee219405d7da
I20260811 06:17:07.357362 12728 ts_tablet_manager.cc:1939] T 52953438e7c248b1a758ee219405d7da P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.372870 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 117) took 4887 ms. Trace:
I20260811 06:17:07.375185 12728 rpcz_store.cc:276] 0811 06:17:02.484254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.484307 (+ 53us) service_pool.cc:227] Handling call
0811 06:17:07.122678 (+4638371us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:17:07.122687 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.294898 (+172211us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.345420 (+ 50522us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.371976 (+ 26556us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4637891}
I20260811 06:17:07.379283 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 144) took 2112 ms. Trace:
I20260811 06:17:07.379192 12728 tablet_replica.cc:330] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.381620 12727 rpcz_store.cc:276] 0811 06:17:05.206136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.206662 (+ 526us) service_pool.cc:227] Handling call
0811 06:17:07.174551 (+1967889us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:07.174564 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.223934 (+ 49370us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.297435 (+ 73501us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.318122 (+ 20687us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1964068}
I20260811 06:17:07.381695 12728 raft_consensus.cc:2229] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.383132 11361 tablet_bootstrap.cc:654] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.383550 12728 raft_consensus.cc:2258] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:07.384141 12944 raft_consensus.cc:659] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 06:17:07.386279 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 142) took 2183 ms. Trace:
I20260811 06:17:07.386515 12727 rpcz_store.cc:276] 0811 06:17:05.202436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.202509 (+ 73us) service_pool.cc:227] Handling call
0811 06:17:07.382088 (+2179579us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:17:07.386056 (+ 3968us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.386148 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2170841}
I20260811 06:17:07.386895 12727 tablet_replica.cc:330] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:07.387195 12727 raft_consensus.cc:2229] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:07.387583 12727 raft_consensus.cc:2258] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.388316 12727 ts_tablet_manager.cc:1905] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.388775 12728 ts_tablet_manager.cc:1905] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.399190 10916 raft_consensus.cc:3037] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.399828 12727 ts_tablet_manager.cc:1918] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.400024 12727 log.cc:1196] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:07.401144 12727 ts_tablet_manager.cc:1939] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.401178 13282 raft_consensus.cc:482] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.401897 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 145) took 2189 ms. Trace:
I20260811 06:17:07.402053 13282 raft_consensus.cc:504] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.404913 13282 leader_election.cc:288] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.406965 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "227bc4fd6cd84e5eb2043c52f95d606d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.407437 10921 raft_consensus.cc:2379] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:07.402055 12727 rpcz_store.cc:276] 0811 06:17:05.211892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.211988 (+ 96us) service_pool.cc:227] Handling call
0811 06:17:07.386786 (+2174798us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:17:07.386797 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.393140 (+ 6343us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.399685 (+ 6545us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.401552 (+ 1867us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2172085}
I20260811 06:17:07.408155 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 147) took 2193 ms. Trace:
I20260811 06:17:07.408329 12727 rpcz_store.cc:276] 0811 06:17:05.214501 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.214743 (+ 242us) service_pool.cc:227] Handling call
0811 06:17:07.407930 (+2193187us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:07.407943 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.408021 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2192584}
I20260811 06:17:07.408931 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 146) took 2194 ms. Trace:
I20260811 06:17:07.409114 12727 rpcz_store.cc:276] 0811 06:17:05.214362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.214949 (+ 587us) service_pool.cc:227] Handling call
0811 06:17:07.408701 (+2193752us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:17:07.408712 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.408770 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2191312}
I20260811 06:17:07.409789 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 148) took 2186 ms. Trace:
I20260811 06:17:07.409982 12727 rpcz_store.cc:276] 0811 06:17:05.222977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.223074 (+ 97us) service_pool.cc:227] Handling call
0811 06:17:07.409476 (+2186402us) ts_tablet_manager.cc:1145] Deleting tablet a4a46cec25944310a838d8323b119883
0811 06:17:07.409486 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.409544 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140390}
I20260811 06:17:07.410660 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 149) took 2185 ms. Trace:
I20260811 06:17:07.410907 12727 rpcz_store.cc:276] 0811 06:17:05.225513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.225581 (+ 68us) service_pool.cc:227] Handling call
0811 06:17:07.410347 (+2184766us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:17:07.410357 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.410449 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2139691}
I20260811 06:17:07.415431 12727 tablet_replica.cc:330] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:07.415723 12727 raft_consensus.cc:2229] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.415997 12727 raft_consensus.cc:2258] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.416626 12727 ts_tablet_manager.cc:1905] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.425436 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:07.378074 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 52953438e7c248b1a758ee219405d7da (table default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]) successfully deleted
I20260811 06:17:07.382472 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (table default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]) successfully deleted
W20260811 06:17:07.426165 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 43725.4us
W20260811 06:17:07.426580 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because the tablet was not found. No further retry: Not found: Tablet not found: ecd1a22b6d2b4e9fb29860a4fa3a5045
W20260811 06:17:07.425987 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 47878.4us
I20260811 06:17:07.426926 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (table default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]) successfully deleted
W20260811 06:17:07.427227 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7db813cbb8f74b329015b163ebd58c00 because the tablet was not found. No further retry: Not found: Tablet not found: 7db813cbb8f74b329015b163ebd58c00
W20260811 06:17:07.427518 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because the tablet was not found. No further retry: Not found: Tablet not found: 1c42b5ef0fc84627908200331f53b1a3
W20260811 06:17:07.427809 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a4a46cec25944310a838d8323b119883 because the tablet was not found. No further retry: Not found: Tablet not found: a4a46cec25944310a838d8323b119883
W20260811 06:17:07.428112 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532208d7a02d448e8dac702ffe6c2ffc already in progress: creating tablet
I20260811 06:17:07.335924 11365 raft_consensus.cc:348] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.380191 10564 leader_election.cc:341] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: b0cdc826a1d8460aba1aae684c13131d
I20260811 06:17:07.428607 11365 raft_consensus.cc:374] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.428742 11365 raft_consensus.cc:729] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.428992 11365 consensus_queue.cc:260] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.429593 11365 ts_tablet_manager.cc:1428] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.109s user 0.002s sys 0.000s
I20260811 06:17:07.429955 11365 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.428624 10564 leader_election.cc:302] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:07.430287 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 50163.3us
I20260811 06:17:07.432660 11365 tablet_bootstrap.cc:654] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.433522 11046 leader_election.cc:341] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:07.433331 13282 consensus_queue.cc:1035] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 06:17:07.433771 11046 leader_election.cc:302] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:07.435083 13450 raft_consensus.cc:3037] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.440438 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:07.444329 13450 raft_consensus.cc:2726] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.448467 13446 consensus_queue.cc:1035] T eb437660103845aa98af100aef1c3021 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.456305 13494 raft_consensus.cc:2726] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.428556 12726 rpcz_store.cc:276] 0811 06:17:02.465309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.465577 (+ 268us) service_pool.cc:227] Handling call
0811 06:17:07.150348 (+4684771us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:17:07.150360 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.161448 (+ 11088us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.190714 (+ 29266us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.326829 (+136115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4683819}
I20260811 06:17:07.459527 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 5119e9bb88844329aea123dc3805d91d (table default.Table_bb432c883f1b4eae996f883c77495069 [id=ad26ff1a167c4e93b900a6f11656ee36]) successfully deleted
I20260811 06:17:07.459612 12726 tablet_replica.cc:330] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.459889 12726 raft_consensus.cc:2229] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.460112 12726 raft_consensus.cc:2258] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.460660 12726 ts_tablet_manager.cc:1905] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.464200 13495 raft_consensus.cc:482] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.464370 13495 raft_consensus.cc:504] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.465481 13495 leader_election.cc:288] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.466090 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:07.466910 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.467058 10564 leader_election.cc:341] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:07.467555 10555 leader_election.cc:341] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.467658 10555 leader_election.cc:302] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.471498 12728 ts_tablet_manager.cc:1918] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.471803 12728 log.cc:1196] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/45ebef95922f4e7f93533b54c07b7cec
I20260811 06:17:07.472327 12728 ts_tablet_manager.cc:1939] T 45ebef95922f4e7f93533b54c07b7cec P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.472306 13495 raft_consensus.cc:2726] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.472748 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 118) took 4867 ms. Trace:
I20260811 06:17:07.472878 12728 rpcz_store.cc:276] 0811 06:17:02.604996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.605082 (+ 86us) service_pool.cc:227] Handling call
0811 06:17:07.378420 (+4773338us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:17:07.378436 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.453040 (+ 74604us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.471358 (+ 18318us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.472684 (+ 1326us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4748624}
I20260811 06:17:07.473369 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 119) took 4861 ms. Trace:
I20260811 06:17:07.473479 12728 rpcz_store.cc:276] 0811 06:17:02.611726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.612031 (+ 305us) service_pool.cc:227] Handling call
0811 06:17:07.473173 (+4861142us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:17:07.473183 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.473298 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4842093}
I20260811 06:17:07.473529 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 45ebef95922f4e7f93533b54c07b7cec (table default.Table_2dd734f7b4474e44acfdf0e5151b6b21 [id=416217c8551d4037bf36c99fb5572ef7]) successfully deleted
I20260811 06:17:07.425974 11663 catalog_manager.cc:5495] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
W20260811 06:17:07.475385 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
I20260811 06:17:07.475693 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
W20260811 06:17:07.478864 13074 log.cc:924] Time spent T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Append to log took a long time: real 0.055s user 0.002s sys 0.000s
I20260811 06:17:07.483042 11362 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.483222 11362 ts_tablet_manager.cc:1397] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.154s user 0.002s sys 0.017s
I20260811 06:17:07.483596 11365 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.484077 11365 ts_tablet_manager.cc:1397] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.007s
I20260811 06:17:07.484305 11362 raft_consensus.cc:348] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.484664 11362 raft_consensus.cc:374] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.485128 11362 raft_consensus.cc:729] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.485566 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:07.485584 11362 consensus_queue.cc:260] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.486611 11362 ts_tablet_manager.cc:1428] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:07.487015 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:07.487600 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:07.487898 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:07.489900 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:07.489481 11365 raft_consensus.cc:348] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.490587 11365 raft_consensus.cc:374] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.490733 11365 raft_consensus.cc:729] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.491163 11365 consensus_queue.cc:260] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.492666 11365 ts_tablet_manager.cc:1428] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 06:17:07.493304 11365 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.494081 11362 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.496816 11362 tablet_bootstrap.cc:654] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.499785 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:07.501400 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:07.501458 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 120) took 4512 ms. Trace:
I20260811 06:17:07.501601 12728 rpcz_store.cc:276] 0811 06:17:02.989353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.989410 (+ 57us) service_pool.cc:227] Handling call
0811 06:17:07.473706 (+4484296us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:07.501179 (+ 27473us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.501305 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4480005}
I20260811 06:17:07.502200 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 121) took 4069 ms. Trace:
I20260811 06:17:07.502334 12728 rpcz_store.cc:276] 0811 06:17:03.433082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.433150 (+ 68us) service_pool.cc:227] Handling call
0811 06:17:07.501967 (+4068817us) ts_tablet_manager.cc:1145] Deleting tablet 1f48707b4fb746f49eaaf91b5b81e814
0811 06:17:07.501978 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.502061 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4068564}
W20260811 06:17:07.502350 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
I20260811 06:17:07.502775 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 131) took 2507 ms. Trace:
I20260811 06:17:07.502930 12728 rpcz_store.cc:276] 0811 06:17:04.995658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.995709 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:07.502591 (+2506882us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:17:07.502602 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.502676 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506498}
W20260811 06:17:07.503070 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:07.503321 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:07.503369 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 133) took 2507 ms. Trace:
I20260811 06:17:07.503530 12728 rpcz_store.cc:276] 0811 06:17:04.996012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.996247 (+ 235us) service_pool.cc:227] Handling call
0811 06:17:07.503151 (+2506904us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:17:07.503161 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.503260 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506602}
I20260811 06:17:07.503887 12728 tablet_replica.cc:330] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
W20260811 06:17:07.503998 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:17:07.504146 12728 raft_consensus.cc:2229] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.504465 12728 raft_consensus.cc:2258] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.505147 12728 ts_tablet_manager.cc:1905] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.504479 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:07.505774 11365 tablet_bootstrap.cc:654] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.506269 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:07.510198 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:07.511932 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:07.516263 12727 ts_tablet_manager.cc:1918] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.516538 12727 log.cc:1196] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2f243c792a634abf83484aef820dbb48
I20260811 06:17:07.517089 12727 ts_tablet_manager.cc:1939] T 2f243c792a634abf83484aef820dbb48 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:07.522891 12726 ts_tablet_manager.cc:1918] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.523455 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:07.523944 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:07.528395 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:07.528864 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:07.533625 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:07.533881 11362 tablet_bootstrap.cc:492] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.534017 12726 log.cc:1196] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6119212ae4be4204852a5d9437dcee72
I20260811 06:17:07.534221 11362 ts_tablet_manager.cc:1397] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260811 06:17:07.535418 11362 raft_consensus.cc:348] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.536185 12726 ts_tablet_manager.cc:1939] T 6119212ae4be4204852a5d9437dcee72 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.537776 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 81) took 5081 ms. Trace:
I20260811 06:17:07.538177 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:07.538601 11361 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.538714 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:07.538913 12726 rpcz_store.cc:276] 0811 06:17:02.455976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.456023 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:07.459563 (+5003540us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:17:07.459576 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.506733 (+ 47157us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.522772 (+ 16039us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.537681 (+ 14909us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4970415}
I20260811 06:17:07.539681 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:07.540382 11361 ts_tablet_manager.cc:1397] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.228s user 0.000s sys 0.012s
I20260811 06:17:07.540515 12726 tablet_replica.cc:330] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.540793 12726 raft_consensus.cc:2229] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.540252 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6119212ae4be4204852a5d9437dcee72 (table default.Table_88b42a43d2824f1387ba1ab9fae64f4b [id=7cfbea4772a5409697019c193aa74fc2]) successfully deleted
I20260811 06:17:07.541523 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:07.542166 11361 raft_consensus.cc:348] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.542641 11362 raft_consensus.cc:374] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.542834 11362 raft_consensus.cc:729] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.543291 11362 consensus_queue.cc:260] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.544286 11362 ts_tablet_manager.cc:1428] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260811 06:17:07.544997 11362 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.545138 11361 raft_consensus.cc:374] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.545308 11361 raft_consensus.cc:729] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.545902 11361 consensus_queue.cc:260] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.548170 11362 tablet_bootstrap.cc:654] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.549896 12726 raft_consensus.cc:2258] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.550500 11361 ts_tablet_manager.cc:1428] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260811 06:17:07.552386 12944 consensus_queue.cc:1035] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.552863 12728 ts_tablet_manager.cc:1918] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.553128 12728 log.cc:1196] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:07.553655 12728 ts_tablet_manager.cc:1939] T a0e5b4cdeb464861ada487eeb1b901a6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.554078 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 138) took 2557 ms. Trace:
I20260811 06:17:07.554286 12728 rpcz_store.cc:276] 0811 06:17:04.997778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.997828 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:07.503766 (+2505938us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:17:07.503776 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.520630 (+ 16854us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.540849 (+ 20219us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.554038 (+ 13189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2505600}
I20260811 06:17:07.554812 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 137) took 2557 ms. Trace:
I20260811 06:17:07.554943 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a0e5b4cdeb464861ada487eeb1b901a6 (table default.Table_ace7c736f5c144488e5dead2e48b82cb [id=a9ec35161c75450ea4ab508f99821bde]) successfully deleted
I20260811 06:17:07.555001 12728 rpcz_store.cc:276] 0811 06:17:04.996851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.997019 (+ 168us) service_pool.cc:227] Handling call
0811 06:17:07.554603 (+2557584us) ts_tablet_manager.cc:1145] Deleting tablet 0813b34919a14a2481857e9f87b217c8
0811 06:17:07.554615 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.554716 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554271}
I20260811 06:17:07.555202 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:07.555503 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 130) took 2559 ms. Trace:
I20260811 06:17:07.555724 12726 ts_tablet_manager.cc:1905] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.555693 12728 rpcz_store.cc:276] 0811 06:17:04.995460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.997062 (+ 1602us) service_pool.cc:227] Handling call
0811 06:17:07.555258 (+2558196us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:07.555269 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.555354 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554682}
I20260811 06:17:07.556171 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 128) took 2564 ms. Trace:
W20260811 06:17:07.555647 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:07.556351 12728 rpcz_store.cc:276] 0811 06:17:04.992121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.992249 (+ 128us) service_pool.cc:227] Handling call
0811 06:17:07.555986 (+2563737us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:17:07.556014 (+ 28us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.556107 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554793}
W20260811 06:17:07.556639 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:07.556775 12728 tablet_replica.cc:330] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.557082 12728 raft_consensus.cc:2229] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:17:07.557181 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:07.557548 12728 raft_consensus.cc:2258] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.562851 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:07.562970 11361 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.567031 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:07.567900 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:07.568789 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:07.570708 11361 tablet_bootstrap.cc:654] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.571135 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:07.572031 12728 ts_tablet_manager.cc:1905] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.573693 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
W20260811 06:17:07.571053 11047 consensus_peers.cc:487] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:07.575487 12944 consensus_queue.cc:1035] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.583710 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:07.583994 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:07.584724 11365 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.585011 11365 ts_tablet_manager.cc:1397] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.023s
I20260811 06:17:07.587165 11365 raft_consensus.cc:348] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.587702 11365 raft_consensus.cc:374] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.587847 11365 raft_consensus.cc:729] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.588510 13495 raft_consensus.cc:482] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.588557 11362 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.588622 13495 raft_consensus.cc:504] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.588758 11362 ts_tablet_manager.cc:1397] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.000s
I20260811 06:17:07.589236 13495 leader_election.cc:288] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.589809 11362 raft_consensus.cc:348] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.590091 11362 raft_consensus.cc:374] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.590283 11362 raft_consensus.cc:729] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.590255 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61114d1bcdb94af7b6c55b0331accee5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.590605 10916 raft_consensus.cc:2454] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:07.590546 11362 consensus_queue.cc:260] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.591435 10555 leader_election.cc:302] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:07.592270 13495 raft_consensus.cc:2781] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.592353 13495 raft_consensus.cc:482] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.592418 13495 raft_consensus.cc:3037] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.593114 11362 ts_tablet_manager.cc:1428] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:17:07.593458 11362 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.595942 13495 raft_consensus.cc:504] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.596473 11362 tablet_bootstrap.cc:654] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.599529 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61114d1bcdb94af7b6c55b0331accee5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:07.601131 10564 leader_election.cc:341] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.601562 12728 ts_tablet_manager.cc:1918] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.601603 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:07.601892 12728 log.cc:1196] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:07.602388 12728 ts_tablet_manager.cc:1939] T d4d44dea35e94ed788b7e1e5a8a24d8e P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.602828 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 132) took 2606 ms. Trace:
I20260811 06:17:07.602993 12728 rpcz_store.cc:276] 0811 06:17:04.995857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.996137 (+ 280us) service_pool.cc:227] Handling call
0811 06:17:07.556679 (+2560542us) ts_tablet_manager.cc:1145] Deleting tablet d4d44dea35e94ed788b7e1e5a8a24d8e
0811 06:17:07.556690 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.598006 (+ 41316us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.601441 (+ 3435us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.602731 (+ 1290us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550410}
I20260811 06:17:07.603540 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 139) took 2605 ms. Trace:
I20260811 06:17:07.603667 12728 rpcz_store.cc:276] 0811 06:17:04.997940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.998268 (+ 328us) service_pool.cc:227] Handling call
0811 06:17:07.603333 (+2605065us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:07.603344 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.603449 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589099}
I20260811 06:17:07.604206 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61114d1bcdb94af7b6c55b0331accee5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.603585 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet d4d44dea35e94ed788b7e1e5a8a24d8e (table default.Table_61a9560977f5458a85388ed6ddeb069b [id=bfa0349641894d2a9d2ac610a4e18e6b]) successfully deleted
I20260811 06:17:07.605849 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61114d1bcdb94af7b6c55b0331accee5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:07.606293 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
I20260811 06:17:07.606755 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
W20260811 06:17:07.607223 10564 leader_election.cc:341] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.607402 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:07.605383 13495 leader_election.cc:288] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.588377 11365 consensus_queue.cc:260] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.617924 12728 tablet_replica.cc:330] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.617964 10916 raft_consensus.cc:3037] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.618238 12728 raft_consensus.cc:2229] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.618371 12726 ts_tablet_manager.cc:1918] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.618536 12726 log.cc:1196] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/3250276181a24e58a2db92376b7520e7
I20260811 06:17:07.618852 12726 ts_tablet_manager.cc:1939] T 3250276181a24e58a2db92376b7520e7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:07.618098 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:07.620249 12728 raft_consensus.cc:2258] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.620239 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:07.620672 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:07.621172 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:07.621457 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 95) took 5131 ms. Trace:
I20260811 06:17:07.621791 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_21d24fd15819465b9ffd735474698380 [id=9ff629224da14068a65b686d658a40e9] alter complete (version 2)
I20260811 06:17:07.622498 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_3564f87a2e944d778e6e043901d156b5 [id=825f1af5eebb40d383efc7bb576b1538] alter complete (version 1)
I20260811 06:17:07.627279 10916 raft_consensus.cc:2454] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:07.628234 10555 leader_election.cc:302] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.628996 13495 raft_consensus.cc:2781] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.629534 13495 raft_consensus.cc:686] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:07.630206 13495 consensus_queue.cc:237] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.633556 11365 ts_tablet_manager.cc:1428] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.048s user 0.001s sys 0.003s
I20260811 06:17:07.635535 11365 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.637185 11361 tablet_bootstrap.cc:492] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.637406 11361 ts_tablet_manager.cc:1397] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.003s
I20260811 06:17:07.638732 11361 raft_consensus.cc:348] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.641220 11361 raft_consensus.cc:374] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.645195 11361 raft_consensus.cc:729] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.645812 11362 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.645978 11362 ts_tablet_manager.cc:1397] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.009s
I20260811 06:17:07.645650 11361 consensus_queue.cc:260] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.648557 11362 raft_consensus.cc:348] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.648787 11362 raft_consensus.cc:374] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.648850 11362 raft_consensus.cc:729] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.649072 11361 ts_tablet_manager.cc:1428] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260811 06:17:07.649080 11362 consensus_queue.cc:260] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.649580 11361 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.649626 11362 ts_tablet_manager.cc:1428] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260811 06:17:07.654955 11361 tablet_bootstrap.cc:654] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.655573 11365 tablet_bootstrap.cc:654] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.672911 11362 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.674696 11362 tablet_bootstrap.cc:654] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.676682 11365 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.677016 11365 ts_tablet_manager.cc:1397] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.002s
I20260811 06:17:07.682121 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.681548 11365 raft_consensus.cc:348] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.682919 11365 raft_consensus.cc:374] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.683158 11365 raft_consensus.cc:729] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.683799 11365 consensus_queue.cc:260] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.684590 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.685290 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.689234 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.689380 12728 ts_tablet_manager.cc:1905] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.690567 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.694346 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.694396 11365 ts_tablet_manager.cc:1428] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.001s sys 0.003s
I20260811 06:17:07.695251 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.695418 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.695633 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.694716 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.694991 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.695959 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c4e76ecde14d0a86fedc84815e78a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.695770 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.699195 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.699687 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.699894 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.700102 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.700335 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.700525 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.700840 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.701154 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.701478 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.701799 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 52543aa31a1749d1a0fd5e48cbe30889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.701925 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.702227 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.707249 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.708853 11365 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.713953 11361 tablet_bootstrap.cc:492] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.714205 11361 ts_tablet_manager.cc:1397] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.008s
I20260811 06:17:07.715605 11361 raft_consensus.cc:348] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.715977 11361 raft_consensus.cc:374] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.716089 11361 raft_consensus.cc:729] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.716503 11362 tablet_bootstrap.cc:492] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.716409 11361 consensus_queue.cc:260] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.716656 11362 ts_tablet_manager.cc:1397] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.005s
I20260811 06:17:07.717381 11362 raft_consensus.cc:348] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.717598 11362 raft_consensus.cc:374] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.717654 11362 raft_consensus.cc:729] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.717864 11362 consensus_queue.cc:260] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.719468 11365 tablet_bootstrap.cc:654] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.720311 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.720666 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.720902 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.721167 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.721474 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.721752 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.721949 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.722206 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.723120 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.723429 11362 ts_tablet_manager.cc:1428] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:17:07.723443 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.723745 11362 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.723757 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.724222 13495 raft_consensus.cc:482] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.724363 13495 raft_consensus.cc:504] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.725015 13495 leader_election.cc:288] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.726109 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:07.726545 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:07.729625 11362 tablet_bootstrap.cc:654] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.729933 10564 leader_election.cc:341] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.731024 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.731279 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet b39dfcd1a66b4241bc6f5c38e930f048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.731484 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 681736b44af04718b800d503ca645c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.732297 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.732594 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 97b348d30dc44fa383a27d9097c2e598 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.732610 13495 raft_consensus.cc:482] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.732823 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.732772 13495 raft_consensus.cc:504] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.733014 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.733404 13495 leader_election.cc:288] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.734720 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.736081 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.736270 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.737035 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.737290 12728 ts_tablet_manager.cc:1918] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:07.737409 12728 log.cc:1196] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:07.737464 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:07.737880 12728 ts_tablet_manager.cc:1939] T 2cae52ba275f4d2fbd7014a1c6c01dc0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:07.738380 10564 leader_election.cc:341] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:07.738638 10555 leader_election.cc:341] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.738758 10555 leader_election.cc:302] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.738750 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 144) took 2722 ms. Trace:
I20260811 06:17:07.738845 12728 rpcz_store.cc:276] 0811 06:17:05.016516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.016562 (+ 46us) service_pool.cc:227] Handling call
0811 06:17:07.603907 (+2587345us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:17:07.603917 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.702317 (+ 98400us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.737157 (+ 34840us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.738730 (+ 1573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2587147}
I20260811 06:17:07.739230 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 148) took 2721 ms. Trace:
W20260811 06:17:07.739161 10555 leader_election.cc:341] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.739305 12728 rpcz_store.cc:276] 0811 06:17:05.017661 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.017706 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:07.739137 (+2721431us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:07.739149 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.739215 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2721116}
I20260811 06:17:07.739399 10555 leader_election.cc:302] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.739609 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 129) took 2744 ms. Trace:
I20260811 06:17:07.739656 13494 raft_consensus.cc:2726] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.739675 12728 rpcz_store.cc:276] 0811 06:17:04.995238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.997005 (+ 1767us) service_pool.cc:227] Handling call
0811 06:17:07.739507 (+2742502us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:07.739518 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.739594 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2719180}
I20260811 06:17:07.739748 13495 raft_consensus.cc:2726] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.739952 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 136) took 2743 ms. Trace:
I20260811 06:17:07.740034 12728 rpcz_store.cc:276] 0811 06:17:04.996665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.996740 (+ 75us) service_pool.cc:227] Handling call
0811 06:17:07.739860 (+2743120us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:17:07.739870 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.739937 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718709}
I20260811 06:17:07.740264 12728 tablet_replica.cc:330] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.740450 12728 raft_consensus.cc:2229] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.740636 12728 raft_consensus.cc:2258] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.741250 12728 ts_tablet_manager.cc:1905] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.741442 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.742205 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.742713 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.743018 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c706bf0455341a0a953d937f9778b5f with delete_type TABLET_DATA_DELETED (replaced by tablet a25b6d0d733c44398a233b595caad8a0) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.743296 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.743583 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.744371 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 37e73b8798b2455baf642abc532a5d8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.744597 11361 ts_tablet_manager.cc:1428] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260811 06:17:07.744784 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 3250276181a24e58a2db92376b7520e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.745126 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c62cbef937a46dfbc4dbf934e887139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:07.725687 11672 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2fcf7c7a470144c0a084aebc2032d896 consensus state has no leader
I20260811 06:17:07.748409 11361 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.752010 12484 consensus_queue.cc:1035] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.753600 11365 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.753926 11365 ts_tablet_manager.cc:1397] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.007s
I20260811 06:17:07.756768 11365 raft_consensus.cc:348] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.757299 11365 raft_consensus.cc:374] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.757503 11365 raft_consensus.cc:729] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.758095 11365 consensus_queue.cc:260] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.759938 11653 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352] alter complete (version 7)
I20260811 06:17:07.760334 11365 ts_tablet_manager.cc:1428] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:17:07.761148 11365 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.763144 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.764106 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.764796 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.765224 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.765708 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.766155 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.766601 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.766938 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.767261 11365 tablet_bootstrap.cc:654] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.767349 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.768457 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.768878 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.769258 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.769629 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a46cec25944310a838d8323b119883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.770293 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.770588 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.770977 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 7db813cbb8f74b329015b163ebd58c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.771343 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c42b5ef0fc84627908200331f53b1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.740990 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 (table default.Table_c2c7668245a4461ea61b06122149f946 [id=5801e398a043426995e961e4cf189bf1]) successfully deleted
I20260811 06:17:07.771693 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.772110 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet adc2d99019384c33840f16cbe98d336c with delete_type TABLET_DATA_DELETED (replaced by tablet 217f60a1ca044af38f9ee9093e021c27) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:07.772574 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7db813cbb8f74b329015b163ebd58c00 because the tablet was not found. No further retry: Not found: Tablet not found: 7db813cbb8f74b329015b163ebd58c00
W20260811 06:17:07.772940 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:07.773361 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because the tablet was not found. No further retry: Not found: Tablet not found: ecd1a22b6d2b4e9fb29860a4fa3a5045
I20260811 06:17:07.774895 11361 tablet_bootstrap.cc:654] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.727993 11683 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b23c8754701444db93ceb1131a98b1dc consensus state has no leader
I20260811 06:17:07.778836 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.779363 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.782388 11365 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.782678 11365 ts_tablet_manager.cc:1397] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.003s
I20260811 06:17:07.773700 12728 ts_tablet_manager.cc:1918] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260811 06:17:07.784426 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.784554 12728 log.cc:1196] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:07.781582 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.781950 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.782871 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.783420 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cac1c339574b1fa26555b18811539b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.784953 12728 ts_tablet_manager.cc:1939] T a1981dc26be24ec5afaa3c0bb5c46c8c P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.783587 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.783849 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.784233 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.783197 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.781762 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.782176 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.781213 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.785317 11365 raft_consensus.cc:348] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.785763 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 134) took 2789 ms. Trace:
I20260811 06:17:07.785890 11365 raft_consensus.cc:374] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.785844 12728 rpcz_store.cc:276] 0811 06:17:04.996264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.996875 (+ 611us) service_pool.cc:227] Handling call
0811 06:17:07.740221 (+2743346us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:17:07.740230 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.757382 (+ 17152us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.773566 (+ 16184us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.785744 (+ 12178us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718282}
I20260811 06:17:07.786036 11365 raft_consensus.cc:729] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.781416 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet b0d203f652b24b4897e62fc8c03d32df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.786237 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 135) took 2789 ms. Trace:
I20260811 06:17:07.786317 12728 rpcz_store.cc:276] 0811 06:17:04.996471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.996636 (+ 165us) service_pool.cc:227] Handling call
0811 06:17:07.786103 (+2789467us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:17:07.786114 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.786220 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760622}
I20260811 06:17:07.786587 12728 tablet_replica.cc:330] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.786770 12728 raft_consensus.cc:2229] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.786916 12728 raft_consensus.cc:2258] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.786522 11365 consensus_queue.cc:260] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.790707 11365 ts_tablet_manager.cc:1428] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 06:17:07.791507 11365 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.795348 12728 ts_tablet_manager.cc:1905] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.798617 13282 raft_consensus.cc:482] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.798830 13282 raft_consensus.cc:504] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.799417 13282 leader_election.cc:288] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.800341 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.800575 10916 raft_consensus.cc:2454] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.800951 13446 raft_consensus.cc:482] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.801081 13446 raft_consensus.cc:504] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.801615 13446 leader_election.cc:288] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.802146 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.802451 10651 raft_consensus.cc:2454] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.802525 11365 tablet_bootstrap.cc:654] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.803092 11047 leader_election.cc:302] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.803102 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.803349 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.803558 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.803614 13446 raft_consensus.cc:2781] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.803689 13446 raft_consensus.cc:482] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.803615 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.803745 13446 raft_consensus.cc:3037] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.803879 10916 raft_consensus.cc:2454] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.804345 11046 leader_election.cc:302] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.804914 13282 raft_consensus.cc:2781] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.804986 13282 raft_consensus.cc:482] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.805045 13282 raft_consensus.cc:3037] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.807924 13446 raft_consensus.cc:504] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.808807 12728 ts_tablet_manager.cc:1918] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:07.808939 12728 log.cc:1196] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:07.809234 12728 ts_tablet_manager.cc:1939] T 52ecffcf4a0e46428caed6f7d72199bd P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:07.809439 13282 raft_consensus.cc:504] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.811672 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.811909 10651 raft_consensus.cc:3037] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.814947 10651 raft_consensus.cc:2454] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.815587 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.815830 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816021 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 6dee9af5a4504b8284c9150298ab3462 with delete_type TABLET_DATA_DELETED (replaced by tablet c2527862e75b42aa9091456b0f5f994e) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816111 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816181 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816331 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816378 11046 leader_election.cc:302] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.816469 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.816653 12484 raft_consensus.cc:2781] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.816766 12484 raft_consensus.cc:686] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.817005 12484 consensus_queue.cc:237] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.819123 11365 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.819403 11365 ts_tablet_manager.cc:1397] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.004s
I20260811 06:17:07.621601 12726 rpcz_store.cc:276] 0811 06:17:02.490212 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.490275 (+ 63us) service_pool.cc:227] Handling call
0811 06:17:07.540455 (+5050180us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:17:07.540470 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.590057 (+ 49587us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.618236 (+ 28179us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.621437 (+ 3201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5038190}
I20260811 06:17:07.821295 13282 leader_election.cc:288] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.821270 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 3250276181a24e58a2db92376b7520e7 (table default.Table_ed0d878c78764cc6870d654cf10c1e80 [id=1bcb15d29a434ca79c7cd26b0187e8c7]) successfully deleted
I20260811 06:17:07.821108 11365 raft_consensus.cc:348] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.821606 11365 raft_consensus.cc:374] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.821692 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 98) took 5317 ms. Trace:
I20260811 06:17:07.821753 11365 raft_consensus.cc:729] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.821806 12726 rpcz_store.cc:276] 0811 06:17:02.504158 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.504205 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:07.821553 (+5317348us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:17:07.821564 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.821673 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5275043}
W20260811 06:17:07.822356 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:17:07.822603 12726 tablet_replica.cc:330] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:07.822242 11365 consensus_queue.cc:260] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.822926 12726 raft_consensus.cc:2229] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:07.823714 11365 ts_tablet_manager.cc:1428] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260811 06:17:07.824278 11365 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.822616 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.824769 10654 raft_consensus.cc:2454] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.825765 10916 raft_consensus.cc:3037] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.829203 11365 tablet_bootstrap.cc:654] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.832695 11684 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 88) took 3495 ms (client timeout 1000 ms). Trace:
I20260811 06:17:07.833592 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ca903ee846a4e5baf3dbb4302607c1f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.833693 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 141) took 2825 ms. Trace:
I20260811 06:17:07.833851 10921 raft_consensus.cc:3037] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.835268 11365 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.835608 11365 ts_tablet_manager.cc:1397] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20260811 06:17:07.836846 10921 raft_consensus.cc:2454] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.837572 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.837860 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:07.837478 11365 raft_consensus.cc:348] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.838126 11365 raft_consensus.cc:374] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.838267 11365 raft_consensus.cc:729] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.838755 11365 consensus_queue.cc:260] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.840263 11365 ts_tablet_manager.cc:1428] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:17:07.840885 11365 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.841750 13306 consensus_queue.cc:1035] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.845043 11365 tablet_bootstrap.cc:654] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.847602 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:07.851809 13446 leader_election.cc:288] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.857825 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.860504 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.860843 10654 raft_consensus.cc:3037] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.864104 10654 raft_consensus.cc:2454] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.865209 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 516021603ee24b3f9bdffd1e30e5ea9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.865825 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a00b0b51f574bfb843b65c0876ab4fc with delete_type TABLET_DATA_DELETED (replaced by tablet dd6584701c23406e83122bd2493b7972) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.865906 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 006d3214480c47babe390496b335de70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.866394 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet fe5eea681072477ab52a822d721629cf with delete_type TABLET_DATA_DELETED (replaced by tablet d4d44dea35e94ed788b7e1e5a8a24d8e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.866556 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6254bf781740019c3f71b26179f25d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.866593 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet f12c8618198f4413b2727d04f850a10f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.867017 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.867079 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 6119212ae4be4204852a5d9437dcee72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.867635 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.867867 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 58fdb5920003438d983987ff242f6dce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.868081 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet f2bdb349406a46629e6c307e1ebfd9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.868271 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fbdda840466420f8d67a8cb5868ba03 with delete_type TABLET_DATA_DELETED (replaced by tablet 0874f0e73267446fb873f4619f93307e) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.868441 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.869340 11361 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.869477 11361 ts_tablet_manager.cc:1397] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.121s user 0.005s sys 0.000s
I20260811 06:17:07.870370 13446 raft_consensus.cc:482] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.870534 13446 raft_consensus.cc:504] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.871886 13446 leader_election.cc:288] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.872015 11361 raft_consensus.cc:348] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.872149 13074 log.cc:924] Time spent T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Append to log took a long time: real 0.254s user 0.000s sys 0.003s
I20260811 06:17:07.865478 11365 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:07.871701 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.877024 10651 raft_consensus.cc:2454] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.882690 11362 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.882840 11362 ts_tablet_manager.cc:1397] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.159s user 0.016s sys 0.021s
I20260811 06:17:07.883562 11362 raft_consensus.cc:348] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.883783 11362 raft_consensus.cc:374] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.883837 11362 raft_consensus.cc:729] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.884053 11362 consensus_queue.cc:260] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.884611 11362 ts_tablet_manager.cc:1428] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:07.884883 11362 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:07.876502 13529 log.cc:924] Time spent T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260811 06:17:07.875540 12726 raft_consensus.cc:2258] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.877154 11365 ts_tablet_manager.cc:1397] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.011s
I20260811 06:17:07.886307 11362 tablet_bootstrap.cc:654] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.886283 12726 ts_tablet_manager.cc:1905] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:07.877439 11046 leader_election.cc:302] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.886823 11365 raft_consensus.cc:348] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.887027 11365 raft_consensus.cc:374] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.887076 11365 raft_consensus.cc:729] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.887089 11046 leader_election.cc:302] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.887264 11365 consensus_queue.cc:260] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.877490 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet f88af70bbada49309a0e7cc7c333d6f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.877930 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 16674be53bd54f9395b650e19edd3cf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.878052 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 2875318863584e659e2b76ad2a72ca45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.878145 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.878229 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.878281 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.887804 11365 ts_tablet_manager.cc:1428] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:07.878592 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.878690 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.879041 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.879200 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.879344 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.879521 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:07.888064 11365 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:07.888324 13446 raft_consensus.cc:2781] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.888505 13306 raft_consensus.cc:2781] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.888600 13306 raft_consensus.cc:482] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.888659 13306 raft_consensus.cc:3037] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.833060 11684 rpcz_store.cc:269] 0811 06:17:04.336866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.861391 (+524525us) service_pool.cc:227] Handling call
0811 06:17:07.832515 (+2971124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.059062 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.059215 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.059224 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:06.059226 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.059409 (+ 183us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.059426 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.059451 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.059531 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:06.059534 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.059579 (+ 45us) write_op.cc:270] Start()
0811 06:17:06.059617 (+ 38us) write_op.cc:276] Timestamp: P: 1786429026059531 usec, L: 0
0811 06:17:06.059621 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.059825 (+ 204us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.068505 (+ 8680us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.068799 (+ 294us) write_op.cc:301] APPLY: starting
0811 06:17:06.068816 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.068860 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.068888 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.068975 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.069013 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.069019 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:06.069116 (+ 97us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.069185 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.069204 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:06.069211 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.069279 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.069283 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.162358 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.162563 (+ 205us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.162570 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.162573 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.162693 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.162705 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.162710 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.162782 (+ 72us) tablet.cc:699] Row locks acquired
0811 06:17:06.162785 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.162826 (+ 41us) write_op.cc:270] Start()
0811 06:17:06.162869 (+ 43us) write_op.cc:276] Timestamp: P: 1786429026162770 usec, L: 0
0811 06:17:06.162873 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.163052 (+ 179us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.171469 (+ 8417us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.172241 (+ 772us) write_op.cc:301] APPLY: starting
0811 06:17:06.172253 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.172283 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.173237 (+ 954us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.173297 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.173330 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.173337 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:06.173417 (+ 80us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.173479 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.173494 (+ 15us) write_op.cc:454] Released schema lock
0811 06:17:06.173500 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.173555 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.173559 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144231,"reported_tablets":221,"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":539,"num_ops":1,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":877,"prepare.run_wall_time_us":877,"raft.queue_time_us":1700,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":345,"replication_time_us":8855}],["op",{"apply.queue_time_us":739,"apply.run_cpu_time_us":508,"apply.run_wall_time_us":1365,"mutex_wait_us":1772,"num_ops":1,"prepare.queue_time_us":48977,"prepare.run_cpu_time_us":787,"prepare.run_wall_time_us":786,"raft.queue_time_us":1801,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":8581}]]}
I20260811 06:17:07.890527 11365 tablet_bootstrap.cc:654] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.891040 11684 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 91) took 1046 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.891242 11684 rpcz_store.cc:269] 0811 06:17:06.844881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.890954 (+1046073us) service_pool.cc:214] Skipping call since client already timed out
0811 06:17:07.891001 (+ 47us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260811 06:17:07.891265 13306 raft_consensus.cc:504] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.891867 13306 leader_election.cc:288] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.892519 13446 raft_consensus.cc:686] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:07.892779 13446 consensus_queue.cc:237] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.892933 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:07.893121 10651 raft_consensus.cc:3037] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.895818 10651 raft_consensus.cc:2454] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.896054 11361 raft_consensus.cc:374] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.896126 11361 raft_consensus.cc:729] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.896274 11046 leader_election.cc:302] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.896302 11361 consensus_queue.cc:260] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.896593 13306 raft_consensus.cc:2781] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:07.896692 13306 raft_consensus.cc:686] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
W20260811 06:17:07.835315 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 89) took 2343 ms (client timeout 1000 ms). Trace:
I20260811 06:17:07.896986 13306 consensus_queue.cc:237] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.897066 11679 rpcz_store.cc:269] 0811 06:17:05.491474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.056068 (+564594us) service_pool.cc:227] Handling call
0811 06:17:06.169050 (+112982us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:07.835240 (+1666190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":152201,"reported_tablets":216,"spinlock_wait_cycles":138929536}
I20260811 06:17:07.900533 13495 raft_consensus.cc:482] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:07.842981 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 87) took 4579 ms (client timeout 1000 ms). Trace:
I20260811 06:17:07.900683 13495 raft_consensus.cc:504] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:07.900704 11672 rpcz_store.cc:269] 0811 06:17:03.263847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.436018 (+172171us) service_pool.cc:227] Handling call
0811 06:17:07.842936 (+4406918us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":384721,"reported_tablets":227}
I20260811 06:17:07.901319 13495 leader_election.cc:288] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.902208 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.857860 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 71117.9us
I20260811 06:17:07.902635 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:07.903366 10555 leader_election.cc:341] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:07.903604 10564 leader_election.cc:341] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.903703 10564 leader_election.cc:302] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.903755 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a1981dc26be24ec5afaa3c0bb5c46c8c (table default.Table_cdfe7577fb6c436cb05499d6ea396a51 [id=328164bbe3754ce7abd0375e1070ee37]) successfully deleted
W20260811 06:17:07.904023 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:07.904114 13495 raft_consensus.cc:2726] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.907351 11362 tablet_bootstrap.cc:492] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.907532 11362 ts_tablet_manager.cc:1397] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260811 06:17:07.908263 11362 raft_consensus.cc:348] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.908514 11362 raft_consensus.cc:374] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.908581 11362 raft_consensus.cc:729] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.908794 11362 consensus_queue.cc:260] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.909153 13495 raft_consensus.cc:482] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.909358 11362 ts_tablet_manager.cc:1428] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:07.909302 13495 raft_consensus.cc:504] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.909657 11362 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:07.909946 13495 leader_election.cc:288] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.910668 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.911240 10555 leader_election.cc:341] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.911302 11362 tablet_bootstrap.cc:654] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.911933 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:07.912518 10564 leader_election.cc:341] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.912617 10564 leader_election.cc:302] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.912949 13495 raft_consensus.cc:2726] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.918572 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.918946 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.919353 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 847df543db4244a6b2900fc16fea7c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.919656 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 5119e9bb88844329aea123dc3805d91d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.919974 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1e42440ff14857b297621ca6031835 with delete_type TABLET_DATA_DELETED (replaced by tablet 5465d7f48e1f42689626749ba0350c7d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.920372 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.920686 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet e873e2f7b3d34988856b3be044de1ed7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.921007 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.921382 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.922631 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.923038 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.923339 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.923688 11361 ts_tablet_manager.cc:1428] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260811 06:17:07.923749 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.924126 11361 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:07.924091 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3091f8a8f9442da50b17d4752cedb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:07.927826 11362 tablet_bootstrap.cc:492] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:07.927989 11362 ts_tablet_manager.cc:1397] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
W20260811 06:17:07.865803 11683 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 90) took 2097 ms (client timeout 1000 ms). Trace:
I20260811 06:17:07.928817 11362 raft_consensus.cc:348] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.929039 11362 raft_consensus.cc:374] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:07.929088 11362 raft_consensus.cc:729] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:07.929280 11362 consensus_queue.cc:260] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.929868 11362 ts_tablet_manager.cc:1428] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:07.930150 11362 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:07.929183 11683 rpcz_store.cc:269] 0811 06:17:05.768790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.091192 (+322402us) service_pool.cc:227] Handling call
0811 06:17:06.162465 (+ 71273us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:07.865746 (+1703281us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.450738 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.450862 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.450868 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:06.450871 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.450998 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.451014 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.451019 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:06.451204 (+ 185us) tablet.cc:699] Row locks acquired
0811 06:17:06.451207 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.451253 (+ 46us) write_op.cc:270] Start()
0811 06:17:06.451291 (+ 38us) write_op.cc:276] Timestamp: P: 1786429026451219 usec, L: 0
0811 06:17:06.451294 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.451533 (+ 239us) log.cc:842] Serialized 907 byte log entry
0811 06:17:06.456098 (+ 4565us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.456231 (+ 133us) write_op.cc:301] APPLY: starting
0811 06:17:06.456247 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.456304 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.456372 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.456510 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.456547 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:06.456553 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:06.456670 (+ 117us) log.cc:842] Serialized 29 byte log entry
0811 06:17:06.456750 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.456771 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:06.456778 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.456856 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.456860 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.481292 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.481494 (+ 202us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.481501 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.481503 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.481605 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.481618 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.481623 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.481685 (+ 62us) tablet.cc:699] Row locks acquired
0811 06:17:06.481688 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.481753 (+ 65us) write_op.cc:270] Start()
0811 06:17:06.481789 (+ 36us) write_op.cc:276] Timestamp: P: 1786429026481716 usec, L: 0
0811 06:17:06.481793 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.481997 (+ 204us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.485889 (+ 3892us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.486554 (+ 665us) write_op.cc:301] APPLY: starting
0811 06:17:06.486573 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.486642 (+ 69us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.486710 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.486785 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.486824 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.486831 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:06.486917 (+ 86us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.486985 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.487005 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:06.487012 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.487075 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.487079 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89145,"reported_tablets":221,"spinlock_wait_cycles":133292800,"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":682,"apply.run_wall_time_us":681,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":914,"prepare.run_wall_time_us":915,"raft.queue_time_us":426,"raft.run_cpu_time_us":607,"raft.run_wall_time_us":608,"replication_time_us":4776}],["op",{"apply.queue_time_us":593,"apply.run_cpu_time_us":586,"apply.run_wall_time_us":586,"num_ops":1,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":820,"prepare.run_wall_time_us":821,"raft.queue_time_us":71,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":382,"replication_time_us":4069}]]}
I20260811 06:17:07.931082 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_99b250b50327413e93d821e917b05f4c" } modify_external_catalogs: true
I20260811 06:17:07.931413 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_99b250b50327413e93d821e917b05f4c" } modify_external_catalogs: true
I20260811 06:17:07.932152 11362 tablet_bootstrap.cc:654] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:07.941234 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0dab2b8209e5401c84a187882ef21e08" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.941682 10916 raft_consensus.cc:3037] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.941700 13494 raft_consensus.cc:482] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.941972 13494 raft_consensus.cc:504] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.942602 13494 leader_election.cc:288] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.943097 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:07.943652 10564 leader_election.cc:341] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.943495 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.944325 10555 leader_election.cc:341] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.944440 10555 leader_election.cc:302] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.944836 13494 raft_consensus.cc:2726] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:07.944960 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:07.945137 10923 raft_consensus.cc:2454] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.833823 12728 rpcz_store.cc:276] 0811 06:17:05.007904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.008118 (+ 214us) service_pool.cc:227] Handling call
0811 06:17:07.786542 (+2778424us) ts_tablet_manager.cc:1145] Deleting tablet 52ecffcf4a0e46428caed6f7d72199bd
0811 06:17:07.786552 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.805310 (+ 18758us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.808691 (+ 3381us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.833666 (+ 24975us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760857}
I20260811 06:17:07.950448 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 142) took 2938 ms. Trace:
I20260811 06:17:07.950632 12728 rpcz_store.cc:276] 0811 06:17:05.012423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.012477 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:07.950206 (+2937729us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:07.950294 (+ 88us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.950424 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924142}
I20260811 06:17:07.951066 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 145) took 2934 ms. Trace:
I20260811 06:17:07.951206 12728 rpcz_store.cc:276] 0811 06:17:05.016956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.016998 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:07.950979 (+2933981us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:17:07.950990 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.951048 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924278}
I20260811 06:17:07.951568 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 146) took 2934 ms. Trace:
I20260811 06:17:07.952064 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 52ecffcf4a0e46428caed6f7d72199bd (table default.Table_ae798943d2514f6488c7ae50b11ef679 [id=6265dc35475144bd9f4b3348ed37447a]) successfully deleted
I20260811 06:17:07.952255 12728 rpcz_store.cc:276] 0811 06:17:05.017155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.017197 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:07.951490 (+2934293us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:07.951500 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.951553 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924390}
W20260811 06:17:07.952459 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:07.952708 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 147) took 2935 ms. Trace:
I20260811 06:17:07.952841 12728 rpcz_store.cc:276] 0811 06:17:05.017350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.017456 (+ 106us) service_pool.cc:227] Handling call
0811 06:17:07.952627 (+2935171us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:07.952638 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.952693 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924769}
W20260811 06:17:07.952953 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because the tablet was not found. No further retry: Not found: Tablet not found: 1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:07.953228 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 152) took 2909 ms. Trace:
I20260811 06:17:07.953351 12728 rpcz_store.cc:276] 0811 06:17:05.043867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.055397 (+ 11530us) service_pool.cc:227] Handling call
0811 06:17:07.953154 (+2897757us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:07.953164 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.953214 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2897524}
I20260811 06:17:07.953697 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 155) took 2897 ms. Trace:
I20260811 06:17:07.953859 12728 rpcz_store.cc:276] 0811 06:17:05.056730 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.056773 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:07.953618 (+2896845us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:17:07.953628 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.953681 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2896536}
I20260811 06:17:07.954177 12728 tablet_replica.cc:330] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:07.954437 12728 raft_consensus.cc:2229] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:07.958187 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d668bcfbeff54181ba3b4407b1eb5704 because the tablet was not found. No further retry: Not found: Tablet not found: d668bcfbeff54181ba3b4407b1eb5704
W20260811 06:17:07.958593 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 59c4e76ecde14d0a86fedc84815e78a7 because the tablet was not found. No further retry: Not found: Tablet not found: 59c4e76ecde14d0a86fedc84815e78a7
W20260811 06:17:07.958797 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 285b85c854bf400295b288314947840e because the tablet was not found. No further retry: Not found: Tablet not found: 285b85c854bf400295b288314947840e
W20260811 06:17:07.959014 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0bbf657cb27f4da9a4f595242864163a because the tablet was not found. No further retry: Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a
W20260811 06:17:07.961014 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2fcf7c7a470144c0a084aebc2032d896 consensus state has no leader
I20260811 06:17:07.961476 11361 tablet_bootstrap.cc:654] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:07.962587 11653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 84) took 1532 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.962703 11653 rpcz_store.cc:269] 0811 06:17:06.430275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.877872 (+447597us) service_pool.cc:227] Handling call
0811 06:17:07.190547 (+312675us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.190552 (+ 5us) write_op.cc:454] Released schema lock
0811 06:17:07.962531 (+771979us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:07.181850 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:07.181965 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:07.181972 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:07.181974 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:07.182184 (+ 210us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:07.182199 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:07.182204 (+ 5us) tablet.cc:683] Acquiring locks for 4 operations
0811 06:17:07.182353 (+ 149us) tablet.cc:699] Row locks acquired
0811 06:17:07.182356 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:07.182406 (+ 50us) write_op.cc:270] Start()
0811 06:17:07.182442 (+ 36us) write_op.cc:276] Timestamp: P: 1786429027182303 usec, L: 0
0811 06:17:07.182446 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:07.182679 (+ 233us) log.cc:842] Serialized 1662 byte log entry
0811 06:17:07.186402 (+ 3723us) op_driver.cc:444] REPLICATION: finished
0811 06:17:07.186533 (+ 131us) write_op.cc:301] APPLY: starting
0811 06:17:07.186550 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:07.186725 (+ 175us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:07.186769 (+ 44us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:07.186875 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:07.186916 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0811 06:17:07.186923 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:07.187069 (+ 146us) log.cc:842] Serialized 41 byte log entry
0811 06:17:07.187136 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.187159 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:07.187166 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0811 06:17:07.660694 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:07.660854 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:07.660862 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:07.660864 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:07.660981 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:07.660998 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:07.661003 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:07.661076 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:07.661078 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:07.661122 (+ 44us) write_op.cc:270] Start()
0811 06:17:07.661159 (+ 37us) write_op.cc:276] Timestamp: P: 1786429027661068 usec, L: 0
0811 06:17:07.661164 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:07.661365 (+ 201us) log.cc:842] Serialized 356 byte log entry
0811 06:17:07.668281 (+ 6916us) op_driver.cc:444] REPLICATION: finished
0811 06:17:07.668405 (+ 124us) write_op.cc:301] APPLY: starting
0811 06:17:07.668423 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:07.668466 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:07.668630 (+ 164us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:07.668695 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:07.668732 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:07.668739 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:07.668829 (+ 90us) log.cc:842] Serialized 23 byte log entry
0811 06:17:07.668899 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.668920 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:07.668927 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:07.668984 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.668988 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25122,"reported_tablets":210,"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":695,"apply.run_wall_time_us":695,"num_ops":4,"prepare.queue_time_us":1849,"prepare.run_cpu_time_us":961,"prepare.run_wall_time_us":962,"raft.queue_time_us":529,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":244,"replication_time_us":3932}],["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":634,"apply.run_wall_time_us":634,"num_ops":1,"prepare.queue_time_us":426,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":801,"raft.queue_time_us":326,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":273,"replication_time_us":7090}]]}
I20260811 06:17:07.964072 13494 raft_consensus.cc:482] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.964211 13494 raft_consensus.cc:504] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.965109 13494 leader_election.cc:288] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.965641 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:07.966308 10564 leader_election.cc:341] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:07.870303 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 82) took 3787 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.971988 11655 rpcz_store.cc:269] 0811 06:17:04.082775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.846969 (+764194us) service_pool.cc:227] Handling call
0811 06:17:05.411095 (+564126us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.411102 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:07.870242 (+2459140us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:05.403078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:05.403223 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:05.403230 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:05.403233 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:05.403345 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:05.403359 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:05.403364 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:05.403462 (+ 98us) tablet.cc:699] Row locks acquired
0811 06:17:05.403465 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:05.403502 (+ 37us) write_op.cc:270] Start()
0811 06:17:05.403537 (+ 35us) write_op.cc:276] Timestamp: P: 1786429025403467 usec, L: 0
0811 06:17:05.403541 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:05.403718 (+ 177us) log.cc:842] Serialized 530 byte log entry
0811 06:17:05.408005 (+ 4287us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.408138 (+ 133us) write_op.cc:301] APPLY: starting
0811 06:17:05.408156 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.408198 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.408268 (+ 70us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.408331 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.408370 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:05.408377 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:05.408473 (+ 96us) log.cc:842] Serialized 23 byte log entry
0811 06:17:05.408542 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.408565 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:05.408572 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0811 06:17:06.114583 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.114716 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.114723 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.114726 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.114848 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.114863 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.114869 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.114955 (+ 86us) tablet.cc:699] Row locks acquired
0811 06:17:06.114958 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.115000 (+ 42us) write_op.cc:270] Start()
0811 06:17:06.115042 (+ 42us) write_op.cc:276] Timestamp: P: 1786429026114948 usec, L: 0
0811 06:17:06.115046 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.162051 (+ 47005us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.162246 (+ 195us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:06.171393 (+ 9147us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.171682 (+ 289us) write_op.cc:301] APPLY: starting
0811 06:17:06.171702 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.171751 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.171752 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.171829 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.171865 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.171871 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:06.171968 (+ 97us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.172044 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.172064 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:06.172070 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.172143 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.172147 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163771,"reported_tablets":224,"child_traces":[["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":498,"apply.run_wall_time_us":497,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":747,"prepare.run_wall_time_us":747,"raft.queue_time_us":505,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":307,"replication_time_us":4438}],["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":519,"num_ops":1,"prepare.queue_time_us":1640,"prepare.run_cpu_time_us":1605,"prepare.run_wall_time_us":47743,"raft.queue_time_us":2280,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":298,"replication_time_us":56318,"spinlock_wait_cycles":107375488}]]}
I20260811 06:17:07.973876 13306 consensus_queue.cc:1035] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:07.973804 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_0318f31deb8044249063d4596a191ee1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:07.974475 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0318f31deb8044249063d4596a191ee1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:07.886386 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 81) took 4898 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.976078 11047 consensus_peers.cc:487] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:07.976517 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3025339a6c9e4e07bba4104006206bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:49 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:07.975622 11676 rpcz_store.cc:269] 0811 06:17:02.988025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.090799 (+102774us) service_pool.cc:227] Handling call
0811 06:17:07.886310 (+4795511us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:04.635642 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:04.635957 (+ 315us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:04.635965 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:04.635967 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:04.636219 (+ 252us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:04.636236 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:04.636242 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:04.636419 (+ 177us) tablet.cc:699] Row locks acquired
0811 06:17:04.636422 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:04.636501 (+ 79us) write_op.cc:270] Start()
0811 06:17:04.636578 (+ 77us) write_op.cc:276] Timestamp: P: 1786429024636438 usec, L: 0
0811 06:17:04.636582 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:04.637153 (+ 571us) log.cc:842] Serialized 356 byte log entry
0811 06:17:05.021282 (+384129us) op_driver.cc:444] REPLICATION: finished
0811 06:17:05.169390 (+148108us) write_op.cc:301] APPLY: starting
0811 06:17:05.169413 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:05.169474 (+ 61us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:05.169532 (+ 58us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:05.169652 (+ 120us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:05.169694 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:05.169701 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:05.169911 (+ 210us) log.cc:842] Serialized 23 byte log entry
0811 06:17:05.170068 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.170091 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:05.170099 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:05.170250 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:05.170254 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.060915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.061022 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.061028 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:06.061031 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.061155 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.061166 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.061170 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.061231 (+ 61us) tablet.cc:699] Row locks acquired
0811 06:17:06.061233 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:06.061268 (+ 35us) write_op.cc:270] Start()
0811 06:17:06.061298 (+ 30us) write_op.cc:276] Timestamp: P: 1786429026061224 usec, L: 0
0811 06:17:06.061301 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.061474 (+ 173us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.068582 (+ 7108us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.069369 (+ 787us) write_op.cc:301] APPLY: starting
0811 06:17:06.069381 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.069410 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.069444 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.069499 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.069527 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.069532 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:06.069593 (+ 61us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.069637 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.069653 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:06.069659 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.069703 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.069706 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.955195 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.955330 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.955337 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.955339 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.955462 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.955478 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.955483 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.955557 (+ 74us) tablet.cc:699] Row locks acquired
0811 06:17:06.955560 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:06.955604 (+ 44us) write_op.cc:270] Start()
0811 06:17:06.955640 (+ 36us) write_op.cc:276] Timestamp: P: 1786429026955524 usec, L: 0
0811 06:17:06.955644 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.955842 (+ 198us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.960949 (+ 5107us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.961103 (+ 154us) write_op.cc:301] APPLY: starting
0811 06:17:06.961121 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.961180 (+ 59us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.961208 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.961263 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.961314 (+ 51us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.961321 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:06.961404 (+ 83us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.961492 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.961509 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:06.961516 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.961571 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.961575 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2084,"reported_tablets":231,"child_traces":[["op",{"apply.queue_time_us":148029,"apply.run_cpu_time_us":864,"apply.run_wall_time_us":934,"num_ops":1,"prepare.queue_time_us":28914,"prepare.run_cpu_time_us":15567,"prepare.run_wall_time_us":152778,"replication_time_us":384669,"spinlock_wait_cycles":1466240,"thread_start_us":345505,"threads_started":3,"wal-append.queue_time_us":151397}],["op",{"apply.queue_time_us":753,"apply.run_cpu_time_us":401,"apply.run_wall_time_us":400,"num_ops":1,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":659,"prepare.run_wall_time_us":659,"raft.queue_time_us":474,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":7262,"thread_start_us":91592,"threads_started":1}],["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":540,"apply.run_wall_time_us":539,"num_ops":1,"prepare.queue_time_us":7431,"prepare.run_cpu_time_us":772,"prepare.run_wall_time_us":773,"raft.queue_time_us":473,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":320,"replication_time_us":5281}]]}
I20260811 06:17:07.977991 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b20f7148dc1e4f28910e7637e9aca501"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:07.886870 11656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 89) took 3258 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.979001 11656 rpcz_store.cc:269] 0811 06:17:04.628537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.139116 (+510579us) service_pool.cc:227] Handling call
0811 06:17:05.185980 (+ 46864us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:07.886834 (+2700854us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.163175 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.163273 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.163279 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:06.163281 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.163366 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.163376 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.163380 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.163446 (+ 66us) tablet.cc:699] Row locks acquired
0811 06:17:06.163448 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:06.163482 (+ 34us) write_op.cc:270] Start()
0811 06:17:06.163513 (+ 31us) write_op.cc:276] Timestamp: P: 1786429026163427 usec, L: 0
0811 06:17:06.163517 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.163668 (+ 151us) log.cc:842] Serialized 530 byte log entry
0811 06:17:06.171510 (+ 7842us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.173652 (+ 2142us) write_op.cc:301] APPLY: starting
0811 06:17:06.173662 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.173692 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.173732 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.173771 (+ 39us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.173798 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.173803 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:06.173892 (+ 89us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.173937 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.173955 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:06.173961 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.174016 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.174019 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.931721 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.931853 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.931861 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:06.931863 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.931980 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.932000 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.932006 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.932089 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:06.932091 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:06.932137 (+ 46us) write_op.cc:270] Start()
0811 06:17:06.932180 (+ 43us) write_op.cc:276] Timestamp: P: 1786429026932058 usec, L: 0
0811 06:17:06.932184 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.932432 (+ 248us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.938596 (+ 6164us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.938724 (+ 128us) write_op.cc:301] APPLY: starting
0811 06:17:06.938742 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.938788 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.938847 (+ 59us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.938906 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.939029 (+ 123us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.939038 (+ 9us) write_op.cc:312] APPLY: finished
0811 06:17:06.939147 (+ 109us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.939228 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.939250 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:06.939257 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.939318 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.939322 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116273,"reported_tablets":215,"spinlock_wait_cycles":43667328,"child_traces":[["op",{"apply.queue_time_us":2115,"apply.run_cpu_time_us":406,"apply.run_wall_time_us":406,"num_ops":1,"prepare.queue_time_us":43879,"prepare.run_cpu_time_us":9881,"prepare.run_wall_time_us":47624,"raft.queue_time_us":1213,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":2,"replication_time_us":7982,"thread_start_us":86717,"threads_started":2}],["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":653,"apply.run_wall_time_us":653,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":832,"prepare.run_wall_time_us":835,"raft.queue_time_us":45,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257,"replication_time_us":6386}]]}
I20260811 06:17:07.981678 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_1c91a8d39e7d4242bcc7d33612e2e8ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:07.982641 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c91a8d39e7d4242bcc7d33612e2e8ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:07.984944 13282 raft_consensus.cc:482] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.985126 13282 raft_consensus.cc:504] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.985800 13282 leader_election.cc:288] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:07.988906 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:07.989387 10654 raft_consensus.cc:2454] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:07.989948 11046 leader_election.cc:302] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:07.990232 13282 raft_consensus.cc:2781] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:07.990298 13282 raft_consensus.cc:482] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:07.990347 13282 raft_consensus.cc:3037] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:07.993235 11361 tablet_bootstrap.cc:492] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:07.956379 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40c31ffb11484783bca9263c947f37da" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:07.993546 10923 raft_consensus.cc:3037] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:07.888839 11670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 83) took 2501 ms (client timeout 1000 ms). Trace:
W20260811 06:17:07.994045 11670 rpcz_store.cc:269] 0811 06:17:05.387376 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.053446 (+666070us) service_pool.cc:227] Handling call
0811 06:17:06.168984 (+115538us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:07.888778 (+1719794us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:06.660599 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.660775 (+ 176us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.660782 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:06.660785 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:06.660913 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.660929 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.660934 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.661012 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:06.661014 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:06.661064 (+ 50us) write_op.cc:270] Start()
0811 06:17:06.661104 (+ 40us) write_op.cc:276] Timestamp: P: 1786429026661009 usec, L: 0
0811 06:17:06.661108 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.661339 (+ 231us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.665700 (+ 4361us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.665880 (+ 180us) write_op.cc:301] APPLY: starting
0811 06:17:06.665898 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.665953 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.665980 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.666045 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.666081 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.666088 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:06.666185 (+ 97us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.666259 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.666281 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:06.666290 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.666348 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.666351 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:06.959408 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:06.959586 (+ 178us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:06.959592 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:06.959594 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:06.959692 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:06.959702 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:06.959707 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:06.959769 (+ 62us) tablet.cc:699] Row locks acquired
0811 06:17:06.959771 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:06.959809 (+ 38us) write_op.cc:270] Start()
0811 06:17:06.959843 (+ 34us) write_op.cc:276] Timestamp: P: 1786429026959728 usec, L: 0
0811 06:17:06.959847 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:06.960084 (+ 237us) log.cc:842] Serialized 356 byte log entry
0811 06:17:06.973244 (+ 13160us) op_driver.cc:444] REPLICATION: finished
0811 06:17:06.975030 (+ 1786us) write_op.cc:301] APPLY: starting
0811 06:17:06.975052 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:06.975097 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:06.975140 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:06.975207 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:06.975245 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:06.975251 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:06.975351 (+ 100us) log.cc:842] Serialized 23 byte log entry
0811 06:17:06.975440 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.975466 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:06.975474 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:06.975547 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:06.975550 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9655,"reported_tablets":217,"spinlock_wait_cycles":85985536,"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":525,"apply.run_wall_time_us":524,"num_ops":1,"prepare.queue_time_us":8867,"prepare.run_cpu_time_us":883,"prepare.run_wall_time_us":884,"raft.queue_time_us":390,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":251,"replication_time_us":4564}],["op",{"apply.queue_time_us":1709,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":588,"mutex_wait_us":9882,"num_ops":1,"prepare.queue_time_us":9950,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":756,"replication_time_us":13366}]]}
I20260811 06:17:07.995882 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b7779b57a825405c8773c414101ed41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:07.996766 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7779b57a825405c8773c414101ed41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:07.996865 10923 raft_consensus.cc:2454] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.997218 12944 raft_consensus.cc:482] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:07.997347 12944 raft_consensus.cc:504] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:07.998019 12944 leader_election.cc:288] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:07.966832 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:07.999122 10555 leader_election.cc:341] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:07.999246 10555 leader_election.cc:302] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:07.999606 13494 raft_consensus.cc:2726] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.000744 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.001083 10654 raft_consensus.cc:2454] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:08.001358 12728 raft_consensus.cc:2258] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:07.990633 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:08.002982 10915 raft_consensus.cc:2454] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:08.001845 10810 leader_election.cc:302] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:08.003489 12944 raft_consensus.cc:2781] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:08.003561 12944 raft_consensus.cc:482] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:08.003618 12944 raft_consensus.cc:3037] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.003861 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 7bcc463affbb4154877624aec28435bc
I20260811 06:17:08.004778 11683 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 59) took 5807 ms. Trace:
I20260811 06:17:08.004913 11683 rpcz_store.cc:276] 0811 06:17:02.201872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.930901 (+5729029us) service_pool.cc:227] Handling call
0811 06:17:07.931589 (+ 688us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:07.931858 (+ 269us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:07.931927 (+ 69us) catalog_manager.cc:2761] Locking tablets
0811 06:17:07.932057 (+ 130us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:08.003451 (+ 71394us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.003461 (+ 10us) write_op.cc:454] Released schema lock
0811 06:17:08.003565 (+ 104us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:08.003707 (+ 142us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:08.003768 (+ 61us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:08.004651 (+ 883us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:07.932933 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:07.933046 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:07.933053 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:07.933055 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:07.933185 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:07.933201 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:07.933206 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:07.933446 (+ 240us) tablet.cc:699] Row locks acquired
0811 06:17:07.933450 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:07.933615 (+ 165us) write_op.cc:270] Start()
0811 06:17:07.933661 (+ 46us) write_op.cc:276] Timestamp: P: 1786429027933578 usec, L: 0
0811 06:17:07.933665 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:07.933919 (+ 254us) log.cc:842] Serialized 728 byte log entry
0811 06:17:07.938498 (+ 4579us) op_driver.cc:444] REPLICATION: finished
0811 06:17:07.938614 (+ 116us) write_op.cc:301] APPLY: starting
0811 06:17:07.938633 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:07.938684 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:07.938739 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:07.938822 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:07.938860 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:07.938866 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:07.938963 (+ 97us) log.cc:842] Serialized 29 byte log entry
0811 06:17:07.939035 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.939059 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:07.939067 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":517,"apply.run_wall_time_us":516,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":1099,"prepare.run_wall_time_us":1100,"raft.queue_time_us":551,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":221,"replication_time_us":4786}]]}
I20260811 06:17:08.005996 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_434adc20066e4b959518efc1ea61e28f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:08.006510 12944 raft_consensus.cc:504] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:08.006873 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_434adc20066e4b959518efc1ea61e28f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:08.008785 12944 leader_election.cc:288] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.009187 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:08.009510 10654 raft_consensus.cc:3037] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.010133 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:08.012969 10654 raft_consensus.cc:2454] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:07.970592 10916 raft_consensus.cc:2454] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:07.993146 13282 raft_consensus.cc:504] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.002466 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:08.016467 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b20f7148dc1e4f28910e7637e9aca501 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:08.018059 11156 raft_consensus.cc:2379] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:08.018999 13282 leader_election.cc:288] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:08.019801 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_6bcb4312fec24752b2859b4d7b738495"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:08.021706 11361 ts_tablet_manager.cc:1397] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.098s user 0.004s sys 0.000s
I20260811 06:17:08.022424 12728 ts_tablet_manager.cc:1905] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.023473 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:08.023728 11156 raft_consensus.cc:2379] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:08.021435 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:08.026757 10810 leader_election.cc:302] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:08.027921 12944 raft_consensus.cc:2781] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:08.028427 12944 raft_consensus.cc:686] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:08.028738 12944 consensus_queue.cc:237] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.029135 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 150) took 2761 ms. Trace:
I20260811 06:17:08.029076 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:08.029238 12727 rpcz_store.cc:276] 0811 06:17:05.268007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.268120 (+ 113us) service_pool.cc:227] Handling call
0811 06:17:07.415211 (+2147091us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:17:07.415223 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.444196 (+ 28973us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:07.514990 (+ 70794us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.029111 (+514121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2142406}
I20260811 06:17:08.029611 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 151) took 2758 ms. Trace:
I20260811 06:17:08.029786 12727 rpcz_store.cc:276] 0811 06:17:05.272070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.272136 (+ 66us) service_pool.cc:227] Handling call
0811 06:17:08.029511 (+2757375us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:17:08.029524 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.029595 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2755051}
I20260811 06:17:08.030114 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 152) took 2756 ms. Trace:
I20260811 06:17:08.030187 12727 rpcz_store.cc:276] 0811 06:17:05.274025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.288903 (+ 14878us) service_pool.cc:227] Handling call
0811 06:17:08.030028 (+2741125us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:08.030037 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.030096 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2740781}
I20260811 06:17:08.030444 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 153) took 2740 ms. Trace:
I20260811 06:17:08.030521 12727 rpcz_store.cc:276] 0811 06:17:05.289544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.289589 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.030371 (+2740782us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:08.030380 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.030431 (+ 51us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2740501}
I20260811 06:17:08.030818 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 154) took 2740 ms. Trace:
I20260811 06:17:08.030902 12727 rpcz_store.cc:276] 0811 06:17:05.290066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.290107 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:08.030708 (+2740601us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:08.030717 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.030792 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2740388}
I20260811 06:17:08.031172 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 155) took 2740 ms. Trace:
I20260811 06:17:08.031253 12727 rpcz_store.cc:276] 0811 06:17:05.290482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.290520 (+ 38us) service_pool.cc:227] Handling call
0811 06:17:08.031096 (+2740576us) ts_tablet_manager.cc:1145] Deleting tablet a378a6f20c564eb685b655a762b638ae
0811 06:17:08.031104 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.031158 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2740339}
I20260811 06:17:08.031512 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 156) took 2740 ms. Trace:
I20260811 06:17:08.031590 12727 rpcz_store.cc:276] 0811 06:17:05.290878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.292290 (+ 1412us) service_pool.cc:227] Handling call
0811 06:17:08.031441 (+2739151us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:17:08.031450 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.031497 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2738847}
I20260811 06:17:08.031869 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 158) took 2738 ms. Trace:
I20260811 06:17:08.031947 12727 rpcz_store.cc:276] 0811 06:17:05.293448 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.293493 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.031778 (+2738285us) ts_tablet_manager.cc:1145] Deleting tablet 3250276181a24e58a2db92376b7520e7
0811 06:17:08.031788 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.031854 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2738077}
I20260811 06:17:08.032227 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 161) took 2738 ms. Trace:
I20260811 06:17:08.032296 12727 rpcz_store.cc:276] 0811 06:17:05.294182 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.294228 (+ 46us) service_pool.cc:227] Handling call
0811 06:17:08.032131 (+2737903us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:08.032141 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.032212 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737723}
W20260811 06:17:08.040447 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bcb4312fec24752b2859b4d7b738495 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:08.042796 12726 ts_tablet_manager.cc:1918] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.043005 12726 log.cc:1196] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ab32f96671984766a54b5ee904c465f7
I20260811 06:17:08.043474 12726 ts_tablet_manager.cc:1939] T ab32f96671984766a54b5ee904c465f7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:08.043898 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 96) took 5541 ms. Trace:
I20260811 06:17:08.044070 12726 rpcz_store.cc:276] 0811 06:17:02.502798 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.502883 (+ 85us) service_pool.cc:227] Handling call
0811 06:17:07.822555 (+5319672us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:17:07.822567 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:07.964695 (+142128us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.042676 (+ 77981us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.043880 (+ 1204us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":52244,"tablet-delete.queue_time_us":5275195}
I20260811 06:17:08.044086 13282 consensus_queue.cc:1035] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.044723 11361 raft_consensus.cc:348] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.045534 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.051335 11361 raft_consensus.cc:374] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.052093 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844e735c671440c5bfe1035068c7334e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:08.054158 11361 raft_consensus.cc:729] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.056550 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 2f243c792a634abf83484aef820dbb48 (table default.Table_dcb5c77404034038a23416b22f0fff3f [id=ad1236bbf43f4e0aa085936d5f540e58]) successfully deleted
W20260811 06:17:08.056999 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 37e73b8798b2455baf642abc532a5d8c because the tablet was not found. No further retry: Not found: Tablet not found: 37e73b8798b2455baf642abc532a5d8c
W20260811 06:17:08.057477 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 59c4e76ecde14d0a86fedc84815e78a7 because the tablet was not found. No further retry: Not found: Tablet not found: 59c4e76ecde14d0a86fedc84815e78a7
W20260811 06:17:08.057806 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d668bcfbeff54181ba3b4407b1eb5704 because the tablet was not found. No further retry: Not found: Tablet not found: d668bcfbeff54181ba3b4407b1eb5704
W20260811 06:17:08.058424 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
I20260811 06:17:08.058709 11361 consensus_queue.cc:260] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:08.059031 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a378a6f20c564eb685b655a762b638ae because the tablet was not found. No further retry: Not found: Tablet not found: a378a6f20c564eb685b655a762b638ae
W20260811 06:17:08.059407 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f4f14a0add084048b92a501476ad6588 because the tablet was not found. No further retry: Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
W20260811 06:17:08.059679 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3250276181a24e58a2db92376b7520e7 because the tablet was not found. No further retry: Not found: Tablet not found: 3250276181a24e58a2db92376b7520e7
W20260811 06:17:08.060020 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:08.062849 11361 ts_tablet_manager.cc:1428] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260811 06:17:08.065344 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:08.072122 11361 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.077289 12728 ts_tablet_manager.cc:1918] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.079087 11361 tablet_bootstrap.cc:654] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.072417 11047 leader_election.cc:302] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:08.087984 13282 raft_consensus.cc:2726] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.092945 12484 consensus_queue.cc:1035] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.140834 11365 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.153451 11365 ts_tablet_manager.cc:1397] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.265s user 0.058s sys 0.085s
I20260811 06:17:08.153868 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ab32f96671984766a54b5ee904c465f7 (table default.Table_91a2a9c15d324a14af5161c4cd05fb24 [id=4751fa5ee6184aa39890f385e967f8fd]) successfully deleted
I20260811 06:17:08.094527 11362 tablet_bootstrap.cc:492] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:08.108765 12944 raft_consensus.cc:482] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.156270 12728 log.cc:1196] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f4f14a0add084048b92a501476ad6588
I20260811 06:17:08.156416 11362 ts_tablet_manager.cc:1397] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.226s user 0.027s sys 0.011s
I20260811 06:17:08.156809 12728 ts_tablet_manager.cc:1939] T f4f14a0add084048b92a501476ad6588 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:08.156428 12944 raft_consensus.cc:504] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.157163 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 158) took 3098 ms. Trace:
I20260811 06:17:08.157244 12728 rpcz_store.cc:276] 0811 06:17:05.058443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.058506 (+ 63us) service_pool.cc:227] Handling call
0811 06:17:07.954132 (+2895626us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:17:07.954142 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.074189 (+120047us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.077188 (+ 2999us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.157146 (+ 79958us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2895315}
I20260811 06:17:08.157456 12944 leader_election.cc:288] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.157624 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 161) took 3097 ms. Trace:
I20260811 06:17:08.157606 11362 raft_consensus.cc:348] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.157591 11365 raft_consensus.cc:348] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.157699 12728 rpcz_store.cc:276] 0811 06:17:05.060102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.060150 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:08.157524 (+3097374us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:08.157537 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.157610 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3097060}
I20260811 06:17:08.157810 11362 raft_consensus.cc:374] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.157843 11365 raft_consensus.cc:374] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.157864 11362 raft_consensus.cc:729] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.157898 11365 raft_consensus.cc:729] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.158004 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 153) took 3102 ms. Trace:
I20260811 06:17:08.158053 11362 consensus_queue.cc:260] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.158077 11365 consensus_queue.cc:260] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.158612 11362 ts_tablet_manager.cc:1428] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:08.158779 11365 ts_tablet_manager.cc:1428] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:08.158885 11362 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:08.158077 12728 rpcz_store.cc:276] 0811 06:17:05.055980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.056026 (+ 46us) service_pool.cc:227] Handling call
0811 06:17:08.157924 (+3101898us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:08.157934 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.157991 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3093037}
I20260811 06:17:08.160379 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 157) took 3102 ms. Trace:
I20260811 06:17:08.160472 12728 rpcz_store.cc:276] 0811 06:17:05.058147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.058187 (+ 40us) service_pool.cc:227] Handling call
0811 06:17:08.160286 (+3102099us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:17:08.160297 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.160363 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095207}
I20260811 06:17:08.160763 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 160) took 3101 ms. Trace:
I20260811 06:17:08.160844 12728 rpcz_store.cc:276] 0811 06:17:05.059781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.059825 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:08.160684 (+3100859us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:17:08.160694 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.160748 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095350}
I20260811 06:17:08.161150 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 162) took 3100 ms. Trace:
I20260811 06:17:08.161226 12728 rpcz_store.cc:276] 0811 06:17:05.060813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.060858 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.161050 (+3100192us) ts_tablet_manager.cc:1145] Deleting tablet 32407c8872464da2b1470a8ae21c86fd
0811 06:17:08.161060 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.161136 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095514}
I20260811 06:17:08.162060 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f4f14a0add084048b92a501476ad6588 (table default.Table_e8e359f459ab4b79a079b6f990345a9a [id=7792bcddbdd44cad988860223ed4e05e]) successfully deleted
I20260811 06:17:08.162776 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 164) took 2867 ms. Trace:
I20260811 06:17:08.162896 12727 rpcz_store.cc:276] 0811 06:17:05.294913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.294958 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.032484 (+2737526us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:08.032493 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.162737 (+130244us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737354}
I20260811 06:17:08.163288 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 170) took 2867 ms. Trace:
I20260811 06:17:08.163390 12727 rpcz_store.cc:276] 0811 06:17:05.296109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.296153 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:08.163181 (+2867028us) ts_tablet_manager.cc:1145] Deleting tablet ea4eb7f5db2e4e75818bfb228b64ed0d
0811 06:17:08.163197 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.163271 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2866851}
I20260811 06:17:08.163707 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 157) took 2870 ms. Trace:
I20260811 06:17:08.163793 12727 rpcz_store.cc:276] 0811 06:17:05.293146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.293189 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:08.163623 (+2870434us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:08.163633 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.163690 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860675}
I20260811 06:17:08.164079 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 159) took 2870 ms. Trace:
I20260811 06:17:08.164160 12727 rpcz_store.cc:276] 0811 06:17:05.293883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.293921 (+ 38us) service_pool.cc:227] Handling call
0811 06:17:08.163998 (+2870077us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:17:08.164008 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.164064 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860804}
I20260811 06:17:08.164484 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 160) took 2870 ms. Trace:
I20260811 06:17:08.164562 12727 rpcz_store.cc:276] 0811 06:17:05.294077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.294128 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:08.164373 (+2870245us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:08.164383 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.164469 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2861022}
I20260811 06:17:08.165081 11361 tablet_bootstrap.cc:492] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.165273 11361 ts_tablet_manager.cc:1397] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.000s
I20260811 06:17:08.165688 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.166141 11361 raft_consensus.cc:348] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:08.166373 10813 leader_election.cc:341] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.166440 11361 raft_consensus.cc:374] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.166618 11361 raft_consensus.cc:729] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.166882 11361 consensus_queue.cc:260] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.164986 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 162) took 2870 ms. Trace:
W20260811 06:17:08.169667 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 97b348d30dc44fa383a27d9097c2e598 because the tablet was not found. No further retry: Not found: Tablet not found: 97b348d30dc44fa383a27d9097c2e598
W20260811 06:17:08.170130 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because the tablet was not found. No further retry: Not found: Tablet not found: 9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:17:08.161651 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 163) took 3100 ms. Trace:
W20260811 06:17:08.170578 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 681736b44af04718b800d503ca645c1a because the tablet was not found. No further retry: Not found: Tablet not found: 681736b44af04718b800d503ca645c1a
W20260811 06:17:08.170878 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because the tablet was not found. No further retry: Not found: Tablet not found: b39dfcd1a66b4241bc6f5c38e930f048
W20260811 06:17:08.171213 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:08.170066 12727 rpcz_store.cc:276] 0811 06:17:05.294539 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.294577 (+ 38us) service_pool.cc:227] Handling call
0811 06:17:08.164751 (+2870174us) ts_tablet_manager.cc:1145] Deleting tablet 52ecffcf4a0e46428caed6f7d72199bd
0811 06:17:08.164760 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.164967 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2861085}
I20260811 06:17:08.170444 12728 rpcz_store.cc:276] 0811 06:17:05.061199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.061298 (+ 99us) service_pool.cc:227] Handling call
0811 06:17:08.161564 (+3100266us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:17:08.161576 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.161634 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3095701}
I20260811 06:17:08.174121 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.174469 10654 raft_consensus.cc:2454] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:08.174803 11361 ts_tablet_manager.cc:1428] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:08.174943 10810 leader_election.cc:302] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.175386 12944 raft_consensus.cc:2781] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:08.175467 12944 raft_consensus.cc:482] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:08.175529 12944 raft_consensus.cc:3037] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.176549 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 164) took 3114 ms. Trace:
I20260811 06:17:08.176944 12728 rpcz_store.cc:276] 0811 06:17:05.071583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.071644 (+ 61us) service_pool.cc:227] Handling call
0811 06:17:08.173184 (+3101540us) ts_tablet_manager.cc:1145] Deleting tablet 864c3bbf1e004579a4d0be809f83ca33
0811 06:17:08.173199 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.176402 (+ 3203us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3101149}
I20260811 06:17:08.178574 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 165) took 3106 ms. Trace:
I20260811 06:17:08.178953 12728 rpcz_store.cc:276] 0811 06:17:05.072222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.072281 (+ 59us) service_pool.cc:227] Handling call
0811 06:17:08.178136 (+3105855us) ts_tablet_manager.cc:1145] Deleting tablet ea4eb7f5db2e4e75818bfb228b64ed0d
0811 06:17:08.178153 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.178443 (+ 290us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105387}
I20260811 06:17:08.181773 12726 tablet_replica.cc:330] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:08.182029 11365 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:08.176082 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because the tablet was not found. No further retry: Not found: Tablet not found: 9ac8c5daeb3249e38d863ee94f1267b1
W20260811 06:17:08.182632 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ea4eb7f5db2e4e75818bfb228b64ed0d because the tablet was not found. No further retry: Not found: Tablet not found: ea4eb7f5db2e4e75818bfb228b64ed0d
W20260811 06:17:08.183007 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 97b348d30dc44fa383a27d9097c2e598 because the tablet was not found. No further retry: Not found: Tablet not found: 97b348d30dc44fa383a27d9097c2e598
I20260811 06:17:08.184634 11365 tablet_bootstrap.cc:654] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.186596 11361 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.173702 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 163) took 2878 ms. Trace:
I20260811 06:17:08.188324 12727 rpcz_store.cc:276] 0811 06:17:05.294726 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.294802 (+ 76us) service_pool.cc:227] Handling call
0811 06:17:08.172812 (+2878010us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:08.172826 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.173559 (+ 733us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2868852}
I20260811 06:17:08.189121 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 165) took 2894 ms. Trace:
I20260811 06:17:08.189283 12727 rpcz_store.cc:276] 0811 06:17:05.295034 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.295079 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.188994 (+2893915us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:17:08.189008 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.189101 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885123}
I20260811 06:17:08.182049 12726 raft_consensus.cc:2229] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.189848 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 166) took 2894 ms. Trace:
I20260811 06:17:08.189944 12727 rpcz_store.cc:276] 0811 06:17:05.295232 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.295277 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.189754 (+2894477us) ts_tablet_manager.cc:1145] Deleting tablet 67f458dba9444bfa8841a84cdb798588
0811 06:17:08.189766 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.189831 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885737}
I20260811 06:17:08.190290 12726 raft_consensus.cc:2258] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.190373 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 167) took 2895 ms. Trace:
I20260811 06:17:08.190464 12727 rpcz_store.cc:276] 0811 06:17:05.295351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.295394 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:08.190287 (+2894893us) ts_tablet_manager.cc:1145] Deleting tablet 0bbf657cb27f4da9a4f595242864163a
0811 06:17:08.190297 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.190357 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886132}
I20260811 06:17:08.190892 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 168) took 2895 ms. Trace:
I20260811 06:17:08.190990 12727 rpcz_store.cc:276] 0811 06:17:05.295550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.295593 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:08.190807 (+2895214us) ts_tablet_manager.cc:1145] Deleting tablet 9c5fa9633057485b917f117819d79398
0811 06:17:08.190818 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.190876 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886488}
I20260811 06:17:08.191102 12726 ts_tablet_manager.cc:1905] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.191432 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 169) took 2895 ms. Trace:
I20260811 06:17:08.191519 12727 rpcz_store.cc:276] 0811 06:17:05.295758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.295925 (+ 167us) service_pool.cc:227] Handling call
0811 06:17:08.191313 (+2895388us) ts_tablet_manager.cc:1145] Deleting tablet 32407c8872464da2b1470a8ae21c86fd
0811 06:17:08.191323 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.191416 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886820}
I20260811 06:17:08.191954 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 171) took 2895 ms. Trace:
I20260811 06:17:08.192037 12727 rpcz_store.cc:276] 0811 06:17:05.296591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.296632 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:08.191842 (+2895210us) ts_tablet_manager.cc:1145] Deleting tablet 5e990aa374204f2b95c08b04121176bc
0811 06:17:08.191852 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.191940 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887195}
I20260811 06:17:08.192492 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 172) took 2895 ms. Trace:
I20260811 06:17:08.192579 12727 rpcz_store.cc:276] 0811 06:17:05.296799 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.296844 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.192411 (+2895567us) ts_tablet_manager.cc:1145] Deleting tablet c5efe8eb16e84575abd18a5079aad2c9
0811 06:17:08.192421 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.192476 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887175}
I20260811 06:17:08.192996 12727 tablet_replica.cc:330] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.193204 12727 raft_consensus.cc:2229] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:08.193562 12727 raft_consensus.cc:2258] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.200212 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 166) took 3107 ms. Trace:
I20260811 06:17:08.208660 11361 tablet_bootstrap.cc:654] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.202135 12728 rpcz_store.cc:276] 0811 06:17:05.073060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.073135 (+ 75us) service_pool.cc:227] Handling call
0811 06:17:08.179983 (+3106848us) ts_tablet_manager.cc:1145] Deleting tablet 5e990aa374204f2b95c08b04121176bc
0811 06:17:08.180042 (+ 59us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.180344 (+ 302us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3106357}
I20260811 06:17:08.212194 11365 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.211799 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 170) took 3135 ms. Trace:
I20260811 06:17:08.212442 11365 ts_tablet_manager.cc:1397] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.007s
I20260811 06:17:08.212376 12728 rpcz_store.cc:276] 0811 06:17:05.076974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.082686 (+ 5712us) service_pool.cc:227] Handling call
0811 06:17:08.210954 (+3128268us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:17:08.211091 (+ 137us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.211662 (+ 571us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127698}
I20260811 06:17:08.213179 12727 ts_tablet_manager.cc:1905] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.213809 11365 raft_consensus.cc:348] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.214193 11365 raft_consensus.cc:374] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.214308 11365 raft_consensus.cc:729] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.214720 11365 consensus_queue.cc:260] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.215478 11365 ts_tablet_manager.cc:1428] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:08.215309 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 171) took 3129 ms. Trace:
I20260811 06:17:08.217032 11365 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:08.215895 12728 rpcz_store.cc:276] 0811 06:17:05.085353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.085410 (+ 57us) service_pool.cc:227] Handling call
0811 06:17:08.214450 (+3129040us) ts_tablet_manager.cc:1145] Deleting tablet fe5eea681072477ab52a822d721629cf
0811 06:17:08.214594 (+ 144us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.215173 (+ 579us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3128650}
I20260811 06:17:08.218971 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 172) took 3061 ms. Trace:
I20260811 06:17:08.219547 12728 rpcz_store.cc:276] 0811 06:17:05.157919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.158001 (+ 82us) service_pool.cc:227] Handling call
0811 06:17:08.217987 (+3059986us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:17:08.218121 (+ 134us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.218945 (+ 824us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3059550}
I20260811 06:17:08.221985 11365 tablet_bootstrap.cc:654] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.221844 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 173) took 3063 ms. Trace:
I20260811 06:17:08.222396 12728 rpcz_store.cc:276] 0811 06:17:05.158089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.158845 (+ 756us) service_pool.cc:227] Handling call
0811 06:17:08.221083 (+3062238us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:17:08.221102 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.221677 (+ 575us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3061838}
I20260811 06:17:08.223299 12484 consensus_queue.cc:1035] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.240708 12728 tablet_replica.cc:330] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.244131 12728 raft_consensus.cc:2229] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.246726 12728 raft_consensus.cc:2258] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.253273 11655 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 60) took 5861 ms. Trace:
I20260811 06:17:08.253647 11655 rpcz_store.cc:276] 0811 06:17:02.331480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.973413 (+5641933us) service_pool.cc:227] Handling call
0811 06:17:07.974584 (+ 1171us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.060852 (+ 86268us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.134844 (+ 73992us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.134850 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:08.134969 (+ 119us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.192992 (+ 58023us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.193177 (+ 185us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.126812 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.126938 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.126944 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:08.126946 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.127076 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.127090 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.127094 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.127177 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:08.127179 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:08.127218 (+ 39us) write_op.cc:270] Start()
0811 06:17:08.127254 (+ 36us) write_op.cc:276] Timestamp: P: 1786429028127171 usec, L: 0
0811 06:17:08.127258 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.127504 (+ 246us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.131492 (+ 3988us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.131594 (+ 102us) write_op.cc:301] APPLY: starting
0811 06:17:08.131611 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.131657 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.131743 (+ 86us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.131926 (+ 183us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.131963 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.131970 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:08.132055 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.132119 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.132142 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:08.132149 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":608,"apply.run_wall_time_us":607,"mutex_wait_us":64870,"num_ops":2,"prepare.queue_time_us":64969,"prepare.run_cpu_time_us":820,"prepare.run_wall_time_us":820,"raft.queue_time_us":85,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":221,"replication_time_us":4209}]]}
I20260811 06:17:08.256175 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d58c8185f2b547b58e81aeb849c8a9ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:08.257185 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d58c8185f2b547b58e81aeb849c8a9ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:08.263465 11361 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.263648 11361 ts_tablet_manager.cc:1397] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.017s
I20260811 06:17:08.264499 11361 raft_consensus.cc:348] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.264727 11361 raft_consensus.cc:374] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.264781 11361 raft_consensus.cc:729] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.264992 11361 consensus_queue.cc:260] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.266475 11361 ts_tablet_manager.cc:1428] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:08.267220 11361 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:08.274171 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because the tablet was not found. No further retry: Not found: Tablet not found: 6119212ae4be4204852a5d9437dcee72
I20260811 06:17:08.275851 11361 tablet_bootstrap.cc:654] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.279392 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 63) took 5710 ms. Trace:
I20260811 06:17:08.279717 11670 rpcz_store.cc:276] 0811 06:17:02.483217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.995342 (+5512125us) service_pool.cc:227] Handling call
0811 06:17:07.996904 (+ 1562us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:07.997522 (+ 618us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.140129 (+142607us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.140139 (+ 10us) write_op.cc:454] Released schema lock
0811 06:17:08.140246 (+ 107us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.193236 (+ 52990us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.193374 (+ 138us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.113252 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.113390 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.113397 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:08.113399 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.117020 (+ 3621us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.117040 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.117047 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.117179 (+ 132us) tablet.cc:699] Row locks acquired
0811 06:17:08.117182 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.117232 (+ 50us) write_op.cc:270] Start()
0811 06:17:08.117274 (+ 42us) write_op.cc:276] Timestamp: P: 1786429028117181 usec, L: 0
0811 06:17:08.117277 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.117518 (+ 241us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.122506 (+ 4988us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.122618 (+ 112us) write_op.cc:301] APPLY: starting
0811 06:17:08.122635 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.122680 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.122707 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.122823 (+ 116us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.122860 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.122866 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.122953 (+ 87us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.123021 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.123045 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:08.123052 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"apply.run_cpu_time_us":495,"apply.run_wall_time_us":494,"num_ops":2,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":943,"prepare.run_wall_time_us":4394,"raft.queue_time_us":519,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":266,"replication_time_us":5200}]]}
W20260811 06:17:08.274837 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6c706bf0455341a0a953d937f9778b5f because the tablet was not found. No further retry: Not found: Tablet not found: 6c706bf0455341a0a953d937f9778b5f
I20260811 06:17:08.262396 12728 ts_tablet_manager.cc:1905] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.282019 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_ea5412dbd9ad48b29a075b80dae49bdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:08.287233 11362 tablet_bootstrap.cc:654] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:08.288769 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea5412dbd9ad48b29a075b80dae49bdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:08.289266 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 50342.1us
W20260811 06:17:08.289790 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 864c3bbf1e004579a4d0be809f83ca33 because the tablet was not found. No further retry: Not found: Tablet not found: 864c3bbf1e004579a4d0be809f83ca33
I20260811 06:17:08.301241 12944 raft_consensus.cc:504] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.302286 12944 leader_election.cc:288] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.305516 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:08.310120 10921 raft_consensus.cc:3037] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.310491 11676 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 61) took 5958 ms. Trace:
W20260811 06:17:08.310439 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 98237.9us
I20260811 06:17:08.310667 11676 rpcz_store.cc:276] 0811 06:17:02.331759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.977384 (+5645625us) service_pool.cc:227] Handling call
0811 06:17:08.016674 (+ 39290us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.017202 (+ 528us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.091126 (+ 73924us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.091133 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:08.091305 (+ 172us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.289797 (+198492us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.289914 (+ 117us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.081649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.081796 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.081803 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:08.081806 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:08.081914 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.081929 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.081935 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.082125 (+ 190us) tablet.cc:699] Row locks acquired
0811 06:17:08.082127 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:08.082178 (+ 51us) write_op.cc:270] Start()
0811 06:17:08.082218 (+ 40us) write_op.cc:276] Timestamp: P: 1786429028082130 usec, L: 0
0811 06:17:08.082222 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.082459 (+ 237us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.086672 (+ 4213us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.086808 (+ 136us) write_op.cc:301] APPLY: starting
0811 06:17:08.086827 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.086877 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.086974 (+ 97us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.087129 (+ 155us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.087171 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.087177 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.087268 (+ 91us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.087343 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.087368 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:08.087376 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":647,"apply.run_wall_time_us":647,"num_ops":2,"prepare.queue_time_us":63817,"prepare.run_cpu_time_us":939,"prepare.run_wall_time_us":939,"raft.queue_time_us":476,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":402,"replication_time_us":4421}]]}
I20260811 06:17:08.316937 11656 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 62) took 5853 ms. Trace:
I20260811 06:17:08.318533 13494 raft_consensus.cc:482] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:08.318740 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:08.318727 13494 raft_consensus.cc:504] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:08.319187 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because the tablet was not found. No further retry: Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:08.319422 13494 leader_election.cc:288] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:08.319694 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 285b85c854bf400295b288314947840e because the tablet was not found. No further retry: Not found: Tablet not found: 285b85c854bf400295b288314947840e
W20260811 06:17:08.319979 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because the tablet was not found. No further retry: Not found: Tablet not found: b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:08.320355 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f079882c3c46318f70190d5293868e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.320927 10555 leader_election.cc:341] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:08.322021 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 67f458dba9444bfa8841a84cdb798588 because the tablet was not found. No further retry: Not found: Tablet not found: 67f458dba9444bfa8841a84cdb798588
W20260811 06:17:08.322518 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0bbf657cb27f4da9a4f595242864163a because the tablet was not found. No further retry: Not found: Tablet not found: 0bbf657cb27f4da9a4f595242864163a
I20260811 06:17:08.324280 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91f079882c3c46318f70190d5293868e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:08.325130 10564 leader_election.cc:341] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.325251 10564 leader_election.cc:302] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.325471 13494 raft_consensus.cc:2726] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.326262 13446 consensus_queue.cc:1035] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.322311 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_aa46838bbe644da4ab380925d952c7ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:08.322880 11656 rpcz_store.cc:276] 0811 06:17:02.436847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.981354 (+5544507us) service_pool.cc:227] Handling call
0811 06:17:07.982806 (+ 1452us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:07.983476 (+ 670us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.032641 (+ 49165us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.032650 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:08.032754 (+ 104us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.032974 (+ 220us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.290004 (+257030us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:07.984102 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:07.984207 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:07.984213 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:07.984216 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:07.984307 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:07.984322 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:07.984327 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:07.984414 (+ 87us) tablet.cc:699] Row locks acquired
0811 06:17:07.984417 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:07.984460 (+ 43us) write_op.cc:270] Start()
0811 06:17:07.984498 (+ 38us) write_op.cc:276] Timestamp: P: 1786429027984425 usec, L: 0
0811 06:17:07.984503 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:07.984776 (+ 273us) log.cc:842] Serialized 433 byte log entry
0811 06:17:07.989945 (+ 5169us) op_driver.cc:444] REPLICATION: finished
0811 06:17:07.990072 (+ 127us) write_op.cc:301] APPLY: starting
0811 06:17:07.990090 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:07.990135 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:07.990162 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:07.990439 (+ 277us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:07.990481 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:07.990487 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:07.990581 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:07.990650 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.990674 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:07.990682 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":674,"apply.run_wall_time_us":673,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":788,"prepare.run_wall_time_us":788,"raft.queue_time_us":502,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":294,"replication_time_us":5416}]]}
I20260811 06:17:08.330654 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:08.330899 11156 raft_consensus.cc:3037] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.330703 11365 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.330987 13567 consensus_queue.cc:1035] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:08.332285 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa46838bbe644da4ab380925d952c7ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:08.332001 11365 ts_tablet_manager.cc:1397] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.115s user 0.023s sys 0.023s
I20260811 06:17:08.334146 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_41898761f3ca4302863c36bdc1437def"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:08.336676 12727 ts_tablet_manager.cc:1918] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.336822 12727 log.cc:1196] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2fcf7c7a470144c0a084aebc2032d896
I20260811 06:17:08.337165 12727 ts_tablet_manager.cc:1939] T 2fcf7c7a470144c0a084aebc2032d896 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:08.337553 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41898761f3ca4302863c36bdc1437def in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:08.337541 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9c5fa9633057485b917f117819d79398 because the tablet was not found. No further retry: Not found: Tablet not found: 9c5fa9633057485b917f117819d79398
W20260811 06:17:08.339311 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:08.341357 11156 raft_consensus.cc:2454] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:17:08.341536 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
W20260811 06:17:08.342011 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c5efe8eb16e84575abd18a5079aad2c9 because the tablet was not found. No further retry: Not found: Tablet not found: c5efe8eb16e84575abd18a5079aad2c9
I20260811 06:17:08.342033 12484 consensus_queue.cc:1035] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.343298 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 182) took 2289 ms. Trace:
I20260811 06:17:08.343370 13494 raft_consensus.cc:482] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.343394 12727 rpcz_store.cc:276] 0811 06:17:06.054245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.054305 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:08.192892 (+2138587us) ts_tablet_manager.cc:1145] Deleting tablet 2fcf7c7a470144c0a084aebc2032d896
0811 06:17:08.192902 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.256246 (+ 63344us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.336166 (+ 79920us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.343279 (+ 7113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2138388}
I20260811 06:17:08.343504 13494 raft_consensus.cc:504] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.344139 13494 leader_election.cc:288] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.344043 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 183) took 2282 ms. Trace:
I20260811 06:17:08.344219 12727 rpcz_store.cc:276] 0811 06:17:06.061872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.061975 (+ 103us) service_pool.cc:227] Handling call
0811 06:17:08.343919 (+2281944us) ts_tablet_manager.cc:1145] Deleting tablet 79f307f50e044435be880079219170d8
0811 06:17:08.343930 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.344027 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2281749}
I20260811 06:17:08.344687 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 185) took 2236 ms. Trace:
I20260811 06:17:08.344767 12727 rpcz_store.cc:276] 0811 06:17:06.108139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.108198 (+ 59us) service_pool.cc:227] Handling call
0811 06:17:08.344582 (+2236384us) ts_tablet_manager.cc:1145] Deleting tablet b79f635593b04cd59d43d54f702a8cc6
0811 06:17:08.344593 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.344672 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2236067}
I20260811 06:17:08.345176 12727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 186) took 2228 ms. Trace:
I20260811 06:17:08.345247 12727 rpcz_store.cc:276] 0811 06:17:06.116365 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.116430 (+ 65us) service_pool.cc:227] Handling call
0811 06:17:08.345078 (+2228648us) ts_tablet_manager.cc:1145] Deleting tablet 9a79e23d311a447480c70393259cbfae
0811 06:17:08.345088 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.345162 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228314}
I20260811 06:17:08.349566 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916b91088d7d4024a02214c958c0825b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:08.350225 10564 leader_election.cc:341] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.350375 10813 leader_election.cc:302] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:08.326278 11653 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 65) took 5570 ms. Trace:
I20260811 06:17:08.350682 12944 raft_consensus.cc:2781] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:08.350806 12944 raft_consensus.cc:686] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:08.351053 12944 consensus_queue.cc:237] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.347733 11365 raft_consensus.cc:348] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.352141 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916b91088d7d4024a02214c958c0825b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.352978 10555 leader_election.cc:341] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.353425 10555 leader_election.cc:302] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.353802 13495 raft_consensus.cc:2726] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.352829 11365 raft_consensus.cc:374] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.354406 11365 raft_consensus.cc:729] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.356868 12727 tablet_replica.cc:330] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.357116 12727 raft_consensus.cc:2229] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:08.357363 12727 pending_rounds.cc:62] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:08.357412 12727 pending_rounds.cc:68] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213298252075008 op_type: NO_OP noop_request { }
I20260811 06:17:08.357550 12727 raft_consensus.cc:2866] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:08.357637 12727 raft_consensus.cc:2258] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.358917 12727 ts_tablet_manager.cc:1905] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.357438 11365 consensus_queue.cc:260] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.326561 11683 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 64) took 5592 ms. Trace:
I20260811 06:17:08.366477 11676 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 68) took 5214 ms. Trace:
I20260811 06:17:08.366641 11676 rpcz_store.cc:276] 0811 06:17:03.140874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.316205 (+5175331us) service_pool.cc:227] Handling call
0811 06:17:08.332416 (+ 16211us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.333070 (+ 654us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.354631 (+ 21561us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.354842 (+ 211us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.354957 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.333774 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.333905 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.333912 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:08.333914 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.334016 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.334031 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.334036 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.334130 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:08.334133 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.334177 (+ 44us) write_op.cc:270] Start()
0811 06:17:08.334216 (+ 39us) write_op.cc:276] Timestamp: P: 1786429028334154 usec, L: 0
0811 06:17:08.334221 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.334509 (+ 288us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.352181 (+ 17672us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.352644 (+ 463us) write_op.cc:301] APPLY: starting
0811 06:17:08.352666 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.352716 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.354021 (+ 1305us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.354183 (+ 162us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.354223 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.354230 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:08.354320 (+ 90us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.354402 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.354429 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:08.354437 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.354497 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.354501 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":681,"apply.run_wall_time_us":1922,"num_ops":2,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":850,"prepare.run_wall_time_us":850,"raft.queue_time_us":1668,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":252,"replication_time_us":17929}]]}
I20260811 06:17:08.367949 11653 rpcz_store.cc:276] 0811 06:17:02.734284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.019465 (+5285181us) service_pool.cc:227] Handling call
0811 06:17:08.192897 (+173432us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.193419 (+ 522us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.200332 (+ 6913us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.290215 (+ 89883us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.304271 (+ 14056us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.194196 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.194364 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.194372 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:08.194374 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.194470 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.194485 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.194489 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.194576 (+ 87us) tablet.cc:699] Row locks acquired
0811 06:17:08.194579 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.194621 (+ 42us) write_op.cc:270] Start()
0811 06:17:08.194656 (+ 35us) write_op.cc:276] Timestamp: P: 1786429028194565 usec, L: 0
0811 06:17:08.194660 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.194989 (+ 329us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.199543 (+ 4554us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.199668 (+ 125us) write_op.cc:301] APPLY: starting
0811 06:17:08.199685 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.199735 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.199762 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.199899 (+ 137us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.199941 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.199948 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:08.200042 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.200111 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.200136 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:08.200144 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.200205 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.200209 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":598,"apply.run_wall_time_us":597,"num_ops":2,"prepare.queue_time_us":194,"prepare.run_cpu_time_us":930,"prepare.run_wall_time_us":931,"raft.queue_time_us":508,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":242,"replication_time_us":4855}]]}
I20260811 06:17:08.368621 11365 ts_tablet_manager.cc:1428] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.036s user 0.003s sys 0.003s
I20260811 06:17:08.373760 11365 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:08.376735 12727 ts_tablet_manager.cc:1918] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.376878 12727 log.cc:1196] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/0dab2b8209e5401c84a187882ef21e08
I20260811 06:17:08.377220 12727 ts_tablet_manager.cc:1939] T 0dab2b8209e5401c84a187882ef21e08 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:08.378245 12727 tablet_replica.cc:330] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.378463 12727 raft_consensus.cc:2229] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.378655 12727 raft_consensus.cc:2258] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.378973 11653 master_service.cc:946] ReplaceTablet: received request to replace tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:08.379264 11683 rpcz_store.cc:276] 0811 06:17:02.730066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.005644 (+5275578us) service_pool.cc:227] Handling call
0811 06:17:08.007089 (+ 1445us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.007610 (+ 521us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.149108 (+141498us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.149114 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:08.149231 (+ 117us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.321900 (+172669us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.322033 (+ 133us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.140821 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.140947 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.140953 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:08.140955 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.141058 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.141073 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.141077 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.141170 (+ 93us) tablet.cc:699] Row locks acquired
0811 06:17:08.141173 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.141215 (+ 42us) write_op.cc:270] Start()
0811 06:17:08.141252 (+ 37us) write_op.cc:276] Timestamp: P: 1786429028141166 usec, L: 0
0811 06:17:08.141256 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.141460 (+ 204us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.145392 (+ 3932us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.145548 (+ 156us) write_op.cc:301] APPLY: starting
0811 06:17:08.145567 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.145617 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.145701 (+ 84us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.145896 (+ 195us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.145936 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.145942 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.146024 (+ 82us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.146091 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.146112 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:08.146120 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":629,"apply.run_wall_time_us":653,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":739,"raft.queue_time_us":60,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":259,"replication_time_us":4110}]]}
I20260811 06:17:08.380525 11683 master_service.cc:946] ReplaceTablet: received request to replace tablet 035eee1d37c94471a7cd697fb0fbb951 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:08.369220 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
I20260811 06:17:08.367966 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet 6703e639ab2042e78fadc63bd18c7602 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:08.381948 12727 ts_tablet_manager.cc:1905] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:08.382262 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:08.382835 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:08.383234 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:08.383685 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:08.384050 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
W20260811 06:17:08.384536 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
W20260811 06:17:08.385517 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
W20260811 06:17:08.386516 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
W20260811 06:17:08.387622 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:08.388180 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0874f0e73267446fb873f4619f93307e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:08.388419 10654 raft_consensus.cc:3037] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.391340 10654 raft_consensus.cc:2454] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:08.394129 12727 ts_tablet_manager.cc:1918] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.394277 12727 log.cc:1196] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/217f60a1ca044af38f9ee9093e021c27
I20260811 06:17:08.394845 12727 ts_tablet_manager.cc:1939] T 217f60a1ca044af38f9ee9093e021c27 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:08.396142 12727 tablet_replica.cc:330] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.396365 12727 raft_consensus.cc:2229] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.396530 12727 raft_consensus.cc:2258] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.397424 12727 ts_tablet_manager.cc:1905] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.397557 12728 ts_tablet_manager.cc:1918] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.398761 12728 log.cc:1196] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/5ca903ee846a4e5baf3dbb4302607c1f
W20260811 06:17:08.326733 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ea4eb7f5db2e4e75818bfb228b64ed0d because the tablet was not found. No further retry: Not found: Tablet not found: ea4eb7f5db2e4e75818bfb228b64ed0d
W20260811 06:17:08.401887 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 111580us
I20260811 06:17:08.402171 11362 tablet_bootstrap.cc:492] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:08.402318 11362 ts_tablet_manager.cc:1397] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.243s user 0.004s sys 0.002s
W20260811 06:17:08.402666 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:08.402393 12728 ts_tablet_manager.cc:1939] T 5ca903ee846a4e5baf3dbb4302607c1f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:08.403184 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fe5eea681072477ab52a822d721629cf because the tablet was not found. No further retry: Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
I20260811 06:17:08.403239 11362 raft_consensus.cc:348] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.403527 11362 raft_consensus.cc:374] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:08.403873 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fe5eea681072477ab52a822d721629cf because the tablet was not found. No further retry: Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
W20260811 06:17:08.404361 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 58fdb5920003438d983987ff242f6dce because the tablet was not found. No further retry: Not found: Tablet not found: 58fdb5920003438d983987ff242f6dce
I20260811 06:17:08.404798 12727 ts_tablet_manager.cc:1918] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.404930 12727 log.cc:1196] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/532208d7a02d448e8dac702ffe6c2ffc
W20260811 06:17:08.404862 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
I20260811 06:17:08.405224 12727 ts_tablet_manager.cc:1939] T 532208d7a02d448e8dac702ffe6c2ffc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:08.405890 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 52953438e7c248b1a758ee219405d7da because the tablet was not found. No further retry: Not found: Tablet not found: 52953438e7c248b1a758ee219405d7da
I20260811 06:17:08.406250 12727 tablet_replica.cc:330] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.406457 12727 raft_consensus.cc:2229] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:17:08.406452 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:08.406808 12727 raft_consensus.cc:2258] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.406046 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 174) took 3246 ms. Trace:
W20260811 06:17:08.407255 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because the tablet was not found. No further retry: Not found: Tablet not found: a0e5b4cdeb464861ada487eeb1b901a6
W20260811 06:17:08.407653 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45ebef95922f4e7f93533b54c07b7cec because the tablet was not found. No further retry: Not found: Tablet not found: 45ebef95922f4e7f93533b54c07b7cec
I20260811 06:17:08.407835 12727 ts_tablet_manager.cc:1905] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:08.408124 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because the tablet was not found. No further retry: Not found: Tablet not found: a1981dc26be24ec5afaa3c0bb5c46c8c
W20260811 06:17:08.408480 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
W20260811 06:17:08.408921 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because the tablet was not found. No further retry: Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:08.406903 12728 rpcz_store.cc:276] 0811 06:17:05.159438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.159498 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:08.223885 (+3064387us) ts_tablet_manager.cc:1145] Deleting tablet 5ca903ee846a4e5baf3dbb4302607c1f
0811 06:17:08.239679 (+ 15794us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.346170 (+106491us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.396615 (+ 50445us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.405908 (+ 9293us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3059013}
W20260811 06:17:08.409351 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
I20260811 06:17:08.410120 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 5ca903ee846a4e5baf3dbb4302607c1f (table default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]) successfully deleted
I20260811 06:17:08.411578 11365 tablet_bootstrap.cc:654] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.411649 12728 tablet_replica.cc:330] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.412972 13495 raft_consensus.cc:482] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.413103 13495 raft_consensus.cc:504] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.413806 13495 leader_election.cc:288] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.414300 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:08.414610 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:08.414956 10555 leader_election.cc:341] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:08.415091 10564 leader_election.cc:341] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.415174 10564 leader_election.cc:302] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.414842 12728 raft_consensus.cc:2229] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.415571 13495 raft_consensus.cc:2726] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.416617 12728 raft_consensus.cc:2258] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.417513 12727 ts_tablet_manager.cc:1918] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.417635 12727 log.cc:1196] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:08.418036 12727 ts_tablet_manager.cc:1939] T f5ad5529d4844f61b0888624e7c8b3ce P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:08.423967 11365 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.424369 11365 ts_tablet_manager.cc:1397] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.005s
I20260811 06:17:08.403597 11362 raft_consensus.cc:729] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.424710 12727 tablet_replica.cc:330] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.424681 11362 consensus_queue.cc:260] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.425189 12727 raft_consensus.cc:2229] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.425372 12727 raft_consensus.cc:2258] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.425390 11362 ts_tablet_manager.cc:1428] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260811 06:17:08.426020 12727 ts_tablet_manager.cc:1905] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.427821 11365 raft_consensus.cc:348] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.428375 11365 raft_consensus.cc:374] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.428534 11365 raft_consensus.cc:729] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.429008 11365 consensus_queue.cc:260] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.430763 11365 ts_tablet_manager.cc:1428] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:17:08.431516 11365 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:08.438659 11656 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 69) took 5271 ms. Trace:
I20260811 06:17:08.438942 11656 rpcz_store.cc:276] 0811 06:17:03.166734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.330494 (+5163760us) service_pool.cc:227] Handling call
0811 06:17:08.337686 (+ 7192us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.338204 (+ 518us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.438229 (+100025us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.438377 (+ 148us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.438512 (+ 135us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.345745 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.345846 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.345852 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:08.345854 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.345938 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.345949 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.345953 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.346027 (+ 74us) tablet.cc:699] Row locks acquired
0811 06:17:08.346030 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.346062 (+ 32us) write_op.cc:270] Start()
0811 06:17:08.346094 (+ 32us) write_op.cc:276] Timestamp: P: 1786429028346040 usec, L: 0
0811 06:17:08.346098 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.351273 (+ 5175us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.437469 (+ 86196us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.437559 (+ 90us) write_op.cc:301] APPLY: starting
0811 06:17:08.437573 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.437616 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.437643 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.437838 (+ 195us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.437874 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.437881 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:08.437961 (+ 80us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.438027 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.438045 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:08.438051 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.438108 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.438111 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":598,"apply.run_wall_time_us":598,"num_ops":2,"prepare.queue_time_us":6856,"prepare.run_cpu_time_us":796,"prepare.run_wall_time_us":5649,"replication_time_us":91347}]]}
I20260811 06:17:08.440438 11655 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 66) took 5339 ms. Trace:
I20260811 06:17:08.440634 11655 rpcz_store.cc:276] 0811 06:17:03.100916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.255031 (+5154115us) service_pool.cc:227] Handling call
0811 06:17:08.327905 (+ 72874us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.338033 (+ 10128us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.439676 (+101643us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.439780 (+ 104us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.439892 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.344935 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.345078 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.345086 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:08.345089 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:08.345198 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.345211 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.345217 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.345313 (+ 96us) tablet.cc:699] Row locks acquired
0811 06:17:08.345315 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:08.345356 (+ 41us) write_op.cc:270] Start()
0811 06:17:08.345396 (+ 40us) write_op.cc:276] Timestamp: P: 1786429028345332 usec, L: 0
0811 06:17:08.345401 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.345614 (+ 213us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.429992 (+ 84378us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.436329 (+ 6337us) write_op.cc:301] APPLY: starting
0811 06:17:08.436353 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.436404 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.436485 (+ 81us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.436630 (+ 145us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.436672 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.436678 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.436779 (+ 101us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.436882 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.436906 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:08.436914 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.436981 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.436984 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":6237,"apply.run_cpu_time_us":785,"apply.run_wall_time_us":785,"num_ops":2,"prepare.queue_time_us":6280,"prepare.run_cpu_time_us":771,"prepare.run_wall_time_us":771,"replication_time_us":84558}]]}
I20260811 06:17:08.442435 11656 master_service.cc:946] ReplaceTablet: received request to replace tablet 79f307f50e044435be880079219170d8 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:08.446625 12727 ts_tablet_manager.cc:1918] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.446764 12727 log.cc:1196] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:08.447052 12727 ts_tablet_manager.cc:1939] T 227bc4fd6cd84e5eb2043c52f95d606d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:08.447311 11365 tablet_bootstrap.cc:654] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.449326 12727 tablet_replica.cc:330] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:08.449551 12727 raft_consensus.cc:2229] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:08.449846 12727 pending_rounds.cc:62] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:08.449894 12727 pending_rounds.cc:68] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213297940897792 op_type: NO_OP noop_request { }
I20260811 06:17:08.450343 12727 raft_consensus.cc:2866] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:08.450441 12727 raft_consensus.cc:2258] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.451768 11655 master_service.cc:946] ReplaceTablet: received request to replace tablet 1649493bd0924ee48fd5044d7288932d from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:08.455058 11656 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 73) took 4897 ms. Trace:
I20260811 06:17:08.455265 11656 rpcz_store.cc:276] 0811 06:17:03.557612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.439762 (+4882150us) service_pool.cc:227] Handling call
0811 06:17:08.454640 (+ 14878us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f97527 00007f3e4b289da7 00007f3e4b289ad5 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:08.454857 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27441408}
I20260811 06:17:08.455924 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_28d17bc11c5147c785d93e4351465ea9" } new_table_name: "default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9" modify_external_catalogs: true
I20260811 06:17:08.457798 12727 ts_tablet_manager.cc:1905] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.458233 11676 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 70) took 5227 ms. Trace:
I20260811 06:17:08.458513 11676 rpcz_store.cc:276] 0811 06:17:03.230391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.367312 (+5136921us) service_pool.cc:227] Handling call
0811 06:17:08.458007 (+ 90695us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f97527 00007f3e4b289da7 00007f3e4b289ad5 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:08.458194 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":175165824}
I20260811 06:17:08.458973 11676 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_a761dcad0b3a477a8ee08606c1b45c40" } new_table_name: "default.Table_8d08b9ac405c4d6ebef14f95d93b988b" modify_external_catalogs: true
I20260811 06:17:08.430365 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.467271 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.470115 13495 raft_consensus.cc:482] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.470341 13495 raft_consensus.cc:504] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.471009 13495 leader_election.cc:288] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.471872 12727 ts_tablet_manager.cc:1918] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.472088 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6703e639ab2042e78fadc63bd18c7602" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:08.472545 12727 log.cc:1196] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/5ca903ee846a4e5baf3dbb4302607c1f
W20260811 06:17:08.472640 10555 leader_election.cc:341] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.472216 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6703e639ab2042e78fadc63bd18c7602" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.473073 12727 ts_tablet_manager.cc:1939] T 5ca903ee846a4e5baf3dbb4302607c1f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:08.473245 10564 leader_election.cc:341] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.473347 10564 leader_election.cc:302] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.436308 12728 ts_tablet_manager.cc:1905] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.474261 13495 raft_consensus.cc:2726] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.480867 12728 ts_tablet_manager.cc:1918] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.481029 12728 log.cc:1196] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2fcf7c7a470144c0a084aebc2032d896
I20260811 06:17:08.481381 12728 ts_tablet_manager.cc:1939] T 2fcf7c7a470144c0a084aebc2032d896 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:08.482226 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 191) took 2416 ms. Trace:
I20260811 06:17:08.482331 12728 rpcz_store.cc:276] 0811 06:17:06.066057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.066273 (+ 216us) service_pool.cc:227] Handling call
0811 06:17:08.410950 (+2344677us) ts_tablet_manager.cc:1145] Deleting tablet 2fcf7c7a470144c0a084aebc2032d896
0811 06:17:08.411089 (+ 139us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.477096 (+ 66007us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.480750 (+ 3654us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.482203 (+ 1453us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344192}
I20260811 06:17:08.482892 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 192) took 2416 ms. Trace:
I20260811 06:17:08.482995 12728 rpcz_store.cc:276] 0811 06:17:06.066211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.066278 (+ 67us) service_pool.cc:227] Handling call
0811 06:17:08.482765 (+2416487us) ts_tablet_manager.cc:1145] Deleting tablet 79f307f50e044435be880079219170d8
0811 06:17:08.482777 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.482874 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2416209}
I20260811 06:17:08.483441 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 193) took 2370 ms. Trace:
I20260811 06:17:08.483515 12728 rpcz_store.cc:276] 0811 06:17:06.113206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.113271 (+ 65us) service_pool.cc:227] Handling call
0811 06:17:08.483338 (+2370067us) ts_tablet_manager.cc:1145] Deleting tablet b79f635593b04cd59d43d54f702a8cc6
0811 06:17:08.483347 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.483428 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2369783}
I20260811 06:17:08.483903 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 194) took 2368 ms. Trace:
I20260811 06:17:08.483994 12728 rpcz_store.cc:276] 0811 06:17:06.115886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.115949 (+ 63us) service_pool.cc:227] Handling call
0811 06:17:08.483806 (+2367857us) ts_tablet_manager.cc:1145] Deleting tablet 9a79e23d311a447480c70393259cbfae
0811 06:17:08.483816 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.483889 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2367646}
I20260811 06:17:08.484390 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
W20260811 06:17:08.484689 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:08.485018 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:08.485303 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:08.486263 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:08.425706 11362 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:08.487591 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:08.490870 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 0dab2b8209e5401c84a187882ef21e08 (table default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]) successfully deleted
I20260811 06:17:08.491241 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 67) took 5375 ms. Trace:
I20260811 06:17:08.491454 11670 rpcz_store.cc:276] 0811 06:17:03.115230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.280965 (+5165735us) service_pool.cc:227] Handling call
0811 06:17:08.327757 (+ 46792us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:08.337106 (+ 9349us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:08.490710 (+153604us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:08.490935 (+ 225us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:08.491066 (+ 131us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.353301 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.368798 (+ 15497us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.368807 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:08.368809 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.368918 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.368930 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.368936 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.369034 (+ 98us) tablet.cc:699] Row locks acquired
0811 06:17:08.369037 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.369085 (+ 48us) write_op.cc:270] Start()
0811 06:17:08.369126 (+ 41us) write_op.cc:276] Timestamp: P: 1786429028369058 usec, L: 0
0811 06:17:08.369130 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.453044 (+ 83914us) log.cc:842] Serialized 433 byte log entry
0811 06:17:08.453312 (+ 268us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:08.490002 (+ 36690us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.490100 (+ 98us) write_op.cc:301] APPLY: starting
0811 06:17:08.490118 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.490164 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.490166 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.490373 (+ 207us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.490410 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:08.490416 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.490505 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.490575 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.490594 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:08.490601 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.490671 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.490675 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":632,"apply.run_wall_time_us":631,"num_ops":2,"prepare.queue_time_us":453,"prepare.run_cpu_time_us":1767,"prepare.run_wall_time_us":100055,"replication_time_us":120837,"spinlock_wait_cycles":192188288}]]}
W20260811 06:17:08.491304 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f9fd17e8c6264f898493c15b0aa5518d because the tablet was not found. No further retry: Not found: Tablet not found: f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:17:08.495927 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 217f60a1ca044af38f9ee9093e021c27 (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:17:08.496140 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 532208d7a02d448e8dac702ffe6c2ffc (table default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]) successfully deleted
W20260811 06:17:08.496359 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
I20260811 06:17:08.496620 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f5ad5529d4844f61b0888624e7c8b3ce (table default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]) successfully deleted
W20260811 06:17:08.497079 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:08.497447 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:08.501256 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4ea49146e0734f28907e8531d1e8a5e0" } modify_external_catalogs: true
I20260811 06:17:08.501609 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4ea49146e0734f28907e8531d1e8a5e0" } modify_external_catalogs: true
I20260811 06:17:08.502632 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.502759 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.502909 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.503072 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.503306 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.503573 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.503748 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.504134 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.504601 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.504542 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.504729 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.504864 12728 tablet_replica.cc:330] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.505010 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.505079 12728 raft_consensus.cc:2229] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.505300 11361 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.505293 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.505440 11361 ts_tablet_manager.cc:1397] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.238s user 0.008s sys 0.016s
I20260811 06:17:08.506559 11361 raft_consensus.cc:348] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.506855 11361 raft_consensus.cc:374] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.506914 11361 raft_consensus.cc:729] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.507126 12944 consensus_queue.cc:1035] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.507124 11361 consensus_queue.cc:260] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.507664 11361 ts_tablet_manager.cc:1428] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:17:08.507922 11361 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:08.507887 13074 log.cc:924] Time spent T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Append to log took a long time: real 0.121s user 0.002s sys 0.000s
I20260811 06:17:08.510372 11362 tablet_bootstrap.cc:654] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.511201 11361 tablet_bootstrap.cc:654] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.511260 12728 raft_consensus.cc:2258] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.517454 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:08.497479 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
W20260811 06:17:08.522593 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
W20260811 06:17:08.523540 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a67daf4bdf45464b916905f432f0ec9c because the tablet was not found. No further retry: Not found: Tablet not found: a67daf4bdf45464b916905f432f0ec9c
W20260811 06:17:08.523916 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a4a46cec25944310a838d8323b119883 because the tablet was not found. No further retry: Not found: Tablet not found: a4a46cec25944310a838d8323b119883
W20260811 06:17:08.524173 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6dee9af5a4504b8284c9150298ab3462 because the tablet was not found. No further retry: Not found: Tablet not found: 6dee9af5a4504b8284c9150298ab3462
W20260811 06:17:08.524523 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:08.524788 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7db813cbb8f74b329015b163ebd58c00 because the tablet was not found. No further retry: Not found: Tablet not found: 7db813cbb8f74b329015b163ebd58c00
W20260811 06:17:08.525190 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because the tablet was not found. No further retry: Not found: Tablet not found: 1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:08.529078 12726 ts_tablet_manager.cc:1918] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.529232 12726 log.cc:1196] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a67daf4bdf45464b916905f432f0ec9c
I20260811 06:17:08.529531 12726 ts_tablet_manager.cc:1939] T a67daf4bdf45464b916905f432f0ec9c P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:08.531085 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 97) took 6027 ms. Trace:
I20260811 06:17:08.531185 12726 rpcz_store.cc:276] 0811 06:17:02.503254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.503304 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:08.154649 (+5651345us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:17:08.171469 (+ 16820us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.377854 (+206385us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.528957 (+151103us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.531061 (+ 2104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5607330}
I20260811 06:17:08.533494 11361 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.535096 11361 ts_tablet_manager.cc:1397] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.007s
I20260811 06:17:08.540230 12728 ts_tablet_manager.cc:1905] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.541662 11362 tablet_bootstrap.cc:492] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:08.541898 11362 ts_tablet_manager.cc:1397] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.116s user 0.012s sys 0.000s
I20260811 06:17:08.543123 11362 raft_consensus.cc:348] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.543444 11362 raft_consensus.cc:374] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.543550 11362 raft_consensus.cc:729] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.543819 11362 consensus_queue.cc:260] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.545416 11361 raft_consensus.cc:348] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.549755 12728 ts_tablet_manager.cc:1918] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.549873 12728 log.cc:1196] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:08.549140 11361 raft_consensus.cc:374] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.550125 12728 ts_tablet_manager.cc:1939] T f5ad5529d4844f61b0888624e7c8b3ce P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:08.550362 11361 raft_consensus.cc:729] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.551158 11362 ts_tablet_manager.cc:1428] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:08.553005 11361 consensus_queue.cc:260] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.555862 12728 tablet_replica.cc:330] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.556146 12728 raft_consensus.cc:2229] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.556294 12728 raft_consensus.cc:2258] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.557042 12728 ts_tablet_manager.cc:1905] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.531744 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a67daf4bdf45464b916905f432f0ec9c (table default.Table_0ba41638313a4d03b85b8ddac01ce6eb [id=65bf032e717442739e4e712f716e0fb8]) successfully deleted
I20260811 06:17:08.554555 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet f5ad5529d4844f61b0888624e7c8b3ce (table default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]) successfully deleted
W20260811 06:17:08.562501 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
W20260811 06:17:08.562798 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because the tablet was not found. No further retry: Not found: Tablet not found: a0e5b4cdeb464861ada487eeb1b901a6
W20260811 06:17:08.563145 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
W20260811 06:17:08.563678 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
W20260811 06:17:08.564033 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45ebef95922f4e7f93533b54c07b7cec because the tablet was not found. No further retry: Not found: Tablet not found: 45ebef95922f4e7f93533b54c07b7cec
W20260811 06:17:08.564280 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52953438e7c248b1a758ee219405d7da because the tablet was not found. No further retry: Not found: Tablet not found: 52953438e7c248b1a758ee219405d7da
W20260811 06:17:08.564550 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78d94d27431a4d5e93f1c1ce8c7b6752 already in progress: creating tablet
W20260811 06:17:08.564824 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 already in progress: creating tablet
W20260811 06:17:08.565143 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52543aa31a1749d1a0fd5e48cbe30889 because the tablet was not found. No further retry: Not found: Tablet not found: 52543aa31a1749d1a0fd5e48cbe30889
W20260811 06:17:08.565411 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:08.567027 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
W20260811 06:17:08.567414 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because the tablet was not found. No further retry: Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
W20260811 06:17:08.567807 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because the tablet was not found. No further retry: Not found: Tablet not found: 2f243c792a634abf83484aef820dbb48
W20260811 06:17:08.568267 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:08.567771 11361 ts_tablet_manager.cc:1428] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
W20260811 06:17:08.568715 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:08.569057 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6c706bf0455341a0a953d937f9778b5f because the tablet was not found. No further retry: Not found: Tablet not found: 6c706bf0455341a0a953d937f9778b5f
W20260811 06:17:08.569398 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:08.525431 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because the tablet was not found. No further retry: Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
W20260811 06:17:08.569998 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 44486.5us
W20260811 06:17:08.570356 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet adc2d99019384c33840f16cbe98d336c because the tablet was not found. No further retry: Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
W20260811 06:17:08.570757 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
W20260811 06:17:08.571063 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516021603ee24b3f9bdffd1e30e5ea9d because the tablet was not found. No further retry: Not found: Tablet not found: 516021603ee24b3f9bdffd1e30e5ea9d
W20260811 06:17:08.571401 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7a00b0b51f574bfb843b65c0876ab4fc because the tablet was not found. No further retry: Not found: Tablet not found: 7a00b0b51f574bfb843b65c0876ab4fc
W20260811 06:17:08.571700 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 006d3214480c47babe390496b335de70 because the tablet was not found. No further retry: Not found: Tablet not found: 006d3214480c47babe390496b335de70
I20260811 06:17:08.572153 11362 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:08.572156 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet fe5eea681072477ab52a822d721629cf because the tablet was not found. No further retry: Not found: Tablet not found: fe5eea681072477ab52a822d721629cf
W20260811 06:17:08.572662 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet dc6254bf781740019c3f71b26179f25d because the tablet was not found. No further retry: Not found: Tablet not found: dc6254bf781740019c3f71b26179f25d
W20260811 06:17:08.573292 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f12c8618198f4413b2727d04f850a10f because the tablet was not found. No further retry: Not found: Tablet not found: f12c8618198f4413b2727d04f850a10f
I20260811 06:17:08.576155 11362 tablet_bootstrap.cc:654] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.533165 13495 raft_consensus.cc:482] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.579404 13495 raft_consensus.cc:504] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.580147 13495 leader_election.cc:288] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.531551 12726 tablet_replica.cc:330] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:08.580734 12726 raft_consensus.cc:2229] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.580680 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.581064 12726 raft_consensus.cc:2258] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.582319 11361 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.583720 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.584388 10564 leader_election.cc:341] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:08.584582 10555 leader_election.cc:341] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.584684 10555 leader_election.cc:302] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.589493 13495 raft_consensus.cc:2726] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.591777 13494 raft_consensus.cc:482] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.591943 13494 raft_consensus.cc:504] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.592548 13494 leader_election.cc:288] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:08.592985 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.593488 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.593677 10564 leader_election.cc:341] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.594573 11362 tablet_bootstrap.cc:492] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
W20260811 06:17:08.594651 10555 leader_election.cc:341] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.594704 11362 ts_tablet_manager.cc:1397] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.011s
I20260811 06:17:08.594774 10555 leader_election.cc:302] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.595202 13494 consensus_queue.cc:1035] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.595655 13494 raft_consensus.cc:2726] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.596527 11362 raft_consensus.cc:348] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.596763 11362 raft_consensus.cc:374] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.596828 11362 raft_consensus.cc:729] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.597024 11362 consensus_queue.cc:260] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.597568 11362 ts_tablet_manager.cc:1428] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:08.597846 11362 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:08.598861 12726 ts_tablet_manager.cc:1905] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.600401 11362 tablet_bootstrap.cc:654] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.600663 11365 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.601356 11365 ts_tablet_manager.cc:1397] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.170s user 0.020s sys 0.013s
I20260811 06:17:08.604959 11365 raft_consensus.cc:348] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.606172 11365 raft_consensus.cc:374] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.606487 11365 raft_consensus.cc:729] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.607774 12728 ts_tablet_manager.cc:1918] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:08.607911 12728 log.cc:1196] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/532208d7a02d448e8dac702ffe6c2ffc
I20260811 06:17:08.608197 12728 ts_tablet_manager.cc:1939] T 532208d7a02d448e8dac702ffe6c2ffc P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:08.608562 11365 consensus_queue.cc:260] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.612447 11365 ts_tablet_manager.cc:1428] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.010s user 0.000s sys 0.005s
I20260811 06:17:08.613644 11365 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:08.573698 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 227bc4fd6cd84e5eb2043c52f95d606d (table default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]) successfully deleted
W20260811 06:17:08.617189 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because the tablet was not found. No further retry: Not found: Tablet not found: 6119212ae4be4204852a5d9437dcee72
W20260811 06:17:08.617758 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
W20260811 06:17:08.598109 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 90) took 2060 ms (client timeout 1000 ms). Trace:
W20260811 06:17:08.618355 11663 rpcz_store.cc:269] 0811 06:17:06.537464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.931135 (+393671us) service_pool.cc:227] Handling call
0811 06:17:08.597957 (+1666822us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:07.639391 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:07.639533 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:07.639542 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:07.639546 (+ 4us) tablet.cc:660] Decoding operations
0811 06:17:07.639686 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:07.639703 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:07.639709 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:07.639787 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:07.639789 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:07.639837 (+ 48us) write_op.cc:270] Start()
0811 06:17:07.639889 (+ 52us) write_op.cc:276] Timestamp: P: 1786429027639786 usec, L: 0
0811 06:17:07.639895 (+ 6us) op_driver.cc:331] REPLICATION: starting
0811 06:17:07.640140 (+ 245us) log.cc:842] Serialized 530 byte log entry
0811 06:17:07.652410 (+ 12270us) op_driver.cc:444] REPLICATION: finished
0811 06:17:07.652526 (+ 116us) write_op.cc:301] APPLY: starting
0811 06:17:07.652543 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:07.652586 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:07.652613 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:07.652671 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:07.652704 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:07.652710 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:07.652809 (+ 99us) log.cc:842] Serialized 23 byte log entry
0811 06:17:07.652885 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.652910 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:07.652918 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:07.652980 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:07.652984 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2639,"reported_tablets":213,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":512,"apply.run_wall_time_us":511,"num_ops":1,"prepare.queue_time_us":16805,"prepare.run_cpu_time_us":886,"prepare.run_wall_time_us":887,"raft.queue_time_us":504,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":269,"replication_time_us":12475}]]}
I20260811 06:17:08.622409 11365 tablet_bootstrap.cc:654] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.629964 12728 tablet_replica.cc:330] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.630224 12728 raft_consensus.cc:2229] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:08.631425 11361 tablet_bootstrap.cc:654] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.608811 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 532208d7a02d448e8dac702ffe6c2ffc (table default.Table_df5cfd277a4d425a84441c5670b812f5 [id=2dc255377ce1455a8205f78dd89214ee]) successfully deleted
I20260811 06:17:08.633126 12728 raft_consensus.cc:2258] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.639770 12726 ts_tablet_manager.cc:1918] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260811 06:17:08.640219 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 37e73b8798b2455baf642abc532a5d8c because the tablet was not found. No further retry: Not found: Tablet not found: 37e73b8798b2455baf642abc532a5d8c
W20260811 06:17:08.640738 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3250276181a24e58a2db92376b7520e7 because the tablet was not found. No further retry: Not found: Tablet not found: 3250276181a24e58a2db92376b7520e7
W20260811 06:17:08.642098 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6c62cbef937a46dfbc4dbf934e887139 because the tablet was not found. No further retry: Not found: Tablet not found: 6c62cbef937a46dfbc4dbf934e887139
W20260811 06:17:08.642457 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f12c8618198f4413b2727d04f850a10f because the tablet was not found. No further retry: Not found: Tablet not found: f12c8618198f4413b2727d04f850a10f
W20260811 06:17:08.642880 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7fbdda840466420f8d67a8cb5868ba03 because the tablet was not found. No further retry: Not found: Tablet not found: 7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:08.648737 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:08.608340 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:08.649355 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:08.658871 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:08.659808 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
W20260811 06:17:08.660485 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 58fdb5920003438d983987ff242f6dce because the tablet was not found. No further retry: Not found: Tablet not found: 58fdb5920003438d983987ff242f6dce
I20260811 06:17:08.661151 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:08.661461 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:08.664616 11679 catalog_manager.cc:5495] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } }
I20260811 06:17:08.665299 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:08.666111 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:08.672230 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:08.680016 12728 ts_tablet_manager.cc:1905] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.681583 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
W20260811 06:17:08.666318 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because the tablet was not found. No further retry: Not found: Tablet not found: f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:17:08.683952 11156 raft_consensus.cc:3037] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:08.683279 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7fbdda840466420f8d67a8cb5868ba03 because the tablet was not found. No further retry: Not found: Tablet not found: 7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:08.689939 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 5ca903ee846a4e5baf3dbb4302607c1f (table default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]) successfully deleted
W20260811 06:17:08.690409 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f88af70bbada49309a0e7cc7c333d6f0 because the tablet was not found. No further retry: Not found: Tablet not found: f88af70bbada49309a0e7cc7c333d6f0
W20260811 06:17:08.690811 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 16674be53bd54f9395b650e19edd3cf4 because the tablet was not found. No further retry: Not found: Tablet not found: 16674be53bd54f9395b650e19edd3cf4
W20260811 06:17:08.691174 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2875318863584e659e2b76ad2a72ca45 because the tablet was not found. No further retry: Not found: Tablet not found: 2875318863584e659e2b76ad2a72ca45
W20260811 06:17:08.691481 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 847df543db4244a6b2900fc16fea7c07 because the tablet was not found. No further retry: Not found: Tablet not found: 847df543db4244a6b2900fc16fea7c07
W20260811 06:17:08.691869 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5119e9bb88844329aea123dc3805d91d because the tablet was not found. No further retry: Not found: Tablet not found: 5119e9bb88844329aea123dc3805d91d
W20260811 06:17:08.692240 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1e42440ff14857b297621ca6031835 because the tablet was not found. No further retry: Not found: Tablet not found: ae1e42440ff14857b297621ca6031835
W20260811 06:17:08.692713 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ab32f96671984766a54b5ee904c465f7 because the tablet was not found. No further retry: Not found: Tablet not found: ab32f96671984766a54b5ee904c465f7
W20260811 06:17:08.693099 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because the tablet was not found. No further retry: Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:08.699143 12726 log.cc:1196] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:08.688823 13494 consensus_queue.cc:1035] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.703756 11361 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.703944 11361 ts_tablet_manager.cc:1397] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.122s user 0.002s sys 0.005s
I20260811 06:17:08.706454 11361 raft_consensus.cc:348] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.717914 11361 raft_consensus.cc:374] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.718014 11361 raft_consensus.cc:729] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.718294 11361 consensus_queue.cc:260] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.719142 11361 ts_tablet_manager.cc:1428] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260811 06:17:08.722115 11361 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.699790 12726 ts_tablet_manager.cc:1939] T f5ad5529d4844f61b0888624e7c8b3ce P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:08.708989 13494 raft_consensus.cc:482] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.702335 11365 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:08.727186 11365 ts_tablet_manager.cc:1397] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.114s user 0.007s sys 0.019s
I20260811 06:17:08.727119 13494 raft_consensus.cc:504] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:08.727413 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
W20260811 06:17:08.727871 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because the tablet was not found. No further retry: Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:08.728057 13494 leader_election.cc:288] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:08.728230 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
W20260811 06:17:08.729069 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b0cdc826a1d8460aba1aae684c13131d because the tablet was not found. No further retry: Not found: Tablet not found: b0cdc826a1d8460aba1aae684c13131d
W20260811 06:17:08.729838 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3025339a6c9e4e07bba4104006206bb8 because the tablet was not found. No further retry: Not found: Tablet not found: 3025339a6c9e4e07bba4104006206bb8
W20260811 06:17:08.730268 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:08.732544 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:08.732853 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:08.732848 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.733652 10555 leader_election.cc:341] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.734730 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:08.735121 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:08.735670 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 99) took 6184 ms. Trace:
I20260811 06:17:08.736055 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:08.736617 11679 catalog_manager.cc:5495] T eb437660103845aa98af100aef1c3021 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } }
I20260811 06:17:08.737602 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:08.744328 11365 raft_consensus.cc:348] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.744542 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.744867 11365 raft_consensus.cc:374] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.745080 11365 raft_consensus.cc:729] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.744789 12726 rpcz_store.cc:276] 0811 06:17:02.551325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.551446 (+ 121us) service_pool.cc:227] Handling call
0811 06:17:08.531505 (+5980059us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:17:08.531516 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.636028 (+104512us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.639627 (+ 3599us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.735546 (+ 95919us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5933045}
W20260811 06:17:08.745450 10564 leader_election.cc:341] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.745365 11365 consensus_queue.cc:260] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:08.745627 10564 leader_election.cc:302] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.746028 11362 tablet_bootstrap.cc:492] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:08.746011 11365 ts_tablet_manager.cc:1428] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.002s sys 0.001s
I20260811 06:17:08.746160 11362 ts_tablet_manager.cc:1397] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.148s user 0.074s sys 0.059s
I20260811 06:17:08.746371 11365 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:08.746970 11362 raft_consensus.cc:348] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.747254 11362 raft_consensus.cc:374] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.747329 11362 raft_consensus.cc:729] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.747342 13494 raft_consensus.cc:2726] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.747548 11362 consensus_queue.cc:260] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.748131 11362 ts_tablet_manager.cc:1428] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:08.749379 11362 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:08.757174 11362 tablet_bootstrap.cc:654] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.760061 12726 tablet_replica.cc:330] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:08.766434 12726 raft_consensus.cc:2229] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.768589 11362 tablet_bootstrap.cc:492] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:08.768857 11362 ts_tablet_manager.cc:1397] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260811 06:17:08.770282 11362 raft_consensus.cc:348] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.770746 11362 raft_consensus.cc:374] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.770856 11362 raft_consensus.cc:729] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.771183 11362 consensus_queue.cc:260] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.772418 11362 ts_tablet_manager.cc:1428] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:08.773607 11362 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:08.776233 12726 raft_consensus.cc:2258] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:08.776352 13571 raft_consensus.cc:482] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.776616 13571 raft_consensus.cc:504] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.777366 13571 leader_election.cc:288] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.780318 11362 tablet_bootstrap.cc:654] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.780612 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.746286 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f5ad5529d4844f61b0888624e7c8b3ce (table default.Table_29c22b2f708149d4a6421f424db0e8da [id=d38690ffff694cf384a1a37101ea5cec]) successfully deleted
I20260811 06:17:08.783850 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:08.784976 11361 tablet_bootstrap.cc:654] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.786293 13571 raft_consensus.cc:482] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.786440 13571 raft_consensus.cc:504] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.786995 13571 leader_election.cc:288] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.781181 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4dba9d9bb4f278b5a43c124c7b509" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.788298 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.788493 10654 raft_consensus.cc:2454] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:08.788981 10810 leader_election.cc:302] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.789208 13571 raft_consensus.cc:2726] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.789356 10810 leader_election.cc:302] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:08.789537 13571 raft_consensus.cc:2781] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:08.789606 13571 raft_consensus.cc:482] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:08.789659 13571 raft_consensus.cc:3037] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.793064 13571 raft_consensus.cc:504] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.794049 11365 tablet_bootstrap.cc:654] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.794296 13571 leader_election.cc:288] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.795151 12726 ts_tablet_manager.cc:1905] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:08.798148 11679 catalog_manager.cc:5495] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:08.787719 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.799778 11161 raft_consensus.cc:2454] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:08.789955 12484 raft_consensus.cc:482] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.800117 12484 raft_consensus.cc:504] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.800884 12484 leader_election.cc:288] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:08.800966 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:08.801451 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:08.804486 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:08.805384 11047 leader_election.cc:341] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.805593 13306 consensus_queue.cc:1035] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:08.806763 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:08.807652 13567 raft_consensus.cc:482] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.807790 13567 raft_consensus.cc:504] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.808395 13567 leader_election.cc:288] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:08.809566 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:08.797031 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:08.810568 11156 raft_consensus.cc:3037] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.810532 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:08.810906 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:08.811378 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:08.811719 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:08.812449 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:08.812847 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:08.813210 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:08.813441 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:08.814563 11156 raft_consensus.cc:2454] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:08.815480 10813 leader_election.cc:302] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:08.815811 13571 raft_consensus.cc:2781] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:08.816033 13571 raft_consensus.cc:686] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:08.816285 13571 consensus_queue.cc:237] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.824922 11361 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.825307 11361 ts_tablet_manager.cc:1397] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.103s user 0.006s sys 0.000s
I20260811 06:17:08.826102 12728 ts_tablet_manager.cc:1918] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:08.796432 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cec2c3e143a4834a07aef7a31340d9c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:08.801894 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.809195 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4d5c19d1aa486fa6415907628e6f57" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:08.826925 10654 raft_consensus.cc:3037] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.826937 10651 raft_consensus.cc:2454] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:08.827780 11046 leader_election.cc:302] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:08.829406 13306 raft_consensus.cc:2781] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:08.829517 13306 raft_consensus.cc:482] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:08.829674 13306 raft_consensus.cc:3037] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.830749 10654 raft_consensus.cc:2454] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:08.826644 11361 raft_consensus.cc:348] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.831595 11361 raft_consensus.cc:374] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.831794 11361 raft_consensus.cc:729] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.832273 11361 consensus_queue.cc:260] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.833110 11361 ts_tablet_manager.cc:1428] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 06:17:08.834765 11361 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.835003 13306 raft_consensus.cc:504] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.842901 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:08.843194 10654 raft_consensus.cc:3037] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:08.846302 10654 raft_consensus.cc:2454] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:08.813697 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:08.848263 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:08.848802 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:08.849824 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:08.851167 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:08.851560 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:08.857470 11046 leader_election.cc:302] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:08.857992 12484 raft_consensus.cc:2781] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:08.859954 12728 log.cc:1196] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/217f60a1ca044af38f9ee9093e021c27
I20260811 06:17:08.830121 10810 leader_election.cc:302] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.843467 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:08.860405 13567 raft_consensus.cc:2726] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.861999 12484 raft_consensus.cc:686] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:08.862751 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:08.863837 12728 ts_tablet_manager.cc:1939] T 217f60a1ca044af38f9ee9093e021c27 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:08.863999 12484 consensus_queue.cc:237] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.865548 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
W20260811 06:17:08.865674 11047 leader_election.cc:341] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:08.866650 11361 tablet_bootstrap.cc:654] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:08.867143 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:08.867411 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:08.869580 13306 leader_election.cc:288] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:08.871080 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:08.873497 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:08.875528 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:08.875988 13567 raft_consensus.cc:482] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:08.876322 13567 raft_consensus.cc:504] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.877120 13567 leader_election.cc:288] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:08.878741 10810 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
W20260811 06:17:08.880668 10813 leader_election.cc:341] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:08.880848 10813 leader_election.cc:302] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:08.881755 13567 raft_consensus.cc:2726] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:08.883798 13074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Bootstrap replaying log segment 1/1 (220.6K/253.5K this segment, stats: ops{read=492 overwritten=0 applied=492 ignored=0} inserts{seen=466 ignored=0} mutations{seen=556 ignored=0} orphaned_commits=0)
I20260811 06:17:08.888033 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 228) took 1106 ms. Trace:
I20260811 06:17:08.889262 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:08.894982 11683 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 72) took 5388 ms. Trace:
I20260811 06:17:08.895193 11683 rpcz_store.cc:276] 0811 06:17:03.506872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.380413 (+4873541us) service_pool.cc:227] Handling call
0811 06:17:08.454424 (+ 74011us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f97527 00007f3e4b289da7 00007f3e4b289ad5 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:08.894920 (+440496us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":165463424}
I20260811 06:17:08.903954 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:08.923619 12728 rpcz_store.cc:276] 0811 06:17:07.781876 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.781921 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:08.629907 (+847986us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:08.629916 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.712616 (+ 82700us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.825962 (+113346us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:08.887928 (+ 61966us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":845123}
I20260811 06:17:08.924273 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 217f60a1ca044af38f9ee9093e021c27 (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:17:08.933089 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:08.937273 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 230) took 1142 ms. Trace:
I20260811 06:17:08.943821 12728 rpcz_store.cc:276] 0811 06:17:07.782688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.782787 (+ 99us) service_pool.cc:227] Handling call
0811 06:17:08.924744 (+1141957us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:17:08.924761 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.924870 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139827}
W20260811 06:17:08.944577 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 006d3214480c47babe390496b335de70 because the tablet was not found. No further retry: Not found: Tablet not found: 006d3214480c47babe390496b335de70
I20260811 06:17:08.944823 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 1649493bd0924ee48fd5044d7288932d
I20260811 06:17:08.945171 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 232) took 1161 ms. Trace:
I20260811 06:17:08.945470 11655 catalog_manager.cc:6565] ReplaceTablet: tablet 1649493bd0924ee48fd5044d7288932d deleted and replaced by tablet 990e3308157d4edbb2ba8744a09d0b06
I20260811 06:17:08.945361 12728 rpcz_store.cc:276] 0811 06:17:07.783290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.783342 (+ 52us) service_pool.cc:227] Handling call
0811 06:17:08.944931 (+1161589us) ts_tablet_manager.cc:1145] Deleting tablet 22cac1c339574b1fa26555b18811539b
0811 06:17:08.944943 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.945020 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159912}
I20260811 06:17:08.945636 11655 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 74) took 4871 ms. Trace:
I20260811 06:17:08.946036 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 233) took 1162 ms. Trace:
I20260811 06:17:08.946143 12728 rpcz_store.cc:276] 0811 06:17:07.783521 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.783561 (+ 40us) service_pool.cc:227] Handling call
0811 06:17:08.945811 (+1162250us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:17:08.945823 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.945889 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1160689}
I20260811 06:17:08.945863 11655 rpcz_store.cc:276] 0811 06:17:04.074413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.442036 (+4367623us) service_pool.cc:227] Handling call
0811 06:17:08.463477 (+ 21441us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f97527 00007f3e4b289da7 00007f3e4b289ad5 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:08.945557 (+482080us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.937672 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.937812 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.937818 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:08.937820 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.937933 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.937949 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.937954 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.938042 (+ 88us) tablet.cc:699] Row locks acquired
0811 06:17:08.938045 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.938085 (+ 40us) write_op.cc:270] Start()
0811 06:17:08.938117 (+ 32us) write_op.cc:276] Timestamp: P: 1786429028938050 usec, L: 0
0811 06:17:08.938120 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.938302 (+ 182us) log.cc:842] Serialized 625 byte log entry
0811 06:17:08.943706 (+ 5404us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.943818 (+ 112us) write_op.cc:301] APPLY: starting
0811 06:17:08.943834 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.943879 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.943906 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.944013 (+ 107us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.944130 (+ 117us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:08.944136 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.944225 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.944293 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.944315 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:08.944322 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.944380 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.944383 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":26108288,"child_traces":[["op",{"apply.queue_time_us":62,"apply.run_cpu_time_us":631,"apply.run_wall_time_us":630,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":746,"raft.queue_time_us":57,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":342,"replication_time_us":5552}]]}
I20260811 06:17:08.947127 12728 tablet_replica.cc:330] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:08.947363 12728 raft_consensus.cc:2229] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:08.947585 12728 raft_consensus.cc:2258] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:08.948021 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 22cac1c339574b1fa26555b18811539b because the tablet was not found. No further retry: Not found: Tablet not found: 22cac1c339574b1fa26555b18811539b
I20260811 06:17:08.948203 12728 ts_tablet_manager.cc:1905] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:08.948374 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dc6254bf781740019c3f71b26179f25d because the tablet was not found. No further retry: Not found: Tablet not found: dc6254bf781740019c3f71b26179f25d
I20260811 06:17:08.948827 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:08.952003 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:08.954726 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:08.954875 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:08.963097 11361 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:08.963382 11361 ts_tablet_manager.cc:1397] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.004s
I20260811 06:17:08.964707 11361 raft_consensus.cc:348] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.965181 11361 raft_consensus.cc:374] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:08.965494 11361 raft_consensus.cc:729] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:08.965896 11361 consensus_queue.cc:260] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:08.966727 11361 ts_tablet_manager.cc:1428] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:08.968099 11361 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:08.970952 11361 tablet_bootstrap.cc:654] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.005439 12726 ts_tablet_manager.cc:1918] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:09.005611 12726 log.cc:1196] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:17:09.006034 12726 ts_tablet_manager.cc:1939] T f9fd17e8c6264f898493c15b0aa5518d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.006548 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 100) took 6453 ms. Trace:
I20260811 06:17:09.010990 11362 tablet_bootstrap.cc:492] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.014413 11362 ts_tablet_manager.cc:1397] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.239s user 0.028s sys 0.101s
I20260811 06:17:09.028349 12726 rpcz_store.cc:276] 0811 06:17:02.552612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.552666 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:08.745548 (+6192882us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:17:08.745561 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:08.884587 (+139026us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.005298 (+120711us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.006526 (+ 1228us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6146494}
I20260811 06:17:09.028954 11362 raft_consensus.cc:348] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.018666 11365 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.029491 11365 ts_tablet_manager.cc:1397] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.283s user 0.040s sys 0.062s
I20260811 06:17:09.030014 12726 tablet_replica.cc:330] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.030151 11362 raft_consensus.cc:374] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.030200 11365 raft_consensus.cc:348] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.030408 11365 raft_consensus.cc:374] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.030469 11365 raft_consensus.cc:729] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.030509 11362 raft_consensus.cc:729] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.030668 11365 consensus_queue.cc:260] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.031989 11365 ts_tablet_manager.cc:1428] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:09.032598 11365 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.037269 11365 tablet_bootstrap.cc:654] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.039059 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f9fd17e8c6264f898493c15b0aa5518d (table default.Table_9acf8fc7ef294818b6d7ef52993c33ff [id=994dbd3637fa47e393eced0b9503ab78]) successfully deleted
I20260811 06:17:08.996451 13306 consensus_queue.cc:1035] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:09.036378 13282 raft_consensus.cc:482] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.039994 13282 raft_consensus.cc:504] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.040657 13282 leader_election.cc:288] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.041829 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f
I20260811 06:17:09.042307 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:09.042531 10651 raft_consensus.cc:2454] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:09.042618 12728 ts_tablet_manager.cc:1918] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.042739 12728 log.cc:1196] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:09.043057 12728 ts_tablet_manager.cc:1939] T 227bc4fd6cd84e5eb2043c52f95d606d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:09.043883 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 234) took 1260 ms. Trace:
I20260811 06:17:09.043983 12728 rpcz_store.cc:276] 0811 06:17:07.783755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.783811 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:08.946472 (+1162661us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:17:08.946483 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.030789 (+ 84306us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.042499 (+ 11710us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.043861 (+ 1362us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161258}
I20260811 06:17:09.044395 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 235) took 1260 ms. Trace:
I20260811 06:17:09.044445 11046 leader_election.cc:302] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:09.044480 12728 rpcz_store.cc:276] 0811 06:17:07.784099 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.784159 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:09.044291 (+1260132us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:17:09.044303 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.044379 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258986}
I20260811 06:17:09.044538 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 227bc4fd6cd84e5eb2043c52f95d606d (table default.Table_7e17eee1017d48ceb5c1208f05e8cc53 [id=30df481672974502880798413ffb48d3]) successfully deleted
I20260811 06:17:09.044770 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 231) took 1261 ms. Trace:
I20260811 06:17:09.044859 12728 rpcz_store.cc:276] 0811 06:17:07.783030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.783072 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:09.044692 (+1261620us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:17:09.044703 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.044756 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259273}
I20260811 06:17:09.044945 13282 raft_consensus.cc:2781] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:09.045047 13282 raft_consensus.cc:482] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:09.045120 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 227) took 1263 ms. Trace:
I20260811 06:17:09.045148 13282 raft_consensus.cc:3037] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.045190 12728 rpcz_store.cc:276] 0811 06:17:07.781663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.781704 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:09.045043 (+1263339us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:17:09.045053 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.045107 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259523}
I20260811 06:17:09.045570 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 229) took 1263 ms. Trace:
W20260811 06:17:09.046186 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6dee9af5a4504b8284c9150298ab3462 because the tablet was not found. No further retry: Not found: Tablet not found: 6dee9af5a4504b8284c9150298ab3462
W20260811 06:17:09.046494 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2875318863584e659e2b76ad2a72ca45 because the tablet was not found. No further retry: Not found: Tablet not found: 2875318863584e659e2b76ad2a72ca45
W20260811 06:17:09.046728 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because the tablet was not found. No further retry: Not found: Tablet not found: f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:17:09.047943 13282 raft_consensus.cc:504] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.049355 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:09.049571 10651 raft_consensus.cc:3037] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.045656 12728 rpcz_store.cc:276] 0811 06:17:07.782053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.782094 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:09.045480 (+1263386us) ts_tablet_manager.cc:1145] Deleting tablet 16674be53bd54f9395b650e19edd3cf4
0811 06:17:09.045492 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.045552 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259865}
I20260811 06:17:09.052178 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 224) took 1271 ms. Trace:
I20260811 06:17:09.052280 12728 rpcz_store.cc:276] 0811 06:17:07.781098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.781142 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:09.052005 (+1270863us) ts_tablet_manager.cc:1145] Deleting tablet 1349b0ea48b848398d4bdda528358c30
0811 06:17:09.052021 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.052158 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266311}
W20260811 06:17:09.052341 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 16674be53bd54f9395b650e19edd3cf4 because the tablet was not found. No further retry: Not found: Tablet not found: 16674be53bd54f9395b650e19edd3cf4
I20260811 06:17:09.052443 10651 raft_consensus.cc:2454] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:09.052598 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 225) took 1271 ms. Trace:
I20260811 06:17:09.052675 12728 rpcz_store.cc:276] 0811 06:17:07.781337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.781385 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:09.052517 (+1271132us) ts_tablet_manager.cc:1145] Deleting tablet b0d203f652b24b4897e62fc8c03d32df
0811 06:17:09.052526 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.052584 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266316}
I20260811 06:17:09.052961 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 238) took 1134 ms. Trace:
W20260811 06:17:09.052958 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:09.053043 12728 rpcz_store.cc:276] 0811 06:17:07.918452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.918516 (+ 64us) service_pool.cc:227] Handling call
0811 06:17:09.052884 (+1134368us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:09.052894 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.052947 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134141}
I20260811 06:17:09.053333 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 239) took 1134 ms. Trace:
I20260811 06:17:09.053408 12728 rpcz_store.cc:276] 0811 06:17:07.918864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.918907 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:09.053231 (+1134324us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:09.053240 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.053320 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134161}
W20260811 06:17:09.053460 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b0d203f652b24b4897e62fc8c03d32df because the tablet was not found. No further retry: Not found: Tablet not found: b0d203f652b24b4897e62fc8c03d32df
I20260811 06:17:09.053504 11046 leader_election.cc:302] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:09.053675 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 240) took 1134 ms. Trace:
I20260811 06:17:09.053764 12728 rpcz_store.cc:276] 0811 06:17:07.919259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.919301 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:09.053605 (+1134304us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:17:09.053613 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.053660 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134138}
I20260811 06:17:09.053881 13306 raft_consensus.cc:2781] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:09.054008 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 241) took 1134 ms. Trace:
I20260811 06:17:09.054028 13306 raft_consensus.cc:686] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
W20260811 06:17:09.054056 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because the tablet was not found. No further retry: Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:09.054073 12728 rpcz_store.cc:276] 0811 06:17:07.919584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.919621 (+ 37us) service_pool.cc:227] Handling call
0811 06:17:09.053937 (+1134316us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:17:09.053946 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.053996 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134168}
I20260811 06:17:09.054325 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 242) took 1134 ms. Trace:
W20260811 06:17:09.054330 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
I20260811 06:17:09.054391 12728 rpcz_store.cc:276] 0811 06:17:07.919900 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.919936 (+ 36us) service_pool.cc:227] Handling call
0811 06:17:09.054256 (+1134320us) ts_tablet_manager.cc:1145] Deleting tablet ae1e42440ff14857b297621ca6031835
0811 06:17:09.054266 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.054312 (+ 46us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134168}
I20260811 06:17:09.054314 13306 consensus_queue.cc:237] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:09.054610 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 847df543db4244a6b2900fc16fea7c07 because the tablet was not found. No further retry: Not found: Tablet not found: 847df543db4244a6b2900fc16fea7c07
I20260811 06:17:09.054649 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 243) took 1134 ms. Trace:
I20260811 06:17:09.054713 12728 rpcz_store.cc:276] 0811 06:17:07.920282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.920331 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:09.054581 (+1134250us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:17:09.054590 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.054637 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134097}
W20260811 06:17:09.055171 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5119e9bb88844329aea123dc3805d91d because the tablet was not found. No further retry: Not found: Tablet not found: 5119e9bb88844329aea123dc3805d91d
W20260811 06:17:09.055500 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1e42440ff14857b297621ca6031835 because the tablet was not found. No further retry: Not found: Tablet not found: ae1e42440ff14857b297621ca6031835
W20260811 06:17:09.055794 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ab32f96671984766a54b5ee904c465f7 because the tablet was not found. No further retry: Not found: Tablet not found: ab32f96671984766a54b5ee904c465f7
I20260811 06:17:09.057266 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.057859 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:09.058221 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:09.059345 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:09.059657 11653 catalog_manager.cc:6565] ReplaceTablet: tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f deleted and replaced by tablet 9258f70b17214a90bb0da4127dfed959
I20260811 06:17:09.059893 12944 consensus_queue.cc:1035] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:09.060083 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 244) took 1139 ms. Trace:
I20260811 06:17:09.060168 12728 rpcz_store.cc:276] 0811 06:17:07.920606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.920648 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:09.054880 (+1134232us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:17:09.054889 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.060064 (+ 5175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1134083}
I20260811 06:17:09.060531 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 245) took 1139 ms. Trace:
I20260811 06:17:09.060606 12728 rpcz_store.cc:276] 0811 06:17:07.920937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.920973 (+ 36us) service_pool.cc:227] Handling call
0811 06:17:09.060407 (+1139434us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:17:09.060419 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.060515 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139264}
I20260811 06:17:09.060875 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 246) took 1139 ms. Trace:
I20260811 06:17:09.060954 12728 rpcz_store.cc:276] 0811 06:17:07.921275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.921344 (+ 69us) service_pool.cc:227] Handling call
0811 06:17:09.060801 (+1139457us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:17:09.060810 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.060860 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139309}
I20260811 06:17:09.061035 13615 raft_consensus.cc:482] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.061205 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 247) took 1138 ms. Trace:
I20260811 06:17:09.061277 12728 rpcz_store.cc:276] 0811 06:17:07.922557 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.922594 (+ 37us) service_pool.cc:227] Handling call
0811 06:17:09.061133 (+1138539us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:17:09.061143 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.061192 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138374}
I20260811 06:17:09.061167 13615 raft_consensus.cc:504] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.061589 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 248) took 1138 ms. Trace:
I20260811 06:17:09.061669 12728 rpcz_store.cc:276] 0811 06:17:07.922951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.922993 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:09.061481 (+1138488us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:17:09.061491 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.061573 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138337}
I20260811 06:17:09.061914 11365 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.061950 13615 leader_election.cc:288] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.062335 11365 ts_tablet_manager.cc:1397] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.010s
I20260811 06:17:09.062364 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.063090 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.063282 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 249) took 1140 ms. Trace:
I20260811 06:17:09.063340 11653 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 71) took 5722 ms. Trace:
I20260811 06:17:09.063362 12728 rpcz_store.cc:276] 0811 06:17:07.923260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.923296 (+ 36us) service_pool.cc:227] Handling call
0811 06:17:09.061914 (+1138618us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:17:09.061923 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.063264 (+ 1341us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138463}
W20260811 06:17:09.063583 10564 leader_election.cc:341] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.063069 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because the tablet was not found. No further retry: Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
W20260811 06:17:09.063771 10555 leader_election.cc:341] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.063870 10555 leader_election.cc:302] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.064095 13615 raft_consensus.cc:2726] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.063920 11365 raft_consensus.cc:348] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:09.064335 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6703e639ab2042e78fadc63bd18c7602 already in progress: creating tablet
I20260811 06:17:09.064396 11365 raft_consensus.cc:374] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.064540 11365 raft_consensus.cc:729] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.063625 12728 tablet_replica.cc:330] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:09.065518 12728 raft_consensus.cc:2229] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.065773 12728 raft_consensus.cc:2258] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:09.065559 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b0cdc826a1d8460aba1aae684c13131d because the tablet was not found. No further retry: Not found: Tablet not found: b0cdc826a1d8460aba1aae684c13131d
W20260811 06:17:09.066138 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a67daf4bdf45464b916905f432f0ec9c because the tablet was not found. No further retry: Not found: Tablet not found: a67daf4bdf45464b916905f432f0ec9c
I20260811 06:17:09.065290 11365 consensus_queue.cc:260] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.066373 12728 ts_tablet_manager.cc:1905] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.068544 11365 ts_tablet_manager.cc:1428] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:09.068872 12484 raft_consensus.cc:482] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:09.069106 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:17:09.069046 12484 raft_consensus.cc:504] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:09.069408 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f9fd17e8c6264f898493c15b0aa5518d because the tablet was not found. No further retry: Not found: Tablet not found: f9fd17e8c6264f898493c15b0aa5518d
I20260811 06:17:09.069847 12484 leader_election.cc:288] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.070185 11365 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.070533 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.071833 11047 leader_election.cc:341] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.065229 11653 rpcz_store.cc:276] 0811 06:17:03.341324 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.373749 (+5032425us) service_pool.cc:227] Handling call
0811 06:17:08.464564 (+ 90815us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f97527 00007f3e4b289da7 00007f3e4b289ad5 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:09.063233 (+598669us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.974350 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.974469 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.974477 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:08.974479 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.974645 (+ 166us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.974661 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.974666 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.974758 (+ 92us) tablet.cc:699] Row locks acquired
0811 06:17:08.974761 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.974806 (+ 45us) write_op.cc:270] Start()
0811 06:17:08.974842 (+ 36us) write_op.cc:276] Timestamp: P: 1786429028974767 usec, L: 0
0811 06:17:08.974847 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.975123 (+ 276us) log.cc:842] Serialized 625 byte log entry
0811 06:17:08.980155 (+ 5032us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.980299 (+ 144us) write_op.cc:301] APPLY: starting
0811 06:17:08.980316 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.980366 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.980444 (+ 78us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.980566 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.980625 (+ 59us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:08.980631 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.980716 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.980784 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.980806 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:08.980813 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.980873 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.980877 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":195835648,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":665,"num_ops":2,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":898,"prepare.run_wall_time_us":899,"raft.queue_time_us":553,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":395,"replication_time_us":5284}]]}
I20260811 06:17:09.072501 12728 ts_tablet_manager.cc:1918] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.072623 12728 log.cc:1196] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/0dab2b8209e5401c84a187882ef21e08
I20260811 06:17:09.072909 12728 ts_tablet_manager.cc:1939] T 0dab2b8209e5401c84a187882ef21e08 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:09.073395 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:09.073486 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_aecd4ad372f24176971a2c21bd9af268" } modify_external_catalogs: true
I20260811 06:17:09.073638 10651 raft_consensus.cc:2454] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:09.073829 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_aecd4ad372f24176971a2c21bd9af268" } modify_external_catalogs: true
I20260811 06:17:09.074218 11046 leader_election.cc:302] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:09.075892 12484 raft_consensus.cc:2781] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:09.076030 12484 raft_consensus.cc:482] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:09.076115 12484 raft_consensus.cc:3037] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.079449 13282 leader_election.cc:288] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.080219 12484 raft_consensus.cc:504] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.073707 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 250) took 1150 ms. Trace:
I20260811 06:17:09.081198 11365 tablet_bootstrap.cc:654] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.079212 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.081158 12728 rpcz_store.cc:276] 0811 06:17:07.923659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.923711 (+ 52us) service_pool.cc:227] Handling call
0811 06:17:09.063583 (+1139872us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:17:09.063593 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.069458 (+ 5865us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.072391 (+ 2933us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.073687 (+ 1296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139731}
I20260811 06:17:09.083372 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:09.083666 10651 raft_consensus.cc:3037] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.083412 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 251) took 1159 ms. Trace:
I20260811 06:17:09.083847 12728 rpcz_store.cc:276] 0811 06:17:07.924018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.924057 (+ 39us) service_pool.cc:227] Handling call
0811 06:17:09.082853 (+1158796us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:09.082973 (+ 120us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.083282 (+ 309us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158536}
I20260811 06:17:09.085961 12728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51802 (request call id 253) took 1040 ms. Trace:
I20260811 06:17:09.086381 12728 rpcz_store.cc:276] 0811 06:17:08.045384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.045460 (+ 76us) service_pool.cc:227] Handling call
0811 06:17:09.085277 (+1039817us) ts_tablet_manager.cc:1145] Deleting tablet 7bcc463affbb4154877624aec28435bc
0811 06:17:09.085293 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.085840 (+ 547us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1039475}
I20260811 06:17:09.087715 10651 raft_consensus.cc:2454] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:09.088320 12484 leader_election.cc:288] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.089022 11046 leader_election.cc:302] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:09.090065 13282 raft_consensus.cc:2781] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:09.090451 13282 raft_consensus.cc:686] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:09.090775 13282 consensus_queue.cc:237] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:09.092974 11047 leader_election.cc:341] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.093122 13446 raft_consensus.cc:482] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.093269 13446 raft_consensus.cc:504] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.093935 13446 leader_election.cc:288] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.094278 10915 raft_consensus.cc:3037] T 8fb4dba9d9bb4f278b5a43c124c7b509 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.094834 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.095367 11365 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:09.095428 11047 leader_election.cc:341] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.095616 11365 ts_tablet_manager.cc:1397] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.006s
I20260811 06:17:09.097466 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152f7db9fc6241c8abfdafd3adc30d47" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:09.094278 10923 raft_consensus.cc:3037] T 4d4d5c19d1aa486fa6415907628e6f57 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.097500 11365 raft_consensus.cc:348] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.097894 11365 raft_consensus.cc:374] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.097991 11365 raft_consensus.cc:729] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:17:09.101406 11047 leader_election.cc:341] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.101123 11365 consensus_queue.cc:260] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.102293 11365 ts_tablet_manager.cc:1428] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260811 06:17:09.102802 11365 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.105541 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:09.105918 13615 raft_consensus.cc:482] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.106050 13615 raft_consensus.cc:504] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.106655 13615 leader_election.cc:288] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:09.106946 11047 leader_election.cc:341] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.107750 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "035eee1d37c94471a7cd697fb0fbb951" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.108423 11365 tablet_bootstrap.cc:654] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:09.108588 10564 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.109625 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "035eee1d37c94471a7cd697fb0fbb951" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.114449 13615 raft_consensus.cc:482] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.114620 13615 raft_consensus.cc:504] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.115237 13615 leader_election.cc:288] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.116240 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.117326 10564 leader_election.cc:341] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.119087 11588 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6dd4a21086934bd9a64d74075ab41fbe consensus state has no leader
I20260811 06:17:09.119514 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 0dab2b8209e5401c84a187882ef21e08 (table default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]) successfully deleted
I20260811 06:17:09.118106 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.120209 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because the tablet was not found. No further retry: Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0
W20260811 06:17:09.120548 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
W20260811 06:17:09.120532 10555 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.120649 10555 leader_election.cc:302] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.120884 13615 raft_consensus.cc:2726] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:09.121235 10555 leader_election.cc:341] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.121362 10555 leader_election.cc:302] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:09.121315 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
I20260811 06:17:09.121465 11365 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.121587 13615 raft_consensus.cc:2726] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.121681 11365 ts_tablet_manager.cc:1397] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.003s
W20260811 06:17:09.122143 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because the tablet was not found. No further retry: Not found: Tablet not found: a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:09.122491 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:09.122713 10651 raft_consensus.cc:2454] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:09.123085 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because the tablet was not found. No further retry: Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:09.123152 11046 leader_election.cc:302] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:09.123489 11365 raft_consensus.cc:348] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.123883 11365 raft_consensus.cc:374] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.123987 11365 raft_consensus.cc:729] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.124050 12484 raft_consensus.cc:2781] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:09.124151 12484 raft_consensus.cc:482] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:09.124323 12484 raft_consensus.cc:3037] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.124320 11365 consensus_queue.cc:260] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.125360 11365 ts_tablet_manager.cc:1428] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 06:17:09.125830 11365 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.128981 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 37a6567096154824babea5bceb94fe6e (DEFAULT_TABLE table=default.Table_6bcb4312fec24752b2859b4d7b738495 [id=3de9225de1ea40bfb304f7abae7c7a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.129410 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a6567096154824babea5bceb94fe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.129885 11365 tablet_bootstrap.cc:654] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.139824 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 37a6567096154824babea5bceb94fe6e (DEFAULT_TABLE table=default.Table_6bcb4312fec24752b2859b4d7b738495 [id=3de9225de1ea40bfb304f7abae7c7a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.140355 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a6567096154824babea5bceb94fe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.141357 11365 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.141577 11365 ts_tablet_manager.cc:1397] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260811 06:17:09.143301 11365 raft_consensus.cc:348] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.143683 11365 raft_consensus.cc:374] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.143775 11365 raft_consensus.cc:729] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.144116 11365 consensus_queue.cc:260] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.145181 11365 ts_tablet_manager.cc:1428] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:09.145687 11365 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.150113 11365 tablet_bootstrap.cc:654] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.151706 11100 tablet_service.cc:1467] Processing CreateTablet for tablet bae79411fa7c43e3853ae56d7939abeb (DEFAULT_TABLE table=default.Table_b7779b57a825405c8773c414101ed41a [id=f31536f4d17b47959117a0ad36c73526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.152172 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae79411fa7c43e3853ae56d7939abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.030792 12726 raft_consensus.cc:2229] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.162460 12726 raft_consensus.cc:2258] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.163116 12726 ts_tablet_manager.cc:1905] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.165113 11362 consensus_queue.cc:260] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:09.165645 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:09.165975 11362 ts_tablet_manager.cc:1428] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.148s user 0.002s sys 0.000s
W20260811 06:17:09.166051 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:09.166273 11362 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:09.166376 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because the tablet was not found. No further retry: Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
W20260811 06:17:09.166642 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2fcf7c7a470144c0a084aebc2032d896 because the tablet was not found. No further retry: Not found: Tablet not found: 2fcf7c7a470144c0a084aebc2032d896
W20260811 06:17:09.166946 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:09.167333 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 916b91088d7d4024a02214c958c0825b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916b91088d7d4024a02214c958c0825b already in progress: creating tablet
W20260811 06:17:09.167662 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
W20260811 06:17:09.168107 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
I20260811 06:17:09.168315 13571 consensus_queue.cc:1035] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:09.169166 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:09.169831 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f4f14a0add084048b92a501476ad6588 because the tablet was not found. No further retry: Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
I20260811 06:17:09.173913 10626 tablet_service.cc:1467] Processing CreateTablet for tablet bae79411fa7c43e3853ae56d7939abeb (DEFAULT_TABLE table=default.Table_b7779b57a825405c8773c414101ed41a [id=f31536f4d17b47959117a0ad36c73526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.174458 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae79411fa7c43e3853ae56d7939abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.184588 11362 tablet_bootstrap.cc:654] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.186791 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 446c91713b264730abe44cdbcc0f6837 (DEFAULT_TABLE table=default.Table_0318f31deb8044249063d4596a191ee1 [id=6895ffbdebaa481986ef657d4a27acda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.187358 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446c91713b264730abe44cdbcc0f6837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.187139 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 446c91713b264730abe44cdbcc0f6837 (DEFAULT_TABLE table=default.Table_0318f31deb8044249063d4596a191ee1 [id=6895ffbdebaa481986ef657d4a27acda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.188566 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446c91713b264730abe44cdbcc0f6837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.209414 12484 raft_consensus.cc:504] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.229990 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbf077619844f448c24717262d40d39 (DEFAULT_TABLE table=default.Table_b20f7148dc1e4f28910e7637e9aca501 [id=8bec108a939d4789a362f6148d6dde33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.230515 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbf077619844f448c24717262d40d39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:09.237632 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 67868.6us
W20260811 06:17:09.238114 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
W20260811 06:17:09.238664 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because the tablet was not found. No further retry: Not found: Tablet not found: 5ca903ee846a4e5baf3dbb4302607c1f
W20260811 06:17:09.239141 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:09.242576 10610 tablet_service.cc:1467] Processing CreateTablet for tablet b115c3e1b6a04f5d961f969b76bb7b0f (DEFAULT_TABLE table=default.Table_1c91a8d39e7d4242bcc7d33612e2e8ed [id=29cb3239a40b47d3b4f6c0979bc7373c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.243079 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b115c3e1b6a04f5d961f969b76bb7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.255394 11100 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbf077619844f448c24717262d40d39 (DEFAULT_TABLE table=default.Table_b20f7148dc1e4f28910e7637e9aca501 [id=8bec108a939d4789a362f6148d6dde33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.256618 11361 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:09.256871 11361 ts_tablet_manager.cc:1397] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.289s user 0.004s sys 0.003s
I20260811 06:17:09.258111 11119 tablet_service.cc:1467] Processing CreateTablet for tablet b115c3e1b6a04f5d961f969b76bb7b0f (DEFAULT_TABLE table=default.Table_1c91a8d39e7d4242bcc7d33612e2e8ed [id=29cb3239a40b47d3b4f6c0979bc7373c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:17:09.258457 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:09.259392 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 37a6567096154824babea5bceb94fe6e (DEFAULT_TABLE table=default.Table_6bcb4312fec24752b2859b4d7b738495 [id=3de9225de1ea40bfb304f7abae7c7a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.259786 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a6567096154824babea5bceb94fe6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.272629 12484 leader_election.cc:288] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.181473 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:09.277314 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:09.277952 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:09.278460 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:09.279222 11672 catalog_manager.cc:5495] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:09.285928 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:09.286267 10654 raft_consensus.cc:3037] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.286746 13615 raft_consensus.cc:482] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.286870 13615 raft_consensus.cc:504] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.287492 13615 leader_election.cc:288] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.288261 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.288970 10555 leader_election.cc:341] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.289382 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4171d257dd6453a9159c59ae713b2e0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:09.290037 11047 leader_election.cc:341] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.292898 10654 raft_consensus.cc:2454] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:09.293447 11046 leader_election.cc:302] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:09.293852 12484 raft_consensus.cc:2781] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:09.294034 12484 raft_consensus.cc:686] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:09.258131 11361 raft_consensus.cc:348] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.294322 12484 consensus_queue.cc:237] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.294638 11361 raft_consensus.cc:374] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.296530 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:09.298131 11362 tablet_bootstrap.cc:492] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.298552 11362 ts_tablet_manager.cc:1397] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.132s user 0.005s sys 0.000s
I20260811 06:17:09.297453 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:09.302776 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:09.303555 12726 ts_tablet_manager.cc:1918] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.303930 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:09.304489 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:09.304143 12726 log.cc:1196] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/45ebef95922f4e7f93533b54c07b7cec
I20260811 06:17:09.305083 12726 ts_tablet_manager.cc:1939] T 45ebef95922f4e7f93533b54c07b7cec P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.303699 11362 raft_consensus.cc:348] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.305375 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:09.305271 11362 raft_consensus.cc:374] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.305706 11362 raft_consensus.cc:729] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.306370 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:09.306646 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 446c91713b264730abe44cdbcc0f6837 (DEFAULT_TABLE table=default.Table_0318f31deb8044249063d4596a191ee1 [id=6895ffbdebaa481986ef657d4a27acda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.306957 10872 tablet_service.cc:1467] Processing CreateTablet for tablet bae79411fa7c43e3853ae56d7939abeb (DEFAULT_TABLE table=default.Table_b7779b57a825405c8773c414101ed41a [id=f31536f4d17b47959117a0ad36c73526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.307665 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:09.307839 11365 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.306967 11362 consensus_queue.cc:260] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.307964 11365 ts_tablet_manager.cc:1397] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.162s user 0.036s sys 0.117s
I20260811 06:17:09.308832 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 105) took 6697 ms. Trace:
I20260811 06:17:09.308897 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:09.310091 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 5cbf077619844f448c24717262d40d39 (DEFAULT_TABLE table=default.Table_b20f7148dc1e4f28910e7637e9aca501 [id=8bec108a939d4789a362f6148d6dde33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.310664 10860 tablet_service.cc:1467] Processing CreateTablet for tablet b115c3e1b6a04f5d961f969b76bb7b0f (DEFAULT_TABLE table=default.Table_1c91a8d39e7d4242bcc7d33612e2e8ed [id=29cb3239a40b47d3b4f6c0979bc7373c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:09.311766 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446c91713b264730abe44cdbcc0f6837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.312105 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bae79411fa7c43e3853ae56d7939abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.313879 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b115c3e1b6a04f5d961f969b76bb7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.314491 11365 raft_consensus.cc:348] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.314699 11365 raft_consensus.cc:374] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.314742 11365 raft_consensus.cc:729] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.314939 11365 consensus_queue.cc:260] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.317984 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbf077619844f448c24717262d40d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.318450 11362 ts_tablet_manager.cc:1428] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260811 06:17:09.319170 11362 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:09.321038 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.323863 10564 leader_election.cc:341] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.324028 10564 leader_election.cc:302] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.324667 13494 raft_consensus.cc:2726] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.325142 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b115c3e1b6a04f5d961f969b76bb7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.325795 11100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cbf077619844f448c24717262d40d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:09.327880 11362 tablet_bootstrap.cc:654] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.337615 11365 ts_tablet_manager.cc:1428] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260811 06:17:09.338019 11365 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.340431 13571 consensus_queue.cc:1035] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:09.358529 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:09.309185 12726 rpcz_store.cc:276] 0811 06:17:02.611407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.611606 (+ 199us) service_pool.cc:227] Handling call
0811 06:17:09.029955 (+6418349us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:17:09.029970 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.213675 (+183705us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.303422 (+ 89747us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.308716 (+ 5294us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6417896}
I20260811 06:17:09.360304 11365 tablet_bootstrap.cc:654] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.362771 12726 tablet_replica.cc:330] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.363095 12726 raft_consensus.cc:2229] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.362427 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 45ebef95922f4e7f93533b54c07b7cec (table default.Table_2dd734f7b4474e44acfdf0e5151b6b21 [id=416217c8551d4037bf36c99fb5572ef7]) successfully deleted
I20260811 06:17:09.364301 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:09.365146 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:09.365885 12726 raft_consensus.cc:2258] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.366613 12726 ts_tablet_manager.cc:1905] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.365691 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:09.373873 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:09.374228 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:09.374574 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:09.375422 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:09.376051 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:09.376305 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:09.376681 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:09.377432 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:09.377679 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:09.386560 12726 ts_tablet_manager.cc:1918] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.388870 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:09.389303 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:09.389823 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:09.390202 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:09.391976 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:09.392218 12726 log.cc:1196] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/5ca903ee846a4e5baf3dbb4302607c1f
I20260811 06:17:09.392722 12726 ts_tablet_manager.cc:1939] T 5ca903ee846a4e5baf3dbb4302607c1f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.392952 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:09.394228 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 107) took 6781 ms. Trace:
I20260811 06:17:09.395531 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:09.395867 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:09.396374 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:09.396672 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:09.397051 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:09.397368 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:09.397635 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:09.397959 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:09.402879 12944 consensus_queue.cc:1035] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:09.403252 12726 rpcz_store.cc:276] 0811 06:17:02.612635 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.612684 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:09.362705 (+6750021us) ts_tablet_manager.cc:1145] Deleting tablet 5ca903ee846a4e5baf3dbb4302607c1f
0811 06:17:09.362723 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.381899 (+ 19176us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.386447 (+ 4548us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.394206 (+ 7759us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6749589}
I20260811 06:17:09.403887 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 5ca903ee846a4e5baf3dbb4302607c1f (table default.Table_a78aa76e7c2c4be2a021e44457b7091a [id=af0dcd5dd94d4af79681ad0d400d7646]) successfully deleted
I20260811 06:17:09.395232 11365 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.404213 11365 ts_tablet_manager.cc:1397] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.006s
I20260811 06:17:09.405305 11365 raft_consensus.cc:348] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.405505 11365 raft_consensus.cc:374] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.405561 11365 raft_consensus.cc:729] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.405820 11365 consensus_queue.cc:260] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.406365 11362 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.406421 11365 ts_tablet_manager.cc:1428] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:09.406658 11362 ts_tablet_manager.cc:1397] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.088s user 0.015s sys 0.027s
I20260811 06:17:09.406785 11365 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.410435 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 109) took 6796 ms. Trace:
I20260811 06:17:09.410548 12726 rpcz_store.cc:276] 0811 06:17:02.614058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.614108 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:09.406584 (+6792476us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:17:09.410274 (+ 3690us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.410410 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6792208}
W20260811 06:17:09.411187 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:17:09.412890 11365 tablet_bootstrap.cc:654] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.418172 12726 tablet_replica.cc:330] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.418660 12726 raft_consensus.cc:2229] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.416854 11362 raft_consensus.cc:348] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.420333 11362 raft_consensus.cc:374] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.421130 11362 raft_consensus.cc:729] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.419255 13669 raft_consensus.cc:482] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.425352 13669 raft_consensus.cc:504] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.426017 13669 leader_election.cc:288] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:09.424211 11362 consensus_queue.cc:260] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.426700 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0813b34919a14a2481857e9f87b217c8" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.432404 11362 ts_tablet_manager.cc:1428] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.025s user 0.004s sys 0.000s
W20260811 06:17:09.435376 10564 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.436820 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0813b34919a14a2481857e9f87b217c8" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.436414 11362 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:09.437911 10555 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.438061 10555 leader_election.cc:302] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.438544 13669 raft_consensus.cc:2726] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.439429 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:09.439677 12726 raft_consensus.cc:2258] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.441210 12726 ts_tablet_manager.cc:1905] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.443590 11365 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.447207 11365 ts_tablet_manager.cc:1397] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.010s
I20260811 06:17:09.448027 11365 raft_consensus.cc:348] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.448277 11365 raft_consensus.cc:374] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.448333 11365 raft_consensus.cc:729] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.448532 11365 consensus_queue.cc:260] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.449036 13669 raft_consensus.cc:482] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.449088 11365 ts_tablet_manager.cc:1428] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:09.449162 13669 raft_consensus.cc:504] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.450453 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "585f92fc5b3d41bd97df525380fcab9f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.451088 10564 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.451440 13669 leader_election.cc:288] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.452091 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "585f92fc5b3d41bd97df525380fcab9f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.452725 10555 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.452850 10555 leader_election.cc:302] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.453258 13669 raft_consensus.cc:2726] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.457998 11365 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.459776 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:09.460767 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:09.460956 11365 tablet_bootstrap.cc:654] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.461563 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:09.464426 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:09.464802 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:09.465094 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:09.466153 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:09.466395 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:09.466761 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:09.467173 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:09.467409 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:09.467777 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:09.470696 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:09.471063 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:09.471288 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:09.471940 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:09.472630 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:09.474000 13669 raft_consensus.cc:482] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.474160 11365 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.474304 11365 ts_tablet_manager.cc:1397] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.004s
I20260811 06:17:09.474144 13669 raft_consensus.cc:504] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.474822 13669 leader_election.cc:288] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.475224 11365 raft_consensus.cc:348] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.475436 11365 raft_consensus.cc:374] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.475490 11365 raft_consensus.cc:729] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.475664 11365 consensus_queue.cc:260] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.476225 11365 ts_tablet_manager.cc:1428] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:09.476500 11365 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.476603 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0ae9a1d3b74c3985637439819b63ef" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.477104 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b0ae9a1d3b74c3985637439819b63ef" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.477957 10555 leader_election.cc:341] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.478399 10564 leader_election.cc:341] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.478524 10564 leader_election.cc:302] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.478874 11365 tablet_bootstrap.cc:654] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.478827 13615 raft_consensus.cc:2726] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.479782 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:09.479790 11362 tablet_bootstrap.cc:654] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.480847 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:09.482019 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:09.482621 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:09.482851 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:09.483420 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:09.484694 11684 catalog_manager.cc:5495] T 8fb4dba9d9bb4f278b5a43c124c7b509 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:09.485591 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:09.485934 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:09.486385 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:09.489967 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:09.490694 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:09.491364 11684 catalog_manager.cc:5495] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:09.493083 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:09.496645 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:09.497572 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:09.499326 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:09.499791 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:09.500653 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:09.504544 11365 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.504791 11365 ts_tablet_manager.cc:1397] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
I20260811 06:17:09.509102 11365 raft_consensus.cc:348] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.509471 11365 raft_consensus.cc:374] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.509585 11365 raft_consensus.cc:729] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.509871 11365 consensus_queue.cc:260] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.510540 11365 ts_tablet_manager.cc:1428] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:09.501271 11684 catalog_manager.cc:5495] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:09.511113 11365 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.516785 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:09.517513 11684 catalog_manager.cc:5495] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:09.518224 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:09.518625 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:09.519340 11365 tablet_bootstrap.cc:654] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.519672 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:09.523591 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:09.526296 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:09.528143 11361 raft_consensus.cc:729] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.530498 11361 consensus_queue.cc:260] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.535910 12726 ts_tablet_manager.cc:1918] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.535595 11361 ts_tablet_manager.cc:1428] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.279s user 0.027s sys 0.006s
I20260811 06:17:09.536046 12726 log.cc:1196] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/0dab2b8209e5401c84a187882ef21e08
I20260811 06:17:09.536388 12726 ts_tablet_manager.cc:1939] T 0dab2b8209e5401c84a187882ef21e08 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.536743 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 101) took 6938 ms. Trace:
I20260811 06:17:09.536840 12726 rpcz_store.cc:276] 0811 06:17:02.598118 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.598239 (+ 121us) service_pool.cc:227] Handling call
0811 06:17:09.413371 (+6815132us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:17:09.418109 (+ 4738us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.508767 (+ 90658us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.535785 (+ 27018us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.536724 (+ 939us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6796169}
I20260811 06:17:09.537194 12726 tablet_replica.cc:330] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.537406 12726 raft_consensus.cc:2229] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.537526 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 0dab2b8209e5401c84a187882ef21e08 (table default.Table_38255a43259b4c3a9e0385991f1730dd [id=8da9cecc32264414b6b51446ed460ea2]) successfully deleted
I20260811 06:17:09.537590 12726 raft_consensus.cc:2258] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.538286 12726 ts_tablet_manager.cc:1905] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.539237 11362 tablet_bootstrap.cc:492] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.539397 11362 ts_tablet_manager.cc:1397] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.000s
I20260811 06:17:09.541644 11362 raft_consensus.cc:348] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.542115 11362 raft_consensus.cc:374] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.542246 11362 raft_consensus.cc:729] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.542675 11362 consensus_queue.cc:260] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.547825 11238 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:09.548135 11362 ts_tablet_manager.cc:1428] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260811 06:17:09.548789 11362 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:09.550472 13615 raft_consensus.cc:482] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.550633 13615 raft_consensus.cc:504] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.551326 13615 leader_election.cc:288] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.554641 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.555408 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.555976 10564 leader_election.cc:341] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.556263 10555 leader_election.cc:341] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.556363 10555 leader_election.cc:302] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.558988 13615 raft_consensus.cc:2726] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.553686 11361 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:09.566874 11663 catalog_manager.cc:5495] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:09.567556 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:09.567937 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:09.568598 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:09.569109 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:09.569410 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:09.569694 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:09.570170 11365 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.570473 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:09.570467 11365 ts_tablet_manager.cc:1397] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.000s
I20260811 06:17:09.570748 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:09.571115 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:09.571765 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:09.572059 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:09.571995 11365 raft_consensus.cc:348] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.572448 11365 raft_consensus.cc:374] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.572518 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:09.572575 11365 raft_consensus.cc:729] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.573822 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:09.574234 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:09.573242 11365 consensus_queue.cc:260] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.574729 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:09.575780 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:09.576802 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:09.576838 11362 tablet_bootstrap.cc:654] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.577517 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:09.577879 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:09.578632 11365 ts_tablet_manager.cc:1428] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260811 06:17:09.581389 11365 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.581912 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:09.582438 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:09.582794 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:09.583395 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:09.583727 11361 tablet_bootstrap.cc:654] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.584735 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:09.585206 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:09.585826 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:09.586103 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:09.586647 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:09.587136 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:09.587865 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:09.588231 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:09.588685 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:09.589056 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:09.590246 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:09.590585 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:09.591042 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:09.591180 12726 ts_tablet_manager.cc:1918] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.591342 12726 log.cc:1196] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/78d94d27431a4d5e93f1c1ce8c7b6752
I20260811 06:17:09.591600 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:09.591707 12726 ts_tablet_manager.cc:1939] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.592177 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:09.592480 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:09.592867 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:09.601874 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 103) took 6990 ms. Trace:
I20260811 06:17:09.602330 12726 rpcz_store.cc:276] 0811 06:17:02.610872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.611071 (+ 199us) service_pool.cc:227] Handling call
0811 06:17:09.537142 (+6926071us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:17:09.537154 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.563944 (+ 26790us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.590959 (+ 27015us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.601804 (+ 10845us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6919527}
I20260811 06:17:09.602905 12726 tablet_replica.cc:330] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.603247 12726 raft_consensus.cc:2229] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.603487 12726 raft_consensus.cc:2258] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.604117 12726 ts_tablet_manager.cc:1905] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.604589 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (table default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]) successfully deleted
I20260811 06:17:09.608259 13615 raft_consensus.cc:482] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.608434 13615 raft_consensus.cc:504] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.609091 13615 leader_election.cc:288] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.609678 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8741294bc33e454a9c4ef1717ccef80f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.609774 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8741294bc33e454a9c4ef1717ccef80f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.610421 10555 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.610872 10564 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.610924 11365 tablet_bootstrap.cc:654] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.610985 10564 leader_election.cc:302] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.612903 13669 raft_consensus.cc:2726] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.624326 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:09.624827 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:09.625552 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:09.625836 11361 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:09.626282 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:09.627058 11361 ts_tablet_manager.cc:1397] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.007s
I20260811 06:17:09.627380 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:09.627775 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:09.628186 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:09.628811 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:09.629166 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:09.629609 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:09.630077 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:09.630561 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:09.631637 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:09.632488 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:09.631811 11361 raft_consensus.cc:348] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.633394 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:09.633553 12726 ts_tablet_manager.cc:1918] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.633829 12726 log.cc:1196] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/b0cdc826a1d8460aba1aae684c13131d
I20260811 06:17:09.633452 11361 raft_consensus.cc:374] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.634011 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:09.634286 12726 ts_tablet_manager.cc:1939] T b0cdc826a1d8460aba1aae684c13131d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.633991 11361 raft_consensus.cc:729] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.634724 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 102) took 7024 ms. Trace:
I20260811 06:17:09.634712 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:09.634860 12726 rpcz_store.cc:276] 0811 06:17:02.610647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.611191 (+ 544us) service_pool.cc:227] Handling call
0811 06:17:09.602851 (+6991660us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:17:09.602866 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.615307 (+ 12441us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.633431 (+ 18124us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.634701 (+ 1270us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6984800}
I20260811 06:17:09.635496 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet b0cdc826a1d8460aba1aae684c13131d (table default.Table_2b0908c490b34de1b667987b39b6b8cc [id=3933f8f825eb4d65a2b0f8fcde6ba165]) successfully deleted
I20260811 06:17:09.635543 12726 tablet_replica.cc:330] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.635739 12726 raft_consensus.cc:2229] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.635919 12726 raft_consensus.cc:2258] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.636503 12726 ts_tablet_manager.cc:1905] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.635696 11361 consensus_queue.cc:260] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.638960 11362 tablet_bootstrap.cc:492] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.639227 11362 ts_tablet_manager.cc:1397] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.091s user 0.010s sys 0.002s
I20260811 06:17:09.639652 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:09.639952 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:09.640400 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:09.641081 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:09.641559 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:09.641878 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:09.642171 11362 raft_consensus.cc:348] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.642179 11683 catalog_manager.cc:5495] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:09.642624 11362 raft_consensus.cc:374] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.642747 11362 raft_consensus.cc:729] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.643389 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:09.644296 12726 ts_tablet_manager.cc:1918] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260811 06:17:09.644203 11362 consensus_queue.cc:260] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.645154 11365 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.646903 12726 log.cc:1196] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:09.647017 11365 ts_tablet_manager.cc:1397] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.003s
I20260811 06:17:09.649122 11365 raft_consensus.cc:348] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.649528 11365 raft_consensus.cc:374] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.649150 12726 ts_tablet_manager.cc:1939] T a1981dc26be24ec5afaa3c0bb5c46c8c P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.649662 11365 raft_consensus.cc:729] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.650179 11365 consensus_queue.cc:260] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.652271 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:09.652678 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:09.651448 11361 ts_tablet_manager.cc:1428] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.024s user 0.000s sys 0.003s
I20260811 06:17:09.652732 11365 ts_tablet_manager.cc:1428] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:09.653230 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:09.653647 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:09.653996 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:09.654315 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:09.654795 11683 catalog_manager.cc:5495] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:09.654978 11362 ts_tablet_manager.cc:1428] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.015s user 0.002s sys 0.001s
I20260811 06:17:09.655102 11365 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.655541 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:09.655910 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:09.656286 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:09.656910 11361 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:09.661373 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:09.662533 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 110) took 7047 ms. Trace:
I20260811 06:17:09.662698 12726 rpcz_store.cc:276] 0811 06:17:02.617643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.617685 (+ 42us) service_pool.cc:227] Handling call
0811 06:17:09.635492 (+7017807us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:17:09.635504 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.639999 (+ 4495us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.644190 (+ 4191us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.662509 (+ 18319us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7017321}
I20260811 06:17:09.663348 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a1981dc26be24ec5afaa3c0bb5c46c8c (table default.Table_cdfe7577fb6c436cb05499d6ea396a51 [id=328164bbe3754ce7abd0375e1070ee37]) successfully deleted
I20260811 06:17:09.663743 12726 tablet_replica.cc:330] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.664019 12726 raft_consensus.cc:2229] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.664259 12726 raft_consensus.cc:2258] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.664741 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:09.665344 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:09.665733 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:09.665796 12726 ts_tablet_manager.cc:1905] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.668038 11362 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:09.673091 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:09.673069 13615 raft_consensus.cc:482] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.673237 13615 raft_consensus.cc:504] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.673918 13615 leader_election.cc:288] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.674422 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:09.674875 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:09.675029 10555 leader_election.cc:341] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:09.675511 10564 leader_election.cc:341] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.675616 10564 leader_election.cc:302] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.676090 13615 raft_consensus.cc:2726] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.676499 11365 tablet_bootstrap.cc:654] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.680166 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:09.681389 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:09.682801 11683 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:09.686398 12726 ts_tablet_manager.cc:1918] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:09.687767 12726 log.cc:1196] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/52953438e7c248b1a758ee219405d7da
I20260811 06:17:09.688283 12726 ts_tablet_manager.cc:1939] T 52953438e7c248b1a758ee219405d7da P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.689026 11361 tablet_bootstrap.cc:654] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.692194 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 104) took 7081 ms. Trace:
I20260811 06:17:09.695518 12726 rpcz_store.cc:276] 0811 06:17:02.611021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.611256 (+ 235us) service_pool.cc:227] Handling call
0811 06:17:09.663689 (+7052433us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:17:09.663702 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.682919 (+ 19217us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.686288 (+ 3369us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.692171 (+ 5883us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7045312}
I20260811 06:17:09.696085 11362 tablet_bootstrap.cc:654] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.696165 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 52953438e7c248b1a758ee219405d7da (table default.Table_11e3880a5ec345918edbff9a7a5b5af0 [id=d6486228ac974063921f2128567d5d95]) successfully deleted
I20260811 06:17:09.696365 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 106) took 7084 ms. Trace:
I20260811 06:17:09.696447 12726 rpcz_store.cc:276] 0811 06:17:02.612302 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.612346 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:09.696096 (+7083750us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:17:09.696109 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.696343 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7069883}
W20260811 06:17:09.697141 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
I20260811 06:17:09.697628 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 108) took 7084 ms. Trace:
I20260811 06:17:09.697818 12726 rpcz_store.cc:276] 0811 06:17:02.613533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.613612 (+ 79us) service_pool.cc:227] Handling call
0811 06:17:09.697486 (+7083874us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:17:09.697497 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.697609 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7065870}
W20260811 06:17:09.698385 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
I20260811 06:17:09.698961 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 111) took 6813 ms. Trace:
I20260811 06:17:09.699095 12726 rpcz_store.cc:276] 0811 06:17:02.885943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:02.886003 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:09.698749 (+6812746us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:09.698760 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.698941 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6812466}
W20260811 06:17:09.699656 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
I20260811 06:17:09.700102 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 112) took 6256 ms. Trace:
I20260811 06:17:09.700227 12726 rpcz_store.cc:276] 0811 06:17:03.443639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.443702 (+ 63us) service_pool.cc:227] Handling call
0811 06:17:09.699971 (+6256269us) ts_tablet_manager.cc:1145] Deleting tablet 1f48707b4fb746f49eaaf91b5b81e814
0811 06:17:09.699981 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.700085 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6255103}
W20260811 06:17:09.704131 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
I20260811 06:17:09.704648 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 116) took 4696 ms. Trace:
I20260811 06:17:09.704833 12726 rpcz_store.cc:276] 0811 06:17:05.007762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.007852 (+ 90us) service_pool.cc:227] Handling call
0811 06:17:09.704489 (+4696637us) ts_tablet_manager.cc:1145] Deleting tablet 52543aa31a1749d1a0fd5e48cbe30889
0811 06:17:09.704501 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.704625 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4696257}
W20260811 06:17:09.705457 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 52543aa31a1749d1a0fd5e48cbe30889 because the tablet was not found. No further retry: Not found: Tablet not found: 52543aa31a1749d1a0fd5e48cbe30889
I20260811 06:17:09.706049 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 118) took 4696 ms. Trace:
I20260811 06:17:09.706228 12726 rpcz_store.cc:276] 0811 06:17:05.009185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.009329 (+ 144us) service_pool.cc:227] Handling call
0811 06:17:09.705800 (+4696471us) ts_tablet_manager.cc:1145] Deleting tablet e873e2f7b3d34988856b3be044de1ed7
0811 06:17:09.705811 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.706031 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4695941}
W20260811 06:17:09.706782 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e873e2f7b3d34988856b3be044de1ed7 because the tablet was not found. No further retry: Not found: Tablet not found: e873e2f7b3d34988856b3be044de1ed7
I20260811 06:17:09.707273 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 119) took 4697 ms. Trace:
I20260811 06:17:09.707401 12726 rpcz_store.cc:276] 0811 06:17:05.009850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.009904 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:09.707100 (+4697196us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:17:09.707111 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.707256 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4696860}
W20260811 06:17:09.707964 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:09.708359 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 123) took 4692 ms. Trace:
I20260811 06:17:09.708485 12726 rpcz_store.cc:276] 0811 06:17:05.015651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.015708 (+ 57us) service_pool.cc:227] Handling call
0811 06:17:09.708273 (+4692565us) ts_tablet_manager.cc:1145] Deleting tablet 2cae52ba275f4d2fbd7014a1c6c01dc0
0811 06:17:09.708283 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.708342 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4692184}
W20260811 06:17:09.709263 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because the tablet was not found. No further retry: Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:09.709652 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 126) took 4648 ms. Trace:
I20260811 06:17:09.709797 12726 rpcz_store.cc:276] 0811 06:17:05.061240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.061291 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:09.709565 (+4648274us) ts_tablet_manager.cc:1145] Deleting tablet cdb93dcd940a47e78c5458041c768e36
0811 06:17:09.709576 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.709634 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4647868}
W20260811 06:17:09.710529 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet cdb93dcd940a47e78c5458041c768e36 because the tablet was not found. No further retry: Not found: Tablet not found: cdb93dcd940a47e78c5458041c768e36
I20260811 06:17:09.710940 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 117) took 4702 ms. Trace:
I20260811 06:17:09.711072 12726 rpcz_store.cc:276] 0811 06:17:05.008522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.008576 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:09.710829 (+4702253us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:17:09.710840 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.710923 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4631488}
W20260811 06:17:09.711599 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:09.713639 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:09.715153 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 120) took 4702 ms. Trace:
I20260811 06:17:09.715309 12726 rpcz_store.cc:276] 0811 06:17:05.013040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.013094 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:09.715012 (+4701918us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:09.715024 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.715129 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4635334}
I20260811 06:17:09.715461 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:09.715812 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
W20260811 06:17:09.716046 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
I20260811 06:17:09.716193 11365 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.716414 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:09.716485 11365 ts_tablet_manager.cc:1397] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.005s
I20260811 06:17:09.717564 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:09.716522 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 121) took 4702 ms. Trace:
I20260811 06:17:09.717988 12726 rpcz_store.cc:276] 0811 06:17:05.013638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.013696 (+ 58us) service_pool.cc:227] Handling call
0811 06:17:09.716412 (+4702716us) ts_tablet_manager.cc:1145] Deleting tablet d4d44dea35e94ed788b7e1e5a8a24d8e
0811 06:17:09.716423 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.716504 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4636386}
I20260811 06:17:09.718014 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:09.718393 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
W20260811 06:17:09.718619 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because the tablet was not found. No further retry: Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
I20260811 06:17:09.718858 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:09.719098 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 122) took 4705 ms. Trace:
I20260811 06:17:09.719293 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_a761dcad0b3a477a8ee08606c1b45c40 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 1 got 0
I20260811 06:17:09.719237 12726 rpcz_store.cc:276] 0811 06:17:05.014116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.014166 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:09.718974 (+4704808us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:17:09.718985 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.719080 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4638639}
I20260811 06:17:09.718302 11365 raft_consensus.cc:348] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.719838 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
W20260811 06:17:09.719862 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:09.720094 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:09.719980 11365 raft_consensus.cc:374] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.720485 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 125) took 4659 ms. Trace:
I20260811 06:17:09.720566 12726 rpcz_store.cc:276] 0811 06:17:05.060828 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.060886 (+ 58us) service_pool.cc:227] Handling call
0811 06:17:09.720283 (+4659397us) ts_tablet_manager.cc:1145] Deleting tablet 1c42b5ef0fc84627908200331f53b1a3
0811 06:17:09.720294 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.720466 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4639648}
I20260811 06:17:09.720515 11365 raft_consensus.cc:729] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:17:09.721011 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1c42b5ef0fc84627908200331f53b1a3 because the tablet was not found. No further retry: Not found: Tablet not found: 1c42b5ef0fc84627908200331f53b1a3
I20260811 06:17:09.721237 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:09.721402 12726 tablet_replica.cc:330] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.721745 12726 raft_consensus.cc:2229] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.721959 12726 raft_consensus.cc:2258] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.721997 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_7baf5a935fc041a6818ad62931bb8665 [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 1 got 0
I20260811 06:17:09.722610 12726 ts_tablet_manager.cc:1905] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.722812 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:09.723501 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:09.722102 11365 consensus_queue.cc:260] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.724063 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:09.724700 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:09.725225 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:09.725806 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:09.726758 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:09.728890 11362 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.729844 11362 ts_tablet_manager.cc:1397] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.007s
I20260811 06:17:09.729965 11365 ts_tablet_manager.cc:1428] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260811 06:17:09.732776 11365 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.733486 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:09.733939 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:09.733983 11361 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:09.734294 11361 ts_tablet_manager.cc:1397] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.078s user 0.007s sys 0.003s
I20260811 06:17:09.735587 11361 raft_consensus.cc:348] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.735991 11361 raft_consensus.cc:374] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.736122 11361 raft_consensus.cc:729] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.737280 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:09.736781 11361 consensus_queue.cc:260] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.741499 11362 raft_consensus.cc:348] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.743445 11361 ts_tablet_manager.cc:1428] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260811 06:17:09.739125 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:09.744130 11362 raft_consensus.cc:374] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.744727 11362 raft_consensus.cc:729] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.746165 11361 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:09.746784 11362 consensus_queue.cc:260] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.744884 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:09.750922 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:09.751281 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:09.751739 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]). Expected version 2 got 0
I20260811 06:17:09.752018 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:09.753896 11365 tablet_bootstrap.cc:654] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.754560 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:09.754931 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:09.756840 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:09.757342 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:09.757823 12726 ts_tablet_manager.cc:1918] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.757930 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:09.758033 12726 log.cc:1196] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:09.758495 12726 ts_tablet_manager.cc:1939] T 035eee1d37c94471a7cd697fb0fbb951 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.758396 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:09.759454 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 129) took 4676 ms. Trace:
I20260811 06:17:09.759465 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:09.759543 11362 ts_tablet_manager.cc:1428] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.029s user 0.004s sys 0.000s
I20260811 06:17:09.759622 12726 rpcz_store.cc:276] 0811 06:17:05.083225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.083272 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:09.721319 (+4638047us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:09.721329 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.735825 (+ 14496us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.757662 (+ 21837us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.759358 (+ 1696us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4637213}
I20260811 06:17:09.759752 13615 raft_consensus.cc:482] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.759904 13615 raft_consensus.cc:504] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.760210 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:09.760221 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 035eee1d37c94471a7cd697fb0fbb951 (table default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]) successfully deleted
I20260811 06:17:09.760656 13615 leader_election.cc:288] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.760757 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:09.761097 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.761399 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:09.761747 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
W20260811 06:17:09.761883 10564 leader_election.cc:341] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.762245 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 128) took 4680 ms. Trace:
I20260811 06:17:09.762393 12726 rpcz_store.cc:276] 0811 06:17:05.082071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.082123 (+ 52us) service_pool.cc:227] Handling call
0811 06:17:09.762137 (+4680014us) ts_tablet_manager.cc:1145] Deleting tablet 52ecffcf4a0e46428caed6f7d72199bd
0811 06:17:09.762153 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.762227 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4676085}
I20260811 06:17:09.762696 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 12971f852ea943b78d967f7672680cad
W20260811 06:17:09.762969 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because the tablet was not found. No further retry: Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
I20260811 06:17:09.763249 11670 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 77) took 3508 ms. Trace:
I20260811 06:17:09.763552 11670 rpcz_store.cc:276] 0811 06:17:06.254653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.492343 (+2237690us) service_pool.cc:227] Handling call
0811 06:17:08.501040 (+ 8697us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:08.501828 (+ 788us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:08.501976 (+ 148us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:08.502085 (+ 109us) catalog_manager.cc:2761] Locking tablets
0811 06:17:08.926393 (+424308us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:08.934345 (+ 7952us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:08.934444 (+ 99us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:09.762577 (+828133us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:09.763167 (+ 590us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.927468 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.927586 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.927593 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:08.927596 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:08.927711 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.927726 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.927731 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:08.927870 (+ 139us) tablet.cc:699] Row locks acquired
0811 06:17:08.927872 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:08.927916 (+ 44us) write_op.cc:270] Start()
0811 06:17:08.927953 (+ 37us) write_op.cc:276] Timestamp: P: 1786429028927882 usec, L: 0
0811 06:17:08.927957 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.928206 (+ 249us) log.cc:842] Serialized 728 byte log entry
0811 06:17:08.933180 (+ 4974us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.933299 (+ 119us) write_op.cc:301] APPLY: starting
0811 06:17:08.933327 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.933374 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.933427 (+ 53us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.933506 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.933544 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:08.933550 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.933638 (+ 88us) log.cc:842] Serialized 29 byte log entry
0811 06:17:08.933705 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.933749 (+ 44us) write_op.cc:454] Released schema lock
0811 06:17:08.933757 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.933821 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.933824 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":18739968,"child_traces":[["op",{"apply.queue_time_us":65,"apply.run_cpu_time_us":583,"apply.run_wall_time_us":583,"num_ops":2,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":848,"prepare.run_wall_time_us":849,"raft.queue_time_us":80,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":396,"replication_time_us":5197}]]}
I20260811 06:17:09.767393 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:09.769500 11362 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:09.770090 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 132) took 4684 ms. Trace:
I20260811 06:17:09.770188 12726 rpcz_store.cc:276] 0811 06:17:05.085204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.085248 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:09.769849 (+4684601us) ts_tablet_manager.cc:1145] Deleting tablet 32407c8872464da2b1470a8ae21c86fd
0811 06:17:09.769864 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.770064 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4684423}
W20260811 06:17:09.770998 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:09.771482 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 134) took 4685 ms. Trace:
I20260811 06:17:09.771596 12726 rpcz_store.cc:276] 0811 06:17:05.086030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.086075 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:09.771359 (+4685284us) ts_tablet_manager.cc:1145] Deleting tablet 2875318863584e659e2b76ad2a72ca45
0811 06:17:09.771374 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.771463 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4685101}
W20260811 06:17:09.772116 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2875318863584e659e2b76ad2a72ca45 because the tablet was not found. No further retry: Not found: Tablet not found: 2875318863584e659e2b76ad2a72ca45
I20260811 06:17:09.772624 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.772838 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:09.773131 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.777097 10555 leader_election.cc:341] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.777245 10555 leader_election.cc:302] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.777487 13615 raft_consensus.cc:2726] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.782099 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 136) took 4695 ms. Trace:
I20260811 06:17:09.783134 12726 rpcz_store.cc:276] 0811 06:17:05.086596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.086640 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:09.772462 (+4685822us) ts_tablet_manager.cc:1145] Deleting tablet 9ac8c5daeb3249e38d863ee94f1267b1
0811 06:17:09.772474 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.782071 (+ 9597us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4685453}
W20260811 06:17:09.784214 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9ac8c5daeb3249e38d863ee94f1267b1 because the tablet was not found. No further retry: Not found: Tablet not found: 9ac8c5daeb3249e38d863ee94f1267b1
I20260811 06:17:09.784818 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 130) took 4700 ms. Trace:
I20260811 06:17:09.785279 12726 rpcz_store.cc:276] 0811 06:17:05.084778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.084822 (+ 44us) service_pool.cc:227] Handling call
0811 06:17:09.784696 (+4699874us) ts_tablet_manager.cc:1145] Deleting tablet 7db813cbb8f74b329015b163ebd58c00
0811 06:17:09.784710 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.784798 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4691682}
W20260811 06:17:09.786161 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7db813cbb8f74b329015b163ebd58c00 because the tablet was not found. No further retry: Not found: Tablet not found: 7db813cbb8f74b329015b163ebd58c00
I20260811 06:17:09.789883 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 131) took 4704 ms. Trace:
I20260811 06:17:09.790037 12726 rpcz_store.cc:276] 0811 06:17:05.085002 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.085043 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:09.786629 (+4701586us) ts_tablet_manager.cc:1145] Deleting tablet d668bcfbeff54181ba3b4407b1eb5704
0811 06:17:09.789756 (+ 3127us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.789859 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4693384}
W20260811 06:17:09.790702 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d668bcfbeff54181ba3b4407b1eb5704 because the tablet was not found. No further retry: Not found: Tablet not found: d668bcfbeff54181ba3b4407b1eb5704
I20260811 06:17:09.791250 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 133) took 4705 ms. Trace:
I20260811 06:17:09.791384 12726 rpcz_store.cc:276] 0811 06:17:05.085814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.085859 (+ 45us) service_pool.cc:227] Handling call
0811 06:17:09.791118 (+4705259us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:09.791129 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.791232 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4697641}
W20260811 06:17:09.792032 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:09.792490 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 135) took 4706 ms. Trace:
I20260811 06:17:09.792616 12726 rpcz_store.cc:276] 0811 06:17:05.086391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.086432 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:09.792402 (+4705970us) ts_tablet_manager.cc:1145] Deleting tablet 285b85c854bf400295b288314947840e
0811 06:17:09.792414 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.792472 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4698705}
I20260811 06:17:09.793267 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 138) took 4704 ms. Trace:
I20260811 06:17:09.793458 12726 rpcz_store.cc:276] 0811 06:17:05.089237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.089278 (+ 41us) service_pool.cc:227] Handling call
0811 06:17:09.793179 (+4703901us) ts_tablet_manager.cc:1145] Deleting tablet bc3091f8a8f9442da50b17d4752cedb0
0811 06:17:09.793190 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.793250 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4698017}
W20260811 06:17:09.794076 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 285b85c854bf400295b288314947840e because the tablet was not found. No further retry: Not found: Tablet not found: 285b85c854bf400295b288314947840e
W20260811 06:17:09.794508 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet bc3091f8a8f9442da50b17d4752cedb0 because the tablet was not found. No further retry: Not found: Tablet not found: bc3091f8a8f9442da50b17d4752cedb0
I20260811 06:17:09.796480 11362 tablet_bootstrap.cc:654] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:09.798682 11656 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2d9627d9f88466ba499aa175151f46a consensus state has no leader
I20260811 06:17:09.798897 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet f6f682f675c344b6b5955e834f94091f
I20260811 06:17:09.799736 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:09.801844 11676 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3de77019fc074a55ab741db336a9fc60 consensus state has no leader
W20260811 06:17:09.802285 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
W20260811 06:17:09.803030 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
I20260811 06:17:09.804349 11653 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 78) took 3542 ms. Trace:
I20260811 06:17:09.804625 11653 rpcz_store.cc:276] 0811 06:17:06.257388 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.072866 (+2815478us) service_pool.cc:227] Handling call
0811 06:17:09.075719 (+ 2853us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:09.076008 (+ 289us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:09.076080 (+ 72us) catalog_manager.cc:2761] Locking tablets
0811 06:17:09.129411 (+ 53331us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:09.142148 (+ 12737us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.142155 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:09.142240 (+ 85us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:09.142331 (+ 91us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:09.793195 (+650864us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:09.799432 (+ 6237us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.130550 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.130656 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.130662 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:09.130665 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:09.130792 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.130806 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.130811 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:09.130917 (+ 106us) tablet.cc:699] Row locks acquired
0811 06:17:09.130919 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:09.130956 (+ 37us) write_op.cc:270] Start()
0811 06:17:09.130992 (+ 36us) write_op.cc:276] Timestamp: P: 1786429029130905 usec, L: 0
0811 06:17:09.130995 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.131407 (+ 412us) log.cc:842] Serialized 728 byte log entry
0811 06:17:09.136779 (+ 5372us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.136910 (+ 131us) write_op.cc:301] APPLY: starting
0811 06:17:09.136928 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.137027 (+ 99us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.137074 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.137155 (+ 81us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.137196 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:09.137203 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:09.137302 (+ 99us) log.cc:842] Serialized 29 byte log entry
0811 06:17:09.137375 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.137400 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:09.137407 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":564,"apply.run_wall_time_us":564,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":965,"prepare.run_wall_time_us":964,"raft.queue_time_us":66,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":234,"replication_time_us":5755}]]}
I20260811 06:17:09.806090 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.806591 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:09.806869 11361 tablet_bootstrap.cc:654] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:09.809943 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:09.811235 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
I20260811 06:17:09.817677 12944 raft_consensus.cc:482] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.817893 12944 raft_consensus.cc:504] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.818583 12944 leader_election.cc:288] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:09.819232 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:09.819484 10662 raft_consensus.cc:2454] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:09.819501 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.819741 11153 raft_consensus.cc:2454] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:09.819947 10810 leader_election.cc:302] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:09.820668 12944 raft_consensus.cc:2781] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:09.820763 12944 raft_consensus.cc:482] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:09.820827 12944 raft_consensus.cc:3037] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.823917 12944 raft_consensus.cc:504] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.825274 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:09.825495 10662 raft_consensus.cc:3037] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.828497 10662 raft_consensus.cc:2454] T 19f45416a7ae45b3a8b26dd98b672f36 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:09.829064 10810 leader_election.cc:302] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:09.829378 13571 raft_consensus.cc:2781] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:09.829496 13571 raft_consensus.cc:686] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:09.829761 13571 consensus_queue.cc:237] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.835705 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 139) took 4746 ms. Trace:
I20260811 06:17:09.835920 12726 rpcz_store.cc:276] 0811 06:17:05.089559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.089609 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:09.798277 (+4708668us) ts_tablet_manager.cc:1145] Deleting tablet ea4eb7f5db2e4e75818bfb228b64ed0d
0811 06:17:09.835579 (+ 37302us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.835677 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4702912}
I20260811 06:17:09.836082 13567 consensus_queue.cc:1035] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:09.836599 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 140) took 4746 ms. Trace:
I20260811 06:17:09.836685 12726 rpcz_store.cc:276] 0811 06:17:05.089824 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.089867 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:09.836466 (+4746599us) ts_tablet_manager.cc:1145] Deleting tablet 5e990aa374204f2b95c08b04121176bc
0811 06:17:09.836481 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.836581 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4740919}
W20260811 06:17:09.836910 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ea4eb7f5db2e4e75818bfb228b64ed0d because the tablet was not found. No further retry: Not found: Tablet not found: ea4eb7f5db2e4e75818bfb228b64ed0d
I20260811 06:17:09.837251 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 143) took 4659 ms. Trace:
W20260811 06:17:09.837334 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:09.837507 12726 rpcz_store.cc:276] 0811 06:17:05.177310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:05.177357 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:09.837041 (+4659684us) ts_tablet_manager.cc:1145] Deleting tablet 6c706bf0455341a0a953d937f9778b5f
0811 06:17:09.837052 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.837132 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4659286}
W20260811 06:17:09.838348 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6c706bf0455341a0a953d937f9778b5f because the tablet was not found. No further retry: Not found: Tablet not found: 6c706bf0455341a0a953d937f9778b5f
I20260811 06:17:09.838860 12726 tablet_replica.cc:330] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:09.839318 12726 raft_consensus.cc:2229] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.839686 12726 raft_consensus.cc:2258] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.839744 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f45416a7ae45b3a8b26dd98b672f36" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:09.840070 11153 raft_consensus.cc:3037] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.840495 12726 ts_tablet_manager.cc:1905] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.843387 11153 raft_consensus.cc:2454] T 19f45416a7ae45b3a8b26dd98b672f36 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:09.843945 12944 leader_election.cc:288] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:09.849731 13282 raft_consensus.cc:482] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.849884 13282 raft_consensus.cc:504] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.850628 13282 leader_election.cc:288] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.851171 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.852159 11047 leader_election.cc:341] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.852505 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:09.853025 10662 raft_consensus.cc:2454] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:09.853561 11046 leader_election.cc:302] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:09.854014 13282 raft_consensus.cc:2781] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:09.854085 13282 raft_consensus.cc:482] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:09.854156 13282 raft_consensus.cc:3037] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.856295 11365 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.856583 11365 ts_tablet_manager.cc:1397] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.124s user 0.004s sys 0.004s
I20260811 06:17:09.857230 13282 raft_consensus.cc:504] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.857678 11365 raft_consensus.cc:348] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.858026 11365 raft_consensus.cc:374] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.858145 11365 raft_consensus.cc:729] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.858475 11365 consensus_queue.cc:260] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.858800 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:09.859405 13282 leader_election.cc:288] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.860184 11365 ts_tablet_manager.cc:1428] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 06:17:09.860203 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:09.860965 11047 leader_election.cc:341] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.862121 11235 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:09.862916 11361 tablet_bootstrap.cc:492] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:09.863090 11361 ts_tablet_manager.cc:1397] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.005s
I20260811 06:17:09.864032 10662 raft_consensus.cc:3037] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:09.865409 11365 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.867414 10662 raft_consensus.cc:2454] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:09.867974 11046 leader_election.cc:302] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:09.868418 13282 raft_consensus.cc:2781] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:09.868678 13282 raft_consensus.cc:686] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:09.869094 13282 consensus_queue.cc:237] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.869222 11362 tablet_bootstrap.cc:492] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:09.870682 11362 ts_tablet_manager.cc:1397] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.010s
I20260811 06:17:09.873214 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:09.876052 11365 tablet_bootstrap.cc:654] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.880709 11656 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 75) took 4829 ms. Trace:
I20260811 06:17:09.880895 11656 rpcz_store.cc:276] 0811 06:17:05.051289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.455576 (+3404287us) service_pool.cc:227] Handling call
0811 06:17:08.456190 (+ 614us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:08.456376 (+ 186us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:08.456664 (+ 288us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:08.456753 (+ 89us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:08.534277 (+ 77524us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:09.880565 (+1346288us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.462192 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.462381 (+ 189us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.462389 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:08.462391 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.462499 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.462514 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.462520 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:08.462588 (+ 68us) tablet.cc:699] Row locks acquired
0811 06:17:08.462591 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.462627 (+ 36us) write_op.cc:270] Start()
0811 06:17:08.462660 (+ 33us) write_op.cc:276] Timestamp: P: 1786429028462593 usec, L: 0
0811 06:17:08.462664 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.462853 (+ 189us) log.cc:842] Serialized 405 byte log entry
0811 06:17:08.500151 (+ 37298us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.500918 (+ 767us) write_op.cc:301] APPLY: starting
0811 06:17:08.501215 (+ 297us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.501788 (+ 573us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.502513 (+ 725us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.504139 (+ 1626us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.524823 (+ 20684us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:08.525182 (+ 359us) write_op.cc:312] APPLY: finished
0811 06:17:08.529259 (+ 4077us) log.cc:842] Serialized 23 byte log entry
0811 06:17:08.531082 (+ 1823us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.531540 (+ 458us) write_op.cc:454] Released schema lock
0811 06:17:08.531556 (+ 16us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.534682 (+ 3126us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.534690 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":505,"apply.run_cpu_time_us":2174,"apply.run_wall_time_us":34892,"mutex_wait_us":349,"num_ops":1,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":735,"replication_time_us":37457}]]}
I20260811 06:17:09.882501 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_7baf5a935fc041a6818ad62931bb8665" } new_table_name: "default.Table_e748a073117748be8c1442641fca722f" modify_external_catalogs: true
I20260811 06:17:09.882650 12726 ts_tablet_manager.cc:1918] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:09.882876 12726 log.cc:1196] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2fcf7c7a470144c0a084aebc2032d896
I20260811 06:17:09.880914 11362 raft_consensus.cc:348] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.883337 12726 ts_tablet_manager.cc:1939] T 2fcf7c7a470144c0a084aebc2032d896 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:09.883576 11362 raft_consensus.cc:374] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.884394 11362 raft_consensus.cc:729] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.885780 11676 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 76) took 4813 ms. Trace:
I20260811 06:17:09.887753 11361 raft_consensus.cc:348] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.886276 11362 consensus_queue.cc:260] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.888988 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.887995 11361 raft_consensus.cc:374] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.891597 11361 raft_consensus.cc:729] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.891387 11362 ts_tablet_manager.cc:1428] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.020s user 0.001s sys 0.003s
I20260811 06:17:09.891870 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.891804 11361 consensus_queue.cc:260] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:09.892141 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.892311 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.889514 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.889082 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.890220 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.890518 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.892536 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.892517 11361 ts_tablet_manager.cc:1428] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260811 06:17:09.893260 11361 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:09.893752 11362 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:09.894501 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
W20260811 06:17:09.895134 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
I20260811 06:17:09.886044 11676 rpcz_store.cc:276] 0811 06:17:05.072751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.458761 (+3386010us) service_pool.cc:227] Handling call
0811 06:17:08.459169 (+ 408us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:08.459366 (+ 197us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:08.459535 (+ 169us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:08.459590 (+ 55us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:08.491718 (+ 32128us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:09.885662 (+1393944us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.460137 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.460227 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.460233 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:08.460236 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:08.460518 (+ 282us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.460541 (+ 23us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.460548 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:08.460760 (+ 212us) tablet.cc:699] Row locks acquired
0811 06:17:08.460765 (+ 5us) write_op.cc:260] PREPARE: finished
0811 06:17:08.460815 (+ 50us) write_op.cc:270] Start()
0811 06:17:08.460886 (+ 71us) write_op.cc:276] Timestamp: P: 1786429028460779 usec, L: 0
0811 06:17:08.460890 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.461088 (+ 198us) log.cc:842] Serialized 405 byte log entry
0811 06:17:08.490084 (+ 28996us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.490765 (+ 681us) write_op.cc:301] APPLY: starting
0811 06:17:08.490775 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.490808 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.490877 (+ 69us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.490925 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.490953 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:08.490959 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:08.491067 (+ 108us) log.cc:842] Serialized 23 byte log entry
0811 06:17:08.491115 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.491131 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:08.491137 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.491200 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.491204 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":648,"apply.run_cpu_time_us":490,"apply.run_wall_time_us":489,"num_ops":1,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":1024,"prepare.run_wall_time_us":1024,"replication_time_us":29179,"thread_start_us":9954,"threads_started":1}]]}
I20260811 06:17:09.897254 11676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4e15808f30a44360b496919b3bc6c412" } modify_external_catalogs: true
I20260811 06:17:09.897598 11676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4e15808f30a44360b496919b3bc6c412" } modify_external_catalogs: true
W20260811 06:17:09.898619 11656 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6dd4a21086934bd9a64d74075ab41fbe consensus state has no leader
I20260811 06:17:09.898999 11656 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 79) took 3604 ms. Trace:
W20260811 06:17:09.899344 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:09.899632 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
W20260811 06:17:09.899899 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:09.900104 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:09.900205 13701 tablet_replica.cc:330] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:09.900467 13701 raft_consensus.cc:2229] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:09.900764 13701 raft_consensus.cc:2258] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:09.900420 11656 rpcz_store.cc:276] 0811 06:17:06.294473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.882120 (+3587647us) service_pool.cc:227] Handling call
0811 06:17:09.882746 (+ 626us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:09.882974 (+ 228us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:09.883220 (+ 246us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:09.883289 (+ 69us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:09.898261 (+ 14972us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:09.898861 (+ 600us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.883982 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.884072 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.884079 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:09.884081 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:09.884182 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.884196 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.884201 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:09.884292 (+ 91us) tablet.cc:699] Row locks acquired
0811 06:17:09.884294 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:09.884331 (+ 37us) write_op.cc:270] Start()
0811 06:17:09.884365 (+ 34us) write_op.cc:276] Timestamp: P: 1786429029884302 usec, L: 0
0811 06:17:09.884369 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.884603 (+ 234us) log.cc:842] Serialized 405 byte log entry
0811 06:17:09.888855 (+ 4252us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.889151 (+ 296us) write_op.cc:301] APPLY: starting
0811 06:17:09.889169 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.889214 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.889239 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.889317 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.889354 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:09.889359 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:09.889466 (+ 107us) log.cc:842] Serialized 23 byte log entry
0811 06:17:09.889533 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.889554 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:09.889561 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:09.889619 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.889623 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":527,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":725,"raft.queue_time_us":504,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":305,"replication_time_us":4462}]]}
I20260811 06:17:09.902959 11656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a" } modify_external_catalogs: true
I20260811 06:17:09.903599 11656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a" } modify_external_catalogs: true
I20260811 06:17:09.905481 13701 ts_tablet_manager.cc:1905] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:09.911844 11361 tablet_bootstrap.cc:654] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.912374 11365 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.912519 11365 ts_tablet_manager.cc:1397] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260811 06:17:09.913198 11365 raft_consensus.cc:348] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.913437 11365 raft_consensus.cc:374] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.913506 11365 raft_consensus.cc:729] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.913897 11365 consensus_queue.cc:260] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.914564 11365 ts_tablet_manager.cc:1428] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:09.914866 11365 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.915025 13615 raft_consensus.cc:482] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:09.915158 13615 raft_consensus.cc:504] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.915817 13615 leader_election.cc:288] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:09.916554 11365 tablet_bootstrap.cc:654] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.917057 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:09.917748 10555 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.920671 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:09.918089 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:09.920809 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.918509 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.918668 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:09.921463 10564 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:09.921572 10564 leader_election.cc:302] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:09.918756 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.921778 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.922114 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.922420 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.922693 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.922734 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.918893 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.920521 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.922092 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.923094 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.923224 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.923488 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.923933 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.924010 13615 raft_consensus.cc:2726] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:09.919298 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.924324 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.924690 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.925103 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:09.925499 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:09.945449 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 86) took 1400 ms (client timeout 1000 ms). Trace:
W20260811 06:17:09.945660 11663 rpcz_store.cc:269] 0811 06:17:08.545038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.619166 (+ 74128us) service_pool.cc:227] Handling call
0811 06:17:09.605053 (+985887us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.605061 (+ 8us) write_op.cc:454] Released schema lock
0811 06:17:09.945372 (+340311us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.595991 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.596128 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.596137 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:09.596139 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:09.596268 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.596285 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.596301 (+ 16us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:09.596384 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:09.596387 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:09.596431 (+ 44us) write_op.cc:270] Start()
0811 06:17:09.596473 (+ 42us) write_op.cc:276] Timestamp: P: 1786429029596392 usec, L: 0
0811 06:17:09.596477 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.596683 (+ 206us) log.cc:842] Serialized 530 byte log entry
0811 06:17:09.601017 (+ 4334us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.601136 (+ 119us) write_op.cc:301] APPLY: starting
0811 06:17:09.601153 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.601198 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.601226 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.601304 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.601341 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:09.601347 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:09.601451 (+ 104us) log.cc:842] Serialized 23 byte log entry
0811 06:17:09.601520 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.601544 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:09.601551 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":22433,"reported_tablets":186,"child_traces":[["op",{"apply.queue_time_us":71,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":478,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":815,"prepare.run_wall_time_us":815,"raft.queue_time_us":470,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":261,"replication_time_us":4512}]]}
I20260811 06:17:09.950310 11365 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:09.950464 11365 ts_tablet_manager.cc:1397] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
I20260811 06:17:09.951526 11663 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_364d018e0f034bee935a0a9ab1249f34" } new_table_name: "default.Table_ccd7875b455a463e917b1bfddbbf5177" modify_external_catalogs: true
I20260811 06:17:09.951824 11365 raft_consensus.cc:348] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:09.952241 11365 raft_consensus.cc:374] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:09.952339 11365 raft_consensus.cc:729] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:09.952709 11365 consensus_queue.cc:260] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:09.957288 11046 consensus_peers.cc:487] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d94d27431a4d5e93f1c1ce8c7b6752. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:09.959400 11365 ts_tablet_manager.cc:1428] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260811 06:17:09.964793 11365 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:09.968245 13701 ts_tablet_manager.cc:1918] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:09.969878 11362 tablet_bootstrap.cc:654] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:09.985553 13701 log.cc:1196] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/916b91088d7d4024a02214c958c0825b
I20260811 06:17:09.986454 13701 ts_tablet_manager.cc:1939] T 916b91088d7d4024a02214c958c0825b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:09.988095 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 916b91088d7d4024a02214c958c0825b (table default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]) successfully deleted
W20260811 06:17:09.990264 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:09.991796 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:09.993235 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:09.994313 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
I20260811 06:17:09.996838 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 154) took 3941 ms. Trace:
W20260811 06:17:09.996974 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
W20260811 06:17:10.000733 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:09.997573 11365 tablet_bootstrap.cc:654] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.005476 12726 rpcz_store.cc:276] 0811 06:17:06.055003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.061544 (+ 6541us) service_pool.cc:227] Handling call
0811 06:17:09.838687 (+3777143us) ts_tablet_manager.cc:1145] Deleting tablet 2fcf7c7a470144c0a084aebc2032d896
0811 06:17:09.838698 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:09.843933 (+ 5235us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.881944 (+ 38011us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:09.996817 (+114873us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3776715}
I20260811 06:17:10.006011 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 155) took 3944 ms. Trace:
I20260811 06:17:10.006093 12726 rpcz_store.cc:276] 0811 06:17:06.061591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.062957 (+ 1366us) service_pool.cc:227] Handling call
0811 06:17:10.005861 (+3942904us) ts_tablet_manager.cc:1145] Deleting tablet 79f307f50e044435be880079219170d8
0811 06:17:10.005875 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.005990 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3942673}
I20260811 06:17:10.006424 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 156) took 3898 ms. Trace:
I20260811 06:17:10.007062 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 19d9e21184b6458493fb6dee48d40602 (DEFAULT_TABLE table=default.Table_ea5412dbd9ad48b29a075b80dae49bdb [id=e69b386b04cf4ad0ab23927c3fd8ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.006498 12726 rpcz_store.cc:276] 0811 06:17:06.107973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.108211 (+ 238us) service_pool.cc:227] Handling call
0811 06:17:10.006300 (+3898089us) ts_tablet_manager.cc:1145] Deleting tablet b79f635593b04cd59d43d54f702a8cc6
0811 06:17:10.006320 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.006407 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3897735}
I20260811 06:17:10.007522 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d9e21184b6458493fb6dee48d40602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.008180 10884 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1ee0f428a40adbe6d34df217b6cc4 (DEFAULT_TABLE table=default.Table_aa46838bbe644da4ab380925d952c7ea [id=a5441e79e03f4218a4e6eab0c7bde199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.008565 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1ee0f428a40adbe6d34df217b6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.010044 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 19d9e21184b6458493fb6dee48d40602 (DEFAULT_TABLE table=default.Table_ea5412dbd9ad48b29a075b80dae49bdb [id=e69b386b04cf4ad0ab23927c3fd8ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.010444 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d9e21184b6458493fb6dee48d40602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.012034 11362 tablet_bootstrap.cc:492] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.012305 11362 ts_tablet_manager.cc:1397] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.119s user 0.008s sys 0.000s
I20260811 06:17:10.014744 11362 raft_consensus.cc:348] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.015372 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2fcf7c7a470144c0a084aebc2032d896 (table default.Table_0363307b6205431e911d6f5a556b6bd2 [id=3e9743f7545f40bdbd3c5957da345f8b]) successfully deleted
W20260811 06:17:10.015887 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:10.015223 11362 raft_consensus.cc:374] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:10.016165 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
I20260811 06:17:10.016655 11362 raft_consensus.cc:729] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.017208 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 (DEFAULT_TABLE table=default.Table_d58c8185f2b547b58e81aeb849c8a9ad [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.017472 10613 tablet_service.cc:1467] Processing CreateTablet for tablet a0c8b46163af4623b93af79302871941 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.017870 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6280a32b6c49f5886fa1ff8745b740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.017208 10626 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1ee0f428a40adbe6d34df217b6cc4 (DEFAULT_TABLE table=default.Table_aa46838bbe644da4ab380925d952c7ea [id=a5441e79e03f4218a4e6eab0c7bde199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.018440 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1ee0f428a40adbe6d34df217b6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.018934 10880 tablet_service.cc:1467] Processing CreateTablet for tablet a0c8b46163af4623b93af79302871941 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.019289 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c8b46163af4623b93af79302871941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.019294 11362 consensus_queue.cc:260] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.022022 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 (DEFAULT_TABLE table=default.Table_d58c8185f2b547b58e81aeb849c8a9ad [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.022105 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 16c20209d9e4499e9da957d525cfa459 (DEFAULT_TABLE table=default.Table_41898761f3ca4302863c36bdc1437def [id=68d172880c644b1981de782342d2d90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.022413 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6280a32b6c49f5886fa1ff8745b740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.022642 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c20209d9e4499e9da957d525cfa459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.023214 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c8b46163af4623b93af79302871941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.027251 11362 ts_tablet_manager.cc:1428] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260811 06:17:10.030197 11362 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.032609 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 19d9e21184b6458493fb6dee48d40602 (DEFAULT_TABLE table=default.Table_ea5412dbd9ad48b29a075b80dae49bdb [id=e69b386b04cf4ad0ab23927c3fd8ffcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.032752 11119 tablet_service.cc:1467] Processing CreateTablet for tablet b3a1ee0f428a40adbe6d34df217b6cc4 (DEFAULT_TABLE table=default.Table_aa46838bbe644da4ab380925d952c7ea [id=a5441e79e03f4218a4e6eab0c7bde199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.033072 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d9e21184b6458493fb6dee48d40602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.033674 11128 tablet_service.cc:1467] Processing CreateTablet for tablet a0c8b46163af4623b93af79302871941 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.034065 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0c8b46163af4623b93af79302871941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.032217 10629 tablet_service.cc:1467] Processing CreateTablet for tablet 16c20209d9e4499e9da957d525cfa459 (DEFAULT_TABLE table=default.Table_41898761f3ca4302863c36bdc1437def [id=68d172880c644b1981de782342d2d90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.038204 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3a1ee0f428a40adbe6d34df217b6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.038362 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c20209d9e4499e9da957d525cfa459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.043377 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 (DEFAULT_TABLE table=default.Table_d58c8185f2b547b58e81aeb849c8a9ad [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.043826 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6280a32b6c49f5886fa1ff8745b740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.046564 11115 tablet_service.cc:1467] Processing CreateTablet for tablet 16c20209d9e4499e9da957d525cfa459 (DEFAULT_TABLE table=default.Table_41898761f3ca4302863c36bdc1437def [id=68d172880c644b1981de782342d2d90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.047053 11115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c20209d9e4499e9da957d525cfa459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.047617 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 157) took 3931 ms. Trace:
I20260811 06:17:10.047741 12726 rpcz_store.cc:276] 0811 06:17:06.116025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:06.116217 (+ 192us) service_pool.cc:227] Handling call
0811 06:17:10.045080 (+3928863us) ts_tablet_manager.cc:1145] Deleting tablet 9a79e23d311a447480c70393259cbfae
0811 06:17:10.047450 (+ 2370us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.047589 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3928565}
I20260811 06:17:10.048130 12726 tablet_replica.cc:330] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.048349 12726 raft_consensus.cc:2229] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.050858 13615 raft_consensus.cc:482] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.053475 12726 raft_consensus.cc:2258] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.053457 13615 raft_consensus.cc:504] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.054152 13615 leader_election.cc:288] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.054464 11362 tablet_bootstrap.cc:654] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.054961 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 990e3308157d4edbb2ba8744a09d0b06 (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.055092 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.055408 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990e3308157d4edbb2ba8744a09d0b06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:10.055828 10564 leader_election.cc:341] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.056582 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 9258f70b17214a90bb0da4127dfed959 (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.056977 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9258f70b17214a90bb0da4127dfed959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.065498 12726 ts_tablet_manager.cc:1905] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.066408 13730 raft_consensus.cc:482] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:10.066504 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
I20260811 06:17:10.041669 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:10.068269 13730 raft_consensus.cc:504] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.068423 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:10.068923 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:10.067270 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 9258f70b17214a90bb0da4127dfed959 (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.069603 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9258f70b17214a90bb0da4127dfed959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.067267 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 990e3308157d4edbb2ba8744a09d0b06 (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.074101 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990e3308157d4edbb2ba8744a09d0b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.074647 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:10.075371 13730 leader_election.cc:288] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.075668 11362 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.076006 11362 ts_tablet_manager.cc:1397] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.000s
I20260811 06:17:10.076960 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:10.077258 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:10.077909 11362 raft_consensus.cc:348] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.078377 11362 raft_consensus.cc:374] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.078532 11362 raft_consensus.cc:729] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.079036 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:10.079279 13282 raft_consensus.cc:482] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.079509 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:10.079444 13282 raft_consensus.cc:504] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.078905 11362 consensus_queue.cc:260] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.080040 13282 leader_election.cc:288] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.079986 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
I20260811 06:17:10.080628 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:10.081692 11362 ts_tablet_manager.cc:1428] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:10.082458 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.082753 10662 raft_consensus.cc:2454] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:10.083070 11362 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.083236 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:10.083312 11046 leader_election.cc:302] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:10.083745 13282 raft_consensus.cc:2781] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:10.083827 13282 raft_consensus.cc:482] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:10.083887 13282 raft_consensus.cc:3037] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.084190 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:10.084648 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:10.085078 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:10.085304 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:10.087908 13282 raft_consensus.cc:504] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.095222 11362 tablet_bootstrap.cc:654] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.098299 12726 ts_tablet_manager.cc:1918] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.098578 12726 log.cc:1196] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:10.098905 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:10.099525 12726 ts_tablet_manager.cc:1939] T a183d0915a5a48c2a26994d47f6fe266 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.099829 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:10.100376 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 158) took 2409 ms. Trace:
I20260811 06:17:10.100726 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:10.100895 12726 rpcz_store.cc:276] 0811 06:17:07.690399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.690472 (+ 73us) service_pool.cc:227] Handling call
0811 06:17:10.048087 (+2357615us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:10.048097 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.072427 (+ 24330us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.098168 (+ 25741us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.100297 (+ 2129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357362}
I20260811 06:17:10.101902 11670 catalog_manager.cc:5495] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:10.103351 13567 raft_consensus.cc:482] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.103758 13567 raft_consensus.cc:504] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.104005 12726 tablet_replica.cc:330] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.104207 12726 raft_consensus.cc:2229] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.104373 12726 raft_consensus.cc:2258] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.104426 13567 leader_election.cc:288] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.104533 13567 raft_consensus.cc:482] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.104619 13567 raft_consensus.cc:504] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.104944 12726 ts_tablet_manager.cc:1905] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.105167 13567 leader_election.cc:288] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.108105 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.108397 10662 raft_consensus.cc:2379] T 2e1460fe55fb48f890f31e1cc86d1d23 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:10.103767 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a183d0915a5a48c2a26994d47f6fe266 (table default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]) successfully deleted
I20260811 06:17:10.108995 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
W20260811 06:17:10.109323 10810 leader_election.cc:341] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 78d94d27431a4d5e93f1c1ce8c7b6752
I20260811 06:17:10.109838 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:10.110303 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:10.110733 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:10.111963 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:10.112270 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:10.112710 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:10.114919 11670 catalog_manager.cc:5495] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:10.121682 11670 catalog_manager.cc:5495] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:10.123982 12726 ts_tablet_manager.cc:1918] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.124846 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:10.125334 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:10.125759 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:10.126009 12726 log.cc:1196] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/0813b34919a14a2481857e9f87b217c8
I20260811 06:17:10.126470 12726 ts_tablet_manager.cc:1939] T 0813b34919a14a2481857e9f87b217c8 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.126762 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:10.127269 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
W20260811 06:17:10.127990 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6dd4a21086934bd9a64d74075ab41fbe consensus state has no leader
I20260811 06:17:10.128257 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:10.128743 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:10.129123 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:10.129638 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:10.130071 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:10.130445 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:10.133569 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:10.134150 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:10.134251 11362 tablet_bootstrap.cc:492] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.134519 11362 ts_tablet_manager.cc:1397] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.011s
I20260811 06:17:10.134931 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:10.135248 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:10.136555 11362 raft_consensus.cc:348] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.137032 11362 raft_consensus.cc:374] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.137154 11362 raft_consensus.cc:729] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.137565 11362 consensus_queue.cc:260] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.140491 11362 ts_tablet_manager.cc:1428] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260811 06:17:10.141924 11362 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.152872 11362 tablet_bootstrap.cc:654] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.114362 13306 raft_consensus.cc:482] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.161588 13306 raft_consensus.cc:504] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.162339 13306 leader_election.cc:288] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.115734 12484 consensus_queue.cc:1035] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.165999 13282 leader_election.cc:288] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.170068 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 159) took 2475 ms. Trace:
I20260811 06:17:10.170197 12726 rpcz_store.cc:276] 0811 06:17:07.694200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.694258 (+ 58us) service_pool.cc:227] Handling call
0811 06:17:10.103953 (+2409695us) ts_tablet_manager.cc:1145] Deleting tablet 0813b34919a14a2481857e9f87b217c8
0811 06:17:10.103968 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.107946 (+ 3978us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.123854 (+ 15908us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.170035 (+ 46181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2409443}
I20260811 06:17:10.170763 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 163) took 2475 ms. Trace:
I20260811 06:17:10.170874 12726 rpcz_store.cc:276] 0811 06:17:07.694788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.695094 (+ 306us) service_pool.cc:227] Handling call
0811 06:17:10.170636 (+2475542us) ts_tablet_manager.cc:1145] Deleting tablet ecd1a22b6d2b4e9fb29860a4fa3a5045
0811 06:17:10.170649 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.170742 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475265}
I20260811 06:17:10.171173 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 160) took 2476 ms. Trace:
I20260811 06:17:10.171238 12726 rpcz_store.cc:276] 0811 06:17:07.694433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.695325 (+ 892us) service_pool.cc:227] Handling call
0811 06:17:10.171096 (+2475771us) ts_tablet_manager.cc:1145] Deleting tablet a0e5b4cdeb464861ada487eeb1b901a6
0811 06:17:10.171105 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.171160 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475531}
I20260811 06:17:10.171471 12726 tablet_replica.cc:330] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.171676 12726 raft_consensus.cc:2229] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.171855 12726 raft_consensus.cc:2258] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.172447 12726 ts_tablet_manager.cc:1905] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.174707 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 0813b34919a14a2481857e9f87b217c8 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
W20260811 06:17:10.175258 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ecd1a22b6d2b4e9fb29860a4fa3a5045 because the tablet was not found. No further retry: Not found: Tablet not found: ecd1a22b6d2b4e9fb29860a4fa3a5045
W20260811 06:17:10.175628 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because the tablet was not found. No further retry: Not found: Tablet not found: a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:10.182215 11362 tablet_bootstrap.cc:492] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.182510 11362 ts_tablet_manager.cc:1397] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.006s
I20260811 06:17:10.183707 13074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Bootstrap replayed 1/1 log segments. Stats: ops{read=570 overwritten=0 applied=569 ignored=0} inserts{seen=548 ignored=0} mutations{seen=626 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260811 06:17:10.184185 11362 raft_consensus.cc:348] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.184887 11362 raft_consensus.cc:374] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.185174 11362 raft_consensus.cc:729] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.185612 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:10.184746 13074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Bootstrap complete.
I20260811 06:17:10.185871 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916b91088d7d4024a02214c958c0825b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.186229 10654 raft_consensus.cc:2454] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:10.186831 10810 leader_election.cc:302] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.187158 13567 raft_consensus.cc:2781] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:10.186059 11362 consensus_queue.cc:260] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.187232 13567 raft_consensus.cc:482] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:10.187294 13567 raft_consensus.cc:3037] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.188189 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:10.188398 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:10.188936 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:10.189059 11362 ts_tablet_manager.cc:1428] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260811 06:17:10.189679 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:10.189878 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:10.190317 13567 raft_consensus.cc:504] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.190662 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
I20260811 06:17:10.190748 11362 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.191510 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:10.191665 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916b91088d7d4024a02214c958c0825b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:10.191869 10662 raft_consensus.cc:3037] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.194440 10662 raft_consensus.cc:2454] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:10.194824 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:10.195204 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:10.195245 10810 leader_election.cc:302] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.191032 13567 leader_election.cc:288] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.195715 13567 raft_consensus.cc:2781] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:10.195870 13567 raft_consensus.cc:686] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:10.196115 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:10.196148 13567 consensus_queue.cc:237] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.196444 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:10.196768 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:10.197759 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:10.198050 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:10.200495 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:10.202283 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:10.202630 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:10.203264 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:10.203830 11362 tablet_bootstrap.cc:654] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.203750 12726 ts_tablet_manager.cc:1918] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:10.204496 12726 log.cc:1196] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/217f60a1ca044af38f9ee9093e021c27
I20260811 06:17:10.207891 12726 ts_tablet_manager.cc:1939] T 217f60a1ca044af38f9ee9093e021c27 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.208798 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:10.209576 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:10.211702 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:10.212213 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
I20260811 06:17:10.213783 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 166) took 2518 ms. Trace:
I20260811 06:17:10.214368 12726 rpcz_store.cc:276] 0811 06:17:07.695262 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.695399 (+ 137us) service_pool.cc:227] Handling call
0811 06:17:10.171418 (+2476019us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:10.171427 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.178880 (+ 7453us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.202747 (+ 23867us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.213640 (+ 10893us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475630}
I20260811 06:17:10.216113 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 217f60a1ca044af38f9ee9093e021c27 (table default.Table_e7d2f44fbe0746df9f34637def4bdd58 [id=cb57b7fc2e9e49059e05ee4738c18875]) successfully deleted
I20260811 06:17:10.216353 12726 tablet_replica.cc:330] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.217294 12726 raft_consensus.cc:2229] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.218180 12726 raft_consensus.cc:2258] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.222533 13701 tablet_replica.cc:330] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:10.222066 12726 ts_tablet_manager.cc:1905] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.222875 13701 raft_consensus.cc:2229] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.223228 13615 raft_consensus.cc:482] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.223361 13615 raft_consensus.cc:504] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.224012 13615 leader_election.cc:288] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.224438 13701 raft_consensus.cc:2258] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.224486 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:10.226171 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:10.226570 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:10.230053 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:10.231205 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:10.231642 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:10.232054 11365 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.232326 11365 ts_tablet_manager.cc:1397] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.270s user 0.040s sys 0.051s
I20260811 06:17:10.232609 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:10.233820 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:10.233875 11365 raft_consensus.cc:348] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.234246 11365 raft_consensus.cc:374] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.234201 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:10.234370 11365 raft_consensus.cc:729] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.234747 11365 consensus_queue.cc:260] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.235482 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:10.235872 11365 ts_tablet_manager.cc:1428] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:10.236397 11365 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.237681 13074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:10.239579 10923 raft_consensus.cc:3037] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.241886 11365 tablet_bootstrap.cc:654] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.236235 11653 catalog_manager.cc:5495] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:10.244251 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.244545 10923 raft_consensus.cc:2454] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:10.246616 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 9258f70b17214a90bb0da4127dfed959 (DEFAULT_TABLE table=default.Table_b713c78a966d4e9e801312e6f5de79c5 [id=cb8d001ce6cf4f2aabbf15d3254690b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.246905 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:10.247234 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9258f70b17214a90bb0da4127dfed959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.247373 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:10.247725 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:10.248396 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:10.251370 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:10.255519 11365 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.255797 11365 ts_tablet_manager.cc:1397] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.006s
I20260811 06:17:10.255743 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:10.257030 11365 raft_consensus.cc:348] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.257396 11365 raft_consensus.cc:374] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.257493 11365 raft_consensus.cc:729] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.257814 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:10.257894 11365 consensus_queue.cc:260] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.258234 11656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 085179a610734942b9dd050ce9cf56d4
I20260811 06:17:10.258852 11656 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 81) took 3942 ms. Trace:
I20260811 06:17:10.259142 11365 ts_tablet_manager.cc:1428] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:10.259004 11656 rpcz_store.cc:276] 0811 06:17:06.316218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.902581 (+3586363us) service_pool.cc:227] Handling call
0811 06:17:09.903947 (+ 1366us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:09.904256 (+ 309us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:09.904450 (+ 194us) catalog_manager.cc:2761] Locking tablets
0811 06:17:09.975475 (+ 71025us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:09.986169 (+ 10694us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:09.986270 (+ 101us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:10.258134 (+271864us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:10.258788 (+ 654us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.976313 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.976418 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.976423 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:09.976425 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:09.976533 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.976547 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.976552 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:09.976696 (+ 144us) tablet.cc:699] Row locks acquired
0811 06:17:09.976698 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:09.976743 (+ 45us) write_op.cc:270] Start()
0811 06:17:09.976779 (+ 36us) write_op.cc:276] Timestamp: P: 1786429029976704 usec, L: 0
0811 06:17:09.976782 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.976950 (+ 168us) log.cc:842] Serialized 728 byte log entry
0811 06:17:09.980200 (+ 3250us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.980386 (+ 186us) write_op.cc:301] APPLY: starting
0811 06:17:09.980400 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.980481 (+ 81us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.980504 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.980567 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.980599 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:09.980605 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:09.980676 (+ 71us) log.cc:842] Serialized 29 byte log entry
0811 06:17:09.980787 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.980803 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:09.980809 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:09.980861 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.980865 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":144,"apply.run_cpu_time_us":502,"apply.run_wall_time_us":537,"mutex_wait_us":44,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":733,"prepare.run_wall_time_us":733,"raft.queue_time_us":59,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"replication_time_us":3398}]]}
I20260811 06:17:10.259716 11365 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.263402 11361 tablet_bootstrap.cc:492] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:10.263406 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.263566 11361 ts_tablet_manager.cc:1397] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.370s user 0.006s sys 0.006s
I20260811 06:17:10.264766 11361 raft_consensus.cc:348] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.264986 11361 raft_consensus.cc:374] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.265053 11361 raft_consensus.cc:729] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.265275 11361 consensus_queue.cc:260] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.265898 11361 ts_tablet_manager.cc:1428] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:10.266172 11361 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:10.266305 11365 tablet_bootstrap.cc:654] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.266582 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:10.269291 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
I20260811 06:17:10.269687 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 990e3308157d4edbb2ba8744a09d0b06 (DEFAULT_TABLE table=default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:10.270571 10923 raft_consensus.cc:3037] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.273963 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:10.274664 11676 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 80) took 3966 ms. Trace:
I20260811 06:17:10.274880 11676 rpcz_store.cc:276] 0811 06:17:06.308287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.897086 (+3588799us) service_pool.cc:227] Handling call
0811 06:17:09.897876 (+ 790us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:09.898031 (+ 155us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:09.898104 (+ 73us) catalog_manager.cc:2761] Locking tablets
0811 06:17:09.978118 (+ 80014us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:10.014638 (+ 36520us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:10.014749 (+ 111us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:10.273879 (+259130us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:10.274495 (+ 616us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.979353 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.979448 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.979453 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:09.979455 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:09.979555 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.979564 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.979569 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:09.979677 (+ 108us) tablet.cc:699] Row locks acquired
0811 06:17:09.979680 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:09.979712 (+ 32us) write_op.cc:270] Start()
0811 06:17:09.979738 (+ 26us) write_op.cc:276] Timestamp: P: 1786429029979675 usec, L: 0
0811 06:17:09.979742 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.979959 (+ 217us) log.cc:842] Serialized 793 byte log entry
0811 06:17:10.013586 (+ 33627us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.013897 (+ 311us) write_op.cc:301] APPLY: starting
0811 06:17:10.013921 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.013975 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.014007 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.014095 (+ 88us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.014136 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:10.014142 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.014245 (+ 103us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.014330 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.014356 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:10.014365 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.014427 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.014430 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":601,"apply.run_wall_time_us":602,"num_ops":2,"prepare.queue_time_us":545,"prepare.run_cpu_time_us":8547,"prepare.run_wall_time_us":33850,"raft.queue_time_us":317,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":33816,"thread_start_us":33106,"threads_started":1}]]}
I20260811 06:17:10.275530 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.276103 11676 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_021b3433e8a447318649cd83bcc5a326" } new_table_name: "default.Table_236cd15efbb74d3abf8d6140bb8702e3" modify_external_catalogs: true
I20260811 06:17:10.276829 13669 raft_consensus.cc:482] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.276962 13669 raft_consensus.cc:504] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.277571 13669 leader_election.cc:288] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:10.278366 10564 leader_election.cc:341] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.278946 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1349b0ea48b848398d4bdda528358c30" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:10.279392 10564 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.281445 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.282407 10915 raft_consensus.cc:3037] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.286525 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.286782 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287006 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287177 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287424 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287456 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287580 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287647 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287690 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287886 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287806 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.287845 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.288125 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.288511 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.288111 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.289817 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.290019 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.290846 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet ab32f96671984766a54b5ee904c465f7 with delete_type TABLET_DATA_DELETED (replaced by tablet 485e465a43c14fc8ad3a70c6e3ee7628) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.291445 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet a67daf4bdf45464b916905f432f0ec9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.292496 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet f9fd17e8c6264f898493c15b0aa5518d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.293365 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.294152 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet b0cdc826a1d8460aba1aae684c13131d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.294183 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.295694 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.295789 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.296761 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 52953438e7c248b1a758ee219405d7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:50 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:10.297314 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
I20260811 06:17:10.297435 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 45ebef95922f4e7f93533b54c07b7cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.298249 13701 ts_tablet_manager.cc:1905] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.298583 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.299393 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.300531 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.300544 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.302852 13738 consensus_queue.cc:1035] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.303376 13738 consensus_queue.cc:1035] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:10.303728 11684 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 85) took 2785 ms (client timeout 1000 ms). Trace:
I20260811 06:17:10.304297 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:10.304543 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:10.305004 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
I20260811 06:17:10.309326 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:10.309677 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:10.310073 13702 tablet_replica.cc:330] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:10.310297 13702 raft_consensus.cc:2229] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.310497 13702 raft_consensus.cc:2258] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.311286 13702 ts_tablet_manager.cc:1905] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.312932 11365 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.313223 11365 ts_tablet_manager.cc:1397] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.004s
I20260811 06:17:10.316926 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:10.317109 10651 raft_consensus.cc:3037] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.316670 11365 raft_consensus.cc:348] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.317340 11365 raft_consensus.cc:374] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.317515 11365 raft_consensus.cc:729] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.317939 11365 consensus_queue.cc:260] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.318281 13702 ts_tablet_manager.cc:1918] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:10.318473 13702 log.cc:1196] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:10.319160 13702 ts_tablet_manager.cc:1939] T 14a36a644dc4491dad838ce4e19793ab P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:10.319679 11365 ts_tablet_manager.cc:1428] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:10.320115 10651 raft_consensus.cc:2454] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:10.320956 11365 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.322880 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6703e639ab2042e78fadc63bd18c7602" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.323093 10654 raft_consensus.cc:2454] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:10.324882 13282 consensus_queue.cc:1035] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.326359 11046 leader_election.cc:302] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:10.326683 13282 raft_consensus.cc:2781] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:10.326864 13282 raft_consensus.cc:686] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:10.327142 13282 consensus_queue.cc:237] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.329375 11046 leader_election.cc:302] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:10.329938 11365 tablet_bootstrap.cc:654] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.331902 12726 ts_tablet_manager.cc:1918] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:17:10.332669 11046 raft_consensus.cc:2670] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:17:10.333357 12726 log.cc:1196] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:10.335697 13741 consensus_queue.cc:1035] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:10.338780 11663 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e87f192975a484ea038dc6c66fd6bae consensus state has no leader
W20260811 06:17:10.339049 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:10.339020 12726 ts_tablet_manager.cc:1939] T 2b0ae9a1d3b74c3985637439819b63ef P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:10.339882 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b0ae9a1d3b74c3985637439819b63ef already in progress: creating tablet
W20260811 06:17:10.340483 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:10.341097 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:10.341674 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:10.342397 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
W20260811 06:17:10.343009 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
W20260811 06:17:10.343703 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
W20260811 06:17:10.337096 11684 rpcz_store.cc:269] 0811 06:17:07.515700 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.891509 (+375809us) service_pool.cc:227] Handling call
0811 06:17:10.301060 (+2409551us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.527733 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.527847 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.527853 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:09.527856 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:09.528075 (+ 219us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.528093 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.528099 (+ 6us) tablet.cc:683] Acquiring locks for 4 operations
0811 06:17:09.528227 (+ 128us) tablet.cc:699] Row locks acquired
0811 06:17:09.528230 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:09.528287 (+ 57us) write_op.cc:270] Start()
0811 06:17:09.528324 (+ 37us) write_op.cc:276] Timestamp: P: 1786429029528251 usec, L: 0
0811 06:17:09.528329 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.528579 (+ 250us) log.cc:842] Serialized 1662 byte log entry
0811 06:17:09.533445 (+ 4866us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.534254 (+ 809us) write_op.cc:301] APPLY: starting
0811 06:17:09.534276 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.534397 (+ 121us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.534429 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.534528 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.534568 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0811 06:17:09.534575 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:09.534682 (+ 107us) log.cc:842] Serialized 41 byte log entry
0811 06:17:09.534769 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.534798 (+ 29us) write_op.cc:454] Released schema lock
0811 06:17:09.534805 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:09.534871 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.534874 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9447,"reported_tablets":194,"child_traces":[["op",{"apply.queue_time_us":739,"apply.run_cpu_time_us":685,"apply.run_wall_time_us":685,"num_ops":4,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":967,"prepare.run_wall_time_us":967,"raft.queue_time_us":489,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":458,"replication_time_us":5090}]]}
I20260811 06:17:10.344270 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 161) took 2649 ms. Trace:
I20260811 06:17:10.345774 12726 rpcz_store.cc:276] 0811 06:17:07.694606 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.694649 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:10.216094 (+2521445us) ts_tablet_manager.cc:1145] Deleting tablet 2b0ae9a1d3b74c3985637439819b63ef
0811 06:17:10.216211 (+ 117us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.292370 (+ 76159us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.329572 (+ 37202us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.344065 (+ 14493us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2520236}
I20260811 06:17:10.347354 11684 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_71a49e0ffd5f4420a30d39b21a9487af" } modify_external_catalogs: true
I20260811 06:17:10.347963 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 2b0ae9a1d3b74c3985637439819b63ef (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]) successfully deleted
I20260811 06:17:10.348564 12726 tablet_replica.cc:330] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.348686 11362 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.348809 11362 ts_tablet_manager.cc:1397] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.158s user 0.007s sys 0.015s
I20260811 06:17:10.349004 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]) successfully deleted
W20260811 06:17:10.348634 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 92) took 2419 ms (client timeout 1000 ms). Trace:
I20260811 06:17:10.349529 12726 raft_consensus.cc:2229] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.349676 11362 raft_consensus.cc:348] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.349983 11362 raft_consensus.cc:374] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.350052 11362 raft_consensus.cc:729] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.350274 11362 consensus_queue.cc:260] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.350252 12726 raft_consensus.cc:2258] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.350817 11362 ts_tablet_manager.cc:1428] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:10.351263 11362 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.352134 10998 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:10.353145 12726 ts_tablet_manager.cc:1905] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.356954 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e1460fe55fb48f890f31e1cc86d1d23" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.357626 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78d94d27431a4d5e93f1c1ce8c7b6752" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.359833 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.363006 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.363561 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.364009 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.364537 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.364970 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.365896 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1349b0ea48b848398d4bdda528358c30" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:10.366298 10555 leader_election.cc:341] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.366528 10555 leader_election.cc:302] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.366917 13669 raft_consensus.cc:2726] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:10.368397 12944 raft_consensus.cc:482] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.369053 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6703e639ab2042e78fadc63bd18c7602" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.369241 10915 raft_consensus.cc:2454] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:10.369302 10555 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.369407 10555 leader_election.cc:302] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.369410 11365 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.369248 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e7d97649c94ef3a73a0ea9acc57ab2" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:10.369689 11365 ts_tablet_manager.cc:1397] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.002s
I20260811 06:17:10.369755 13669 raft_consensus.cc:2726] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:10.369809 10916 raft_consensus.cc:3037] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.372278 10916 raft_consensus.cc:2454] T 19e7d97649c94ef3a73a0ea9acc57ab2 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:10.350347 11672 rpcz_store.cc:269] 0811 06:17:07.882759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.900994 (+ 18235us) service_pool.cc:227] Handling call
0811 06:17:10.302051 (+2401057us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.417241 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.417430 (+ 189us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.417438 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:09.417442 (+ 4us) tablet.cc:660] Decoding operations
0811 06:17:09.417580 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.417597 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.417602 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:09.417680 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:09.417683 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:09.417773 (+ 90us) write_op.cc:270] Start()
0811 06:17:09.417826 (+ 53us) write_op.cc:276] Timestamp: P: 1786429029417747 usec, L: 0
0811 06:17:09.417832 (+ 6us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.418089 (+ 257us) log.cc:842] Serialized 530 byte log entry
0811 06:17:09.422584 (+ 4495us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.422715 (+ 131us) write_op.cc:301] APPLY: starting
0811 06:17:09.422731 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.422772 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.422799 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.422854 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.422889 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:09.422895 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:09.422998 (+ 103us) log.cc:842] Serialized 23 byte log entry
0811 06:17:09.423064 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.423086 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:09.423093 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:09.423152 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.423155 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":98648,"reported_tablets":198,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":493,"apply.run_wall_time_us":493,"num_ops":1,"prepare.queue_time_us":17883,"prepare.run_cpu_time_us":976,"prepare.run_wall_time_us":976,"raft.queue_time_us":988,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":250,"replication_time_us":4728}]]}
I20260811 06:17:10.373675 11365 raft_consensus.cc:348] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.374157 11365 raft_consensus.cc:374] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.374245 11365 raft_consensus.cc:729] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.374476 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 990e3308157d4edbb2ba8744a09d0b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:10.374568 11365 consensus_queue.cc:260] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.377183 11365 ts_tablet_manager.cc:1428] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260811 06:17:10.379495 11365 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.365336 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.368537 12944 raft_consensus.cc:504] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.388888 12944 leader_election.cc:288] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.389535 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.398013 11362 tablet_bootstrap.cc:654] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.395295 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_1796e17e33e24c69bbf95e8514e84395"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:10.400439 11365 tablet_bootstrap.cc:654] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.405207 13701 ts_tablet_manager.cc:1918] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.407474 12726 ts_tablet_manager.cc:1918] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.409838 12726 log.cc:1196] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:10.412431 13732 raft_consensus.cc:482] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.412998 13732 raft_consensus.cc:504] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.414412 12726 ts_tablet_manager.cc:1939] T 585f92fc5b3d41bd97df525380fcab9f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.415515 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.415918 10654 raft_consensus.cc:2454] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:10.416390 10810 leader_election.cc:302] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.416838 12944 raft_consensus.cc:2781] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:10.416987 12944 raft_consensus.cc:482] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:10.417219 12944 raft_consensus.cc:3037] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.417474 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 162) took 2722 ms. Trace:
I20260811 06:17:10.417904 12726 rpcz_store.cc:276] 0811 06:17:07.694707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.694840 (+ 133us) service_pool.cc:227] Handling call
0811 06:17:10.348304 (+2653464us) ts_tablet_manager.cc:1145] Deleting tablet 585f92fc5b3d41bd97df525380fcab9f
0811 06:17:10.348421 (+ 117us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.364546 (+ 16125us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.406387 (+ 41841us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.417362 (+ 10975us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2652404}
I20260811 06:17:10.419902 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 165) took 2724 ms. Trace:
I20260811 06:17:10.420502 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 585f92fc5b3d41bd97df525380fcab9f (table default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]) successfully deleted
I20260811 06:17:10.420423 12726 rpcz_store.cc:276] 0811 06:17:07.694971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.695880 (+ 909us) service_pool.cc:227] Handling call
0811 06:17:10.419392 (+2723512us) ts_tablet_manager.cc:1145] Deleting tablet 59c4e76ecde14d0a86fedc84815e78a7
0811 06:17:10.419554 (+ 162us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.419775 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2723220}
W20260811 06:17:10.421662 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 59c4e76ecde14d0a86fedc84815e78a7 because the tablet was not found. No further retry: Not found: Tablet not found: 59c4e76ecde14d0a86fedc84815e78a7
I20260811 06:17:10.422562 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 164) took 2727 ms. Trace:
I20260811 06:17:10.422863 12726 rpcz_store.cc:276] 0811 06:17:07.694888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.695601 (+ 713us) service_pool.cc:227] Handling call
0811 06:17:10.422162 (+2726561us) ts_tablet_manager.cc:1145] Deleting tablet 2f243c792a634abf83484aef820dbb48
0811 06:17:10.422174 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.422444 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2725652}
W20260811 06:17:10.424134 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because the tablet was not found. No further retry: Not found: Tablet not found: 2f243c792a634abf83484aef820dbb48
I20260811 06:17:10.425083 13732 leader_election.cc:288] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.424968 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 167) took 2694 ms. Trace:
I20260811 06:17:10.425252 12726 rpcz_store.cc:276] 0811 06:17:07.730226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.730943 (+ 717us) service_pool.cc:227] Handling call
0811 06:17:10.424555 (+2693612us) ts_tablet_manager.cc:1145] Deleting tablet 8b282afe70184b0fb68d0e7cdcbcd2b7
0811 06:17:10.424572 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.424845 (+ 273us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2693049}
W20260811 06:17:10.426011 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1796e17e33e24c69bbf95e8514e84395 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:10.426440 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:10.427249 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 168) took 2696 ms. Trace:
I20260811 06:17:10.427475 12726 rpcz_store.cc:276] 0811 06:17:07.730343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.731221 (+ 878us) service_pool.cc:227] Handling call
0811 06:17:10.427057 (+2695836us) ts_tablet_manager.cc:1145] Deleting tablet b39dfcd1a66b4241bc6f5c38e930f048
0811 06:17:10.427100 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.427228 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2695643}
W20260811 06:17:10.428539 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b39dfcd1a66b4241bc6f5c38e930f048 because the tablet was not found. No further retry: Not found: Tablet not found: b39dfcd1a66b4241bc6f5c38e930f048
I20260811 06:17:10.429127 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 172) took 2698 ms. Trace:
I20260811 06:17:10.429340 12726 rpcz_store.cc:276] 0811 06:17:07.730746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.731440 (+ 694us) service_pool.cc:227] Handling call
0811 06:17:10.428944 (+2697504us) ts_tablet_manager.cc:1145] Deleting tablet 681736b44af04718b800d503ca645c1a
0811 06:17:10.428957 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.429080 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2697315}
W20260811 06:17:10.429922 10555 leader_election.cc:341] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.430047 10555 leader_election.cc:302] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:10.430122 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 681736b44af04718b800d503ca645c1a because the tablet was not found. No further retry: Not found: Tablet not found: 681736b44af04718b800d503ca645c1a
I20260811 06:17:10.430361 13669 raft_consensus.cc:2726] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:10.430688 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 169) took 2700 ms. Trace:
I20260811 06:17:10.430876 12726 rpcz_store.cc:276] 0811 06:17:07.730464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.732196 (+ 1732us) service_pool.cc:227] Handling call
0811 06:17:10.430437 (+2698241us) ts_tablet_manager.cc:1145] Deleting tablet 532208d7a02d448e8dac702ffe6c2ffc
0811 06:17:10.430449 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.430635 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2697983}
W20260811 06:17:10.431571 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because the tablet was not found. No further retry: Not found: Tablet not found: 532208d7a02d448e8dac702ffe6c2ffc
I20260811 06:17:10.431593 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 170) took 2701 ms. Trace:
I20260811 06:17:10.431726 12726 rpcz_store.cc:276] 0811 06:17:07.730549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.732454 (+ 1905us) service_pool.cc:227] Handling call
0811 06:17:10.431312 (+2698858us) ts_tablet_manager.cc:1145] Deleting tablet 97b348d30dc44fa383a27d9097c2e598
0811 06:17:10.431323 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.431543 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2698568}
I20260811 06:17:10.432336 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 171) took 2701 ms. Trace:
I20260811 06:17:10.432479 12726 rpcz_store.cc:276] 0811 06:17:07.730629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.732739 (+ 2110us) service_pool.cc:227] Handling call
0811 06:17:10.432153 (+2699414us) ts_tablet_manager.cc:1145] Deleting tablet f4f14a0add084048b92a501476ad6588
0811 06:17:10.432199 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.432288 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699239}
W20260811 06:17:10.432713 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 97b348d30dc44fa383a27d9097c2e598 because the tablet was not found. No further retry: Not found: Tablet not found: 97b348d30dc44fa383a27d9097c2e598
I20260811 06:17:10.433099 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 173) took 2702 ms. Trace:
I20260811 06:17:10.433270 12726 rpcz_store.cc:276] 0811 06:17:07.730865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.732957 (+ 2092us) service_pool.cc:227] Handling call
0811 06:17:10.432945 (+2699988us) ts_tablet_manager.cc:1145] Deleting tablet 7fbdda840466420f8d67a8cb5868ba03
0811 06:17:10.432959 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.433081 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699799}
W20260811 06:17:10.433547 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f4f14a0add084048b92a501476ad6588 because the tablet was not found. No further retry: Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
I20260811 06:17:10.433921 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 174) took 2699 ms. Trace:
W20260811 06:17:10.434118 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7fbdda840466420f8d67a8cb5868ba03 because the tablet was not found. No further retry: Not found: Tablet not found: 7fbdda840466420f8d67a8cb5868ba03
I20260811 06:17:10.434118 12726 rpcz_store.cc:276] 0811 06:17:07.734600 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.734648 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:10.433701 (+2699053us) ts_tablet_manager.cc:1145] Deleting tablet adc2d99019384c33840f16cbe98d336c
0811 06:17:10.433776 (+ 75us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.433871 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2698828}
I20260811 06:17:10.434728 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 175) took 2698 ms. Trace:
W20260811 06:17:10.434787 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet adc2d99019384c33840f16cbe98d336c because the tablet was not found. No further retry: Not found: Tablet not found: adc2d99019384c33840f16cbe98d336c
I20260811 06:17:10.434880 12726 rpcz_store.cc:276] 0811 06:17:07.736153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.736201 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:10.434544 (+2698343us) ts_tablet_manager.cc:1145] Deleting tablet 37e73b8798b2455baf642abc532a5d8c
0811 06:17:10.434555 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.434678 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2698154}
W20260811 06:17:10.435554 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 37e73b8798b2455baf642abc532a5d8c because the tablet was not found. No further retry: Not found: Tablet not found: 37e73b8798b2455baf642abc532a5d8c
I20260811 06:17:10.435492 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 176) took 2656 ms. Trace:
I20260811 06:17:10.435643 12726 rpcz_store.cc:276] 0811 06:17:07.778669 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.778749 (+ 80us) service_pool.cc:227] Handling call
0811 06:17:10.435340 (+2656591us) ts_tablet_manager.cc:1145] Deleting tablet 6119212ae4be4204852a5d9437dcee72
0811 06:17:10.435355 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.435472 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2656300}
I20260811 06:17:10.436194 12726 tablet_replica.cc:330] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:10.436378 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6119212ae4be4204852a5d9437dcee72 because the tablet was not found. No further retry: Not found: Tablet not found: 6119212ae4be4204852a5d9437dcee72
I20260811 06:17:10.436671 12726 raft_consensus.cc:2229] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.437181 12726 raft_consensus.cc:2258] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.438446 12726 ts_tablet_manager.cc:1905] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.439946 11663 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 82) took 3355 ms. Trace:
I20260811 06:17:10.423971 12944 raft_consensus.cc:504] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.448208 10921 raft_consensus.cc:3037] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.449038 13571 consensus_queue.cc:1035] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:10.449621 10813 leader_election.cc:341] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
I20260811 06:17:10.449940 10813 leader_election.cc:302] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.449353 11663 rpcz_store.cc:276] 0811 06:17:07.084770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.951211 (+2866441us) service_pool.cc:227] Handling call
0811 06:17:09.951956 (+ 745us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:09.952163 (+ 207us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:09.952587 (+ 424us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:09.952674 (+ 87us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:09.964853 (+ 12179us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:10.439868 (+475015us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.957857 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.957995 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.958004 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:09.958007 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:09.958186 (+ 179us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.958203 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.958208 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:09.958285 (+ 77us) tablet.cc:699] Row locks acquired
0811 06:17:09.958287 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:09.958345 (+ 58us) write_op.cc:270] Start()
0811 06:17:09.958388 (+ 43us) write_op.cc:276] Timestamp: P: 1786429029958306 usec, L: 0
0811 06:17:09.958392 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.958644 (+ 252us) log.cc:842] Serialized 405 byte log entry
0811 06:17:09.962494 (+ 3850us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.962588 (+ 94us) write_op.cc:301] APPLY: starting
0811 06:17:09.962606 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.962652 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.962720 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.962797 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.962836 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:09.962843 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:09.962937 (+ 94us) log.cc:842] Serialized 23 byte log entry
0811 06:17:09.963016 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.963039 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:09.963046 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:09.963110 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.963113 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":583,"apply.run_wall_time_us":583,"num_ops":1,"prepare.queue_time_us":4552,"prepare.run_cpu_time_us":912,"prepare.run_wall_time_us":912,"raft.queue_time_us":486,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":256,"replication_time_us":4076}]]}
I20260811 06:17:10.450196 13571 raft_consensus.cc:3037] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.450716 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_da057f3b5778478693bfc55ec32d45ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.452103 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da057f3b5778478693bfc55ec32d45ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.452697 11684 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_71a49e0ffd5f4420a30d39b21a9487af" } modify_external_catalogs: true
I20260811 06:17:10.452860 13571 raft_consensus.cc:2726] T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:10.453423 10813 leader_election.cc:302] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.453886 13571 raft_consensus.cc:2726] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:10.454380 10813 leader_election.cc:341] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
I20260811 06:17:10.459911 11362 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.460067 11362 ts_tablet_manager.cc:1397] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.002s
I20260811 06:17:10.461092 11362 raft_consensus.cc:348] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.461377 11362 raft_consensus.cc:374] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.461447 11362 raft_consensus.cc:729] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.461633 11362 consensus_queue.cc:260] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.428871 11361 tablet_bootstrap.cc:654] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.437867 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f243c792a634abf83484aef820dbb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.475473 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.475692 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.475817 11128 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.438208 11115 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.438369 11109 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.438421 11102 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.439072 11105 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.439031 11117 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.439464 11100 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.439831 11118 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.440363 11127 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.440917 11116 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.441110 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.441237 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.441295 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.441427 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.441934 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.442169 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.442390 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.442651 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.443244 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.462746 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.480413 11663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 86) took 1997 ms. Trace:
I20260811 06:17:10.480417 13740 consensus_queue.cc:1035] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.481177 11663 rpcz_store.cc:276] 0811 06:17:08.482702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.450298 (+1967596us) service_pool.cc:227] Handling call
0811 06:17:10.454365 (+ 4067us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.455146 (+ 781us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.480121 (+ 24975us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.480226 (+ 105us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.480320 (+ 94us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.456547 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.456639 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.456644 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:10.456646 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.456724 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.456734 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.456738 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.456807 (+ 69us) tablet.cc:699] Row locks acquired
0811 06:17:10.456810 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.456841 (+ 31us) write_op.cc:270] Start()
0811 06:17:10.456871 (+ 30us) write_op.cc:276] Timestamp: P: 1786429030456815 usec, L: 0
0811 06:17:10.456874 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.457030 (+ 156us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.461894 (+ 4864us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.462691 (+ 797us) write_op.cc:301] APPLY: starting
0811 06:17:10.462703 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.462735 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.462759 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.462891 (+ 132us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.462937 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.462943 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.463035 (+ 92us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.463081 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.463097 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:10.463102 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.463150 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.463153 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":764,"apply.run_cpu_time_us":506,"apply.run_wall_time_us":506,"num_ops":2,"prepare.queue_time_us":594,"prepare.run_cpu_time_us":568,"prepare.run_wall_time_us":567,"raft.queue_time_us":418,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":5003,"threads_started":1}]]}
I20260811 06:17:10.482399 13701 log.cc:1196] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:10.483089 13701 ts_tablet_manager.cc:1939] T 6703e639ab2042e78fadc63bd18c7602 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:10.483086 11670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 87) took 890 ms (client timeout 1000 ms). Trace:
I20260811 06:17:10.484504 13701 tablet_replica.cc:330] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:10.487767 11670 rpcz_store.cc:269] 0811 06:17:09.589995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.764284 (+174289us) service_pool.cc:227] Handling call
0811 06:17:10.153276 (+388992us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.153284 (+ 8us) write_op.cc:454] Released schema lock
0811 06:17:10.480183 (+326899us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.137032 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.137155 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.137162 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.137164 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.137387 (+ 223us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.137403 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.137408 (+ 5us) tablet.cc:683] Acquiring locks for 3 operations
0811 06:17:10.137610 (+ 202us) tablet.cc:699] Row locks acquired
0811 06:17:10.137615 (+ 5us) write_op.cc:260] PREPARE: finished
0811 06:17:10.137667 (+ 52us) write_op.cc:270] Start()
0811 06:17:10.137708 (+ 41us) write_op.cc:276] Timestamp: P: 1786429030137609 usec, L: 0
0811 06:17:10.137730 (+ 22us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.137983 (+ 253us) log.cc:842] Serialized 1284 byte log entry
0811 06:17:10.143126 (+ 5143us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.143251 (+ 125us) write_op.cc:301] APPLY: starting
0811 06:17:10.143270 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.143328 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.143418 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.143513 (+ 95us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.143554 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0811 06:17:10.143561 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:10.143710 (+ 149us) log.cc:842] Serialized 35 byte log entry
0811 06:17:10.143793 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.143821 (+ 28us) write_op.cc:454] Released schema lock
0811 06:17:10.143829 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":45475,"reported_tablets":191,"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":643,"apply.run_wall_time_us":642,"num_ops":3,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":1063,"prepare.run_wall_time_us":1064,"raft.queue_time_us":877,"raft.run_cpu_time_us":657,"raft.run_wall_time_us":657,"replication_time_us":5369}]]}
I20260811 06:17:10.489756 11362 ts_tablet_manager.cc:1428] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260811 06:17:10.490311 11362 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.489548 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_3904756a25ec4d7fa60a32a772b51c40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.492811 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3904756a25ec4d7fa60a32a772b51c40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:10.488317 11047 consensus_peers.cc:487] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:10.491232 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b88946419495411893f36709d4fc89a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:10.496621 13282 consensus_queue.cc:1035] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:10.498210 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b88946419495411893f36709d4fc89a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.498360 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da30a4db5b334cf88b01648c336a7ade" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.498956 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.499150 11155 raft_consensus.cc:2454] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:10.510288 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 6703e639ab2042e78fadc63bd18c7602 (table default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]) successfully deleted
I20260811 06:17:10.511780 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:10.512050 10651 raft_consensus.cc:3037] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.512181 12944 leader_election.cc:288] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:10.514539 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:10.514982 13669 raft_consensus.cc:482] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.515127 13669 raft_consensus.cc:504] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.515758 13669 leader_election.cc:288] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:10.515777 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
I20260811 06:17:10.517135 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05867781f7954fb280cc83b2a13d0d61" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.517699 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05867781f7954fb280cc83b2a13d0d61" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:10.518410 10555 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.519035 11663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 87) took 2000 ms. Trace:
W20260811 06:17:10.519698 10564 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.519807 10564 leader_election.cc:302] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.519649 11663 rpcz_store.cc:276] 0811 06:17:08.518400 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.483008 (+1964608us) service_pool.cc:227] Handling call
0811 06:17:10.493055 (+ 10047us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.493703 (+ 648us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.518727 (+ 25024us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.518848 (+ 121us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.518948 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.494265 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.494393 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.494400 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.494403 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.494489 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.494499 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.494505 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.494583 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:10.494586 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.494621 (+ 35us) write_op.cc:270] Start()
0811 06:17:10.494682 (+ 61us) write_op.cc:276] Timestamp: P: 1786429030494590 usec, L: 0
0811 06:17:10.494686 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.494865 (+ 179us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.516895 (+ 22030us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.517559 (+ 664us) write_op.cc:301] APPLY: starting
0811 06:17:10.517575 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.518055 (+ 480us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.518157 (+ 102us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.518330 (+ 173us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.518367 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.518375 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:10.518464 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.518533 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.518551 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:10.518557 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.518612 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.518616 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":624,"apply.run_cpu_time_us":705,"apply.run_wall_time_us":1107,"mutex_wait_us":518,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":672,"prepare.run_wall_time_us":672,"replication_time_us":22194}]]}
I20260811 06:17:10.520237 13669 raft_consensus.cc:2726] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:10.522353 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
I20260811 06:17:10.543349 13701 raft_consensus.cc:2229] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:10.544066 13701 raft_consensus.cc:2258] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.550239 11361 tablet_bootstrap.cc:492] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:10.550486 11361 ts_tablet_manager.cc:1397] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.284s user 0.004s sys 0.006s
I20260811 06:17:10.551342 11361 raft_consensus.cc:348] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.551656 11361 raft_consensus.cc:374] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.551774 11361 raft_consensus.cc:729] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.552219 11361 consensus_queue.cc:260] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.553277 11361 ts_tablet_manager.cc:1428] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:10.553653 11361 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:10.563901 10813 leader_election.cc:302] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.557947 13701 ts_tablet_manager.cc:1905] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.564954 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 88) took 2028 ms. Trace:
I20260811 06:17:10.565146 11670 rpcz_store.cc:276] 0811 06:17:08.536637 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.489586 (+1952949us) service_pool.cc:227] Handling call
0811 06:17:10.498320 (+ 8734us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.500272 (+ 1952us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.564593 (+ 64321us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.564730 (+ 137us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.564839 (+ 109us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.501328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.501510 (+ 182us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.501517 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.501520 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.501616 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.501628 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.501633 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.501750 (+ 117us) tablet.cc:699] Row locks acquired
0811 06:17:10.501753 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.501791 (+ 38us) write_op.cc:270] Start()
0811 06:17:10.501829 (+ 38us) write_op.cc:276] Timestamp: P: 1786429030501759 usec, L: 0
0811 06:17:10.501833 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.501992 (+ 159us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.563730 (+ 61738us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.563832 (+ 102us) write_op.cc:301] APPLY: starting
0811 06:17:10.563853 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.563903 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.563932 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.564059 (+ 127us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.564098 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.564104 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.564224 (+ 120us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.564307 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.564333 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:10.564341 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.564406 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.564409 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":43,"apply.run_cpu_time_us":630,"apply.run_wall_time_us":630,"num_ops":2,"prepare.queue_time_us":461,"prepare.run_cpu_time_us":736,"prepare.run_wall_time_us":737,"replication_time_us":61866}]]}
I20260811 06:17:10.566218 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_e2fc0d1ac1ad4323b928a7981dc924ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.566972 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2fc0d1ac1ad4323b928a7981dc924ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.567682 13074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29fb239be50c4171bdbc75e064555197, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.568853 13074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 569, Last appended: 3.570, Last appended by leader: 570, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:10.573555 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 85) took 2116 ms. Trace:
I20260811 06:17:10.574954 11361 tablet_bootstrap.cc:654] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.577487 11362 tablet_bootstrap.cc:654] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.579387 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.579727 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.580469 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.580746 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:10.592031 13732 raft_consensus.cc:2726] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:10.574028 11672 rpcz_store.cc:276] 0811 06:17:08.456943 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.378210 (+1921267us) service_pool.cc:227] Handling call
0811 06:17:10.454257 (+ 76047us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.489011 (+ 34754us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.573094 (+ 84083us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.573250 (+ 156us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.573357 (+ 107us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.491956 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.492065 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.492072 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.492075 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.492227 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.492243 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.492249 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.492341 (+ 92us) tablet.cc:699] Row locks acquired
0811 06:17:10.492344 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.492395 (+ 51us) write_op.cc:270] Start()
0811 06:17:10.492433 (+ 38us) write_op.cc:276] Timestamp: P: 1786429030492354 usec, L: 0
0811 06:17:10.492436 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.492673 (+ 237us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.516810 (+ 24137us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.516962 (+ 152us) write_op.cc:301] APPLY: starting
0811 06:17:10.516985 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.517034 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.517060 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.517215 (+ 155us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.517252 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.517258 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.517356 (+ 98us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.517806 (+ 450us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.517830 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:10.517837 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.517910 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.517913 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":843,"apply.run_wall_time_us":1014,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":800,"replication_time_us":24340}]]}
I20260811 06:17:10.600772 13669 raft_consensus.cc:482] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.600960 13669 raft_consensus.cc:504] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.602803 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_f8c48033535b4dd8b57f15cf3226a694"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.603950 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8c48033535b4dd8b57f15cf3226a694 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.604708 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3410afec34ae469d9a07cc9d16cf082c" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:10.605034 11153 raft_consensus.cc:3037] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.606494 13732 raft_consensus.cc:482] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.606803 13732 raft_consensus.cc:504] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.608214 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.608465 10654 raft_consensus.cc:2454] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:10.608983 10810 leader_election.cc:302] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.609220 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.609465 13571 raft_consensus.cc:2781] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:10.609537 13571 raft_consensus.cc:482] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:10.609601 13571 raft_consensus.cc:3037] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:10.609783 10555 leader_election.cc:341] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.610451 11153 raft_consensus.cc:2454] T 3410afec34ae469d9a07cc9d16cf082c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:10.613138 11362 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.612624 13571 raft_consensus.cc:504] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.613304 11362 ts_tablet_manager.cc:1397] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.001s
I20260811 06:17:10.613507 13732 leader_election.cc:288] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.613782 13571 leader_election.cc:288] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.622094 10813 leader_election.cc:302] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:10.622534 13571 raft_consensus.cc:2781] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:10.622831 13571 raft_consensus.cc:686] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:10.623416 13571 consensus_queue.cc:237] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.623610 13801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:17:10.624735 13801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:17:10.620242 11362 raft_consensus.cc:348] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.626561 11362 raft_consensus.cc:374] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.626641 11362 raft_consensus.cc:729] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.627339 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.627630 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:10.628047 13074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 06:17:10.628049 10813 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.629947 12911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 5 candidate_status { last_received { term: 4 index: 612 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
W20260811 06:17:10.630831 12911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42338 (request call id 0) took 6426 ms (client timeout 646 ms). Trace:
I20260811 06:17:10.631800 13732 raft_consensus.cc:482] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.631821 12908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 5 candidate_status { last_received { term: 4 index: 612 } } ignore_live_leader: false dest_uuid: "29fb239be50c4171bdbc75e064555197" is_pre_election: true
W20260811 06:17:10.632316 12908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42338 (request call id 1) took 5835 ms (client timeout 646 ms). Trace:
I20260811 06:17:10.633009 13732 raft_consensus.cc:504] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.633136 12882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 3 FOLLOWER]: Advancing to term 4
I20260811 06:17:10.636477 11361 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:10.636638 11361 ts_tablet_manager.cc:1397] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.002s
I20260811 06:17:10.637878 11361 raft_consensus.cc:348] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.638135 11361 raft_consensus.cc:374] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.638191 11361 raft_consensus.cc:729] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.638355 11361 consensus_queue.cc:260] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.638967 11361 ts_tablet_manager.cc:1428] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 06:17:10.631078 12911 rpcz_store.cc:269] 0811 06:17:04.204586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.204654 (+ 68us) service_pool.cc:227] Handling call
0811 06:17:10.630747 (+6426093us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260811 06:17:10.632593 12908 rpcz_store.cc:269] 0811 06:17:04.797289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:04.797350 (+ 61us) service_pool.cc:227] Handling call
0811 06:17:10.632260 (+5834910us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:10.642602 12882 pending_rounds.cc:76] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Aborting all ops after (but not including) 569
I20260811 06:17:10.645007 12882 pending_rounds.cc:97] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: Aborting uncommitted WRITE_OP operation due to leader change: 3.570
I20260811 06:17:10.646260 13669 leader_election.cc:288] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:10.647675 10813 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.645993 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a2e55d5e0244c299d837aed98f94aad" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:10.649047 10654 raft_consensus.cc:3037] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.626847 11362 consensus_queue.cc:260] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.653014 11362 ts_tablet_manager.cc:1428] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.040s user 0.000s sys 0.003s
I20260811 06:17:10.653314 11362 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:10.659375 10651 raft_consensus.cc:2454] T 3410afec34ae469d9a07cc9d16cf082c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:10.664115 13729 consensus_queue.cc:1035] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.665746 10654 raft_consensus.cc:2454] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:10.666571 10810 leader_election.cc:302] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.667737 13729 raft_consensus.cc:2781] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:10.667876 13729 raft_consensus.cc:686] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:10.668143 13729 consensus_queue.cc:237] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.675203 12726 ts_tablet_manager.cc:1918] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.675410 12726 log.cc:1196] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1349b0ea48b848398d4bdda528358c30
I20260811 06:17:10.675798 12726 ts_tablet_manager.cc:1939] T 1349b0ea48b848398d4bdda528358c30 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.676239 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 177) took 2897 ms. Trace:
I20260811 06:17:10.681680 13701 ts_tablet_manager.cc:1918] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:10.681622 12726 rpcz_store.cc:276] 0811 06:17:07.779266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.779315 (+ 49us) service_pool.cc:227] Handling call
0811 06:17:10.436111 (+2656796us) ts_tablet_manager.cc:1145] Deleting tablet 1349b0ea48b848398d4bdda528358c30
0811 06:17:10.436123 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.654363 (+218240us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.675085 (+ 20722us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.676220 (+ 1135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2656568}
I20260811 06:17:10.682063 13701 log.cc:1196] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/78d94d27431a4d5e93f1c1ce8c7b6752
I20260811 06:17:10.682099 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 178) took 2879 ms. Trace:
I20260811 06:17:10.682279 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1349b0ea48b848398d4bdda528358c30 (table default.Table_34897d99ed2841d195d7833a0bcdd2c4 [id=34e80fdc27064da99e1843979e2fb7b6]) successfully deleted
I20260811 06:17:10.682648 13701 ts_tablet_manager.cc:1939] T 78d94d27431a4d5e93f1c1ce8c7b6752 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:10.682199 12726 rpcz_store.cc:276] 0811 06:17:07.802967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.803032 (+ 65us) service_pool.cc:227] Handling call
0811 06:17:10.681986 (+2878954us) ts_tablet_manager.cc:1145] Deleting tablet 006d3214480c47babe390496b335de70
0811 06:17:10.681998 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.682082 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2878745}
I20260811 06:17:10.683492 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 179) took 2880 ms. Trace:
I20260811 06:17:10.683584 12726 rpcz_store.cc:276] 0811 06:17:07.803088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.803292 (+ 204us) service_pool.cc:227] Handling call
0811 06:17:10.683392 (+2880100us) ts_tablet_manager.cc:1145] Deleting tablet 58fdb5920003438d983987ff242f6dce
0811 06:17:10.683404 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.683475 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2879933}
W20260811 06:17:10.683655 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 006d3214480c47babe390496b335de70 because the tablet was not found. No further retry: Not found: Tablet not found: 006d3214480c47babe390496b335de70
I20260811 06:17:10.683856 12726 tablet_replica.cc:330] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:10.684057 12726 raft_consensus.cc:2229] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.684221 12726 raft_consensus.cc:2258] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.684824 12726 ts_tablet_manager.cc:1905] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:10.685190 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 58fdb5920003438d983987ff242f6dce because the tablet was not found. No further retry: Not found: Tablet not found: 58fdb5920003438d983987ff242f6dce
W20260811 06:17:10.693420 13823 log.cc:924] Time spent T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260811 06:17:10.694785 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:10.695029 10661 raft_consensus.cc:2454] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:10.695590 10810 leader_election.cc:302] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.695887 13730 raft_consensus.cc:2781] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:10.695955 13730 raft_consensus.cc:482] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:10.696013 13730 raft_consensus.cc:3037] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.697043 13732 leader_election.cc:288] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.698069 13669 raft_consensus.cc:482] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.698197 13669 raft_consensus.cc:504] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:10.698763 13669 leader_election.cc:288] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.700469 11365 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.700654 11365 ts_tablet_manager.cc:1397] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.322s user 0.021s sys 0.047s
I20260811 06:17:10.703169 11365 raft_consensus.cc:348] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.703976 11365 raft_consensus.cc:374] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.704299 11365 raft_consensus.cc:729] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.705735 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.706100 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.706581 11361 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:10.707043 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:10.708195 10564 leader_election.cc:341] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.708349 10564 leader_election.cc:302] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.708777 13669 raft_consensus.cc:2726] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:10.709432 11361 tablet_bootstrap.cc:654] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:10.709457 10813 leader_election.cc:341] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.710507 13701 tablet_replica.cc:330] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:10.710855 13701 raft_consensus.cc:2229] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:10.711278 13701 raft_consensus.cc:2258] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:10.712075 10564 leader_election.cc:341] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.712803 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:10.713430 10555 leader_election.cc:341] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.713553 10555 leader_election.cc:302] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.713828 13669 raft_consensus.cc:2726] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:10.716316 13816 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:41374: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 06:17:10.717146 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (table default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]) successfully deleted
W20260811 06:17:10.717500 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
W20260811 06:17:10.717880 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
I20260811 06:17:10.718497 13701 ts_tablet_manager.cc:1905] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:10.719446 13732 consensus_queue.cc:1035] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:10.705013 11365 consensus_queue.cc:260] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.741564 11365 ts_tablet_manager.cc:1428] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.039s user 0.001s sys 0.001s
I20260811 06:17:10.741959 11365 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.762197 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 89) took 2193 ms. Trace:
I20260811 06:17:10.762357 11670 rpcz_store.cc:276] 0811 06:17:08.569093 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.565904 (+1996811us) service_pool.cc:227] Handling call
0811 06:17:10.567070 (+ 1166us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.723083 (+156013us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.761821 (+ 38738us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.761991 (+ 170us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.762109 (+ 118us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.724355 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.724472 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.724478 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:10.724482 (+ 4us) tablet.cc:660] Decoding operations
0811 06:17:10.724588 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.724605 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.724610 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.724705 (+ 95us) tablet.cc:699] Row locks acquired
0811 06:17:10.724708 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.724746 (+ 38us) write_op.cc:270] Start()
0811 06:17:10.724784 (+ 38us) write_op.cc:276] Timestamp: P: 1786429030724693 usec, L: 0
0811 06:17:10.724788 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.724986 (+ 198us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.760623 (+ 35637us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.760745 (+ 122us) write_op.cc:301] APPLY: starting
0811 06:17:10.760767 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.760822 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.760909 (+ 87us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.761059 (+ 150us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.761103 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.761110 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:10.761210 (+ 100us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.761282 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.761307 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:10.761314 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.761377 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.761381 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":691,"apply.run_wall_time_us":692,"num_ops":2,"prepare.queue_time_us":688,"prepare.run_cpu_time_us":777,"prepare.run_wall_time_us":777,"raft.queue_time_us":2884,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":824,"replication_time_us":35205}]]}
I20260811 06:17:10.763836 11004 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:17:10.764038 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:10.764950 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_7f4c4be1ee2342f4858a10f9067b541e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.765866 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f4c4be1ee2342f4858a10f9067b541e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.779590 11365 tablet_bootstrap.cc:654] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.783957 13730 raft_consensus.cc:504] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.785286 13730 leader_election.cc:288] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:10.786260 12726 ts_tablet_manager.cc:1918] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.786398 12726 log.cc:1196] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/916b91088d7d4024a02214c958c0825b
I20260811 06:17:10.786702 12726 ts_tablet_manager.cc:1939] T 916b91088d7d4024a02214c958c0825b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:10.787037 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 180) took 2983 ms. Trace:
I20260811 06:17:10.787127 12726 rpcz_store.cc:276] 0811 06:17:07.803238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.803489 (+ 251us) service_pool.cc:227] Handling call
0811 06:17:10.683807 (+2880318us) ts_tablet_manager.cc:1145] Deleting tablet 916b91088d7d4024a02214c958c0825b
0811 06:17:10.683817 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.691899 (+ 8082us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.786124 (+ 94225us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:10.787019 (+ 895us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2880147}
I20260811 06:17:10.787535 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 181) took 2972 ms. Trace:
I20260811 06:17:10.787621 12726 rpcz_store.cc:276] 0811 06:17:07.815431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.815503 (+ 72us) service_pool.cc:227] Handling call
0811 06:17:10.787424 (+2971921us) ts_tablet_manager.cc:1145] Deleting tablet dc6254bf781740019c3f71b26179f25d
0811 06:17:10.787436 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.787521 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2971684}
I20260811 06:17:10.787802 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 916b91088d7d4024a02214c958c0825b (table default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]) successfully deleted
I20260811 06:17:10.787916 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 182) took 2972 ms. Trace:
I20260811 06:17:10.787992 12726 rpcz_store.cc:276] 0811 06:17:07.815553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.815785 (+ 232us) service_pool.cc:227] Handling call
0811 06:17:10.787832 (+2972047us) ts_tablet_manager.cc:1145] Deleting tablet 227bc4fd6cd84e5eb2043c52f95d606d
0811 06:17:10.787843 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.787901 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2971872}
W20260811 06:17:10.788515 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet dc6254bf781740019c3f71b26179f25d because the tablet was not found. No further retry: Not found: Tablet not found: dc6254bf781740019c3f71b26179f25d
W20260811 06:17:10.788784 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because the tablet was not found. No further retry: Not found: Tablet not found: 227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:10.793483 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:10.793730 10663 raft_consensus.cc:3037] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:10.796604 10663 raft_consensus.cc:2454] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:10.797308 10810 leader_election.cc:302] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:10.797369 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:10.797792 13730 raft_consensus.cc:2781] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:10.797959 13730 raft_consensus.cc:686] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:10.801520 13669 raft_consensus.cc:482] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.801684 13669 raft_consensus.cc:504] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.802397 13669 leader_election.cc:288] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.803407 13669 raft_consensus.cc:482] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.804117 11362 tablet_bootstrap.cc:654] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.804723 13730 consensus_queue.cc:237] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.785840 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:10.806797 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:10.809060 10564 leader_election.cc:341] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.803539 13669 raft_consensus.cc:504] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.815672 13669 leader_election.cc:288] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.810146 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.817231 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 183) took 3001 ms. Trace:
W20260811 06:17:10.817344 10555 leader_election.cc:341] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.817468 10555 leader_election.cc:302] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:10.817343 12726 rpcz_store.cc:276] 0811 06:17:07.815643 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.815990 (+ 347us) service_pool.cc:227] Handling call
0811 06:17:10.811805 (+2995815us) ts_tablet_manager.cc:1145] Deleting tablet 6dee9af5a4504b8284c9150298ab3462
0811 06:17:10.811821 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.817212 (+ 5391us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2995683}
I20260811 06:17:10.818252 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 186) took 3002 ms. Trace:
I20260811 06:17:10.818346 12726 rpcz_store.cc:276] 0811 06:17:07.815925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.816065 (+ 140us) service_pool.cc:227] Handling call
0811 06:17:10.818161 (+3002096us) ts_tablet_manager.cc:1145] Deleting tablet 5119e9bb88844329aea123dc3805d91d
0811 06:17:10.818173 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.818238 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001919}
I20260811 06:17:10.818451 13669 raft_consensus.cc:2726] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:10.818437 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6dee9af5a4504b8284c9150298ab3462 because the tablet was not found. No further retry: Not found: Tablet not found: 6dee9af5a4504b8284c9150298ab3462
I20260811 06:17:10.818637 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 184) took 3002 ms. Trace:
I20260811 06:17:10.818712 12726 rpcz_store.cc:276] 0811 06:17:07.815720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.816142 (+ 422us) service_pool.cc:227] Handling call
0811 06:17:10.818565 (+3002423us) ts_tablet_manager.cc:1145] Deleting tablet f2bdb349406a46629e6c307e1ebfd9dc
0811 06:17:10.818574 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.818624 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3002293}
I20260811 06:17:10.818957 12726 tablet_replica.cc:330] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:10.818941 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5119e9bb88844329aea123dc3805d91d because the tablet was not found. No further retry: Not found: Tablet not found: 5119e9bb88844329aea123dc3805d91d
W20260811 06:17:10.819289 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f2bdb349406a46629e6c307e1ebfd9dc because the tablet was not found. No further retry: Not found: Tablet not found: f2bdb349406a46629e6c307e1ebfd9dc
I20260811 06:17:10.820430 12726 raft_consensus.cc:2229] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:10.820593 12726 raft_consensus.cc:2258] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:10.821126 12726 ts_tablet_manager.cc:1905] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:10.821126 10813 leader_election.cc:341] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:10.825399 10925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1118c96cff4ea387f3d0ee94bef79b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.825590 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:10.827630 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:10.828097 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:10.828679 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:10.829957 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:10.830864 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:10.831861 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
W20260811 06:17:10.826745 10555 leader_election.cc:341] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:10.848279 13865 log.cc:924] Time spent T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Append to log took a long time: real 0.072s user 0.001s sys 0.000s
I20260811 06:17:10.882840 13903 tablet.cc:1722] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.884035 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:10.886577 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:10.887006 11365 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:10.888770 11365 ts_tablet_manager.cc:1397] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.147s user 0.009s sys 0.002s
I20260811 06:17:10.890143 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:10.910607 13903 tablet.cc:1722] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:10.885600 13933 tablet.cc:1722] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:10.929112 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:10.929553 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:10.929968 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:10.930301 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:10.930657 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:10.931246 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:10.935527 11361 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:10.935695 11361 ts_tablet_manager.cc:1397] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.229s user 0.006s sys 0.005s
I20260811 06:17:10.904616 11365 raft_consensus.cc:348] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.935961 11365 raft_consensus.cc:374] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.936084 11365 raft_consensus.cc:729] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.936378 11365 consensus_queue.cc:260] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.855979 13701 ts_tablet_manager.cc:1918] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:10.878742 13912 tablet.cc:1722] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.885787 11161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1118c96cff4ea387f3d0ee94bef79b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:10.941146 13701 log.cc:1196] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:10.952963 13937 raft_consensus.cc:482] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.953298 13937 raft_consensus.cc:504] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.954286 13937 leader_election.cc:288] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:10.955324 13701 ts_tablet_manager.cc:1939] T 14a36a644dc4491dad838ce4e19793ab P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:10.959132 13954 raft_consensus.cc:482] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:10.959352 11365 ts_tablet_manager.cc:1428] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.069s user 0.001s sys 0.001s
I20260811 06:17:10.959662 11365 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:10.951112 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 91) took 2364 ms. Trace:
I20260811 06:17:10.961830 11670 rpcz_store.cc:276] 0811 06:17:08.586192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.763175 (+2176983us) service_pool.cc:227] Handling call
0811 06:17:10.764796 (+ 1621us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8b313 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:10.766043 (+ 1247us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.775308 (+ 9265us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x6160000160b8. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e40f03351 00007f3e53e1f376 00007f3e53d90420 00007f3e53d89d35 00007f3e53f8b46a 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25
0811 06:17:10.775763 (+ 455us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.950752 (+174989us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.950907 (+ 155us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.951031 (+ 124us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.776578 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.776702 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.776710 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:10.776712 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.776834 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.776852 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.776857 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.776951 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:10.776954 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.777000 (+ 46us) write_op.cc:270] Start()
0811 06:17:10.777040 (+ 40us) write_op.cc:276] Timestamp: P: 1786429030776940 usec, L: 0
0811 06:17:10.777045 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.777254 (+ 209us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.949762 (+172508us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.949941 (+ 179us) write_op.cc:301] APPLY: starting
0811 06:17:10.949966 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.950017 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.950064 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.950192 (+ 128us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.950231 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.950238 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:10.950336 (+ 98us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.950427 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.950449 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:10.950457 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.950524 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.950527 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":23874816,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":656,"apply.run_wall_time_us":657,"num_ops":2,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":754,"replication_time_us":172658}]]}
I20260811 06:17:10.962916 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b1b7c4426f9a4326a2c5e6656099762d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:10.963565 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1b7c4426f9a4326a2c5e6656099762d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:10.913362 11362 tablet_bootstrap.cc:492] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:10.964679 11362 ts_tablet_manager.cc:1397] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.311s user 0.006s sys 0.009s
I20260811 06:17:10.965528 11362 raft_consensus.cc:348] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.965824 11362 raft_consensus.cc:374] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:10.965907 11362 raft_consensus.cc:729] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:10.966115 11362 consensus_queue.cc:260] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.951500 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 90) took 2375 ms. Trace:
I20260811 06:17:10.961377 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]) successfully deleted
I20260811 06:17:10.966841 11362 ts_tablet_manager.cc:1428] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:10.967136 11362 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:10.967123 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:10.967401 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:10.967566 11672 rpcz_store.cc:276] 0811 06:17:08.575567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.602126 (+2026559us) service_pool.cc:227] Handling call
0811 06:17:10.604129 (+ 2003us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.778991 (+174862us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:10.951279 (+172288us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:10.951369 (+ 90us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:10.951444 (+ 75us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.841650 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.841840 (+ 190us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.841848 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:10.841851 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.841962 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.841975 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.841980 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.842071 (+ 91us) tablet.cc:699] Row locks acquired
0811 06:17:10.842074 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.842113 (+ 39us) write_op.cc:270] Start()
0811 06:17:10.842148 (+ 35us) write_op.cc:276] Timestamp: P: 1786429030842048 usec, L: 0
0811 06:17:10.842152 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.842348 (+ 196us) log.cc:842] Serialized 433 byte log entry
0811 06:17:10.949840 (+107492us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.949939 (+ 99us) write_op.cc:301] APPLY: starting
0811 06:17:10.949972 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.950029 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.950062 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.950193 (+ 131us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.950307 (+ 114us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.950315 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:10.950393 (+ 78us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.950472 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.950492 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:10.950499 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.950550 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.950553 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":602,"apply.run_wall_time_us":659,"mutex_wait_us":1,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":776,"prepare.run_wall_time_us":777,"replication_time_us":107673,"spinlock_wait_cycles":1408}]]}
I20260811 06:17:10.968739 11362 tablet_bootstrap.cc:654] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:10.968943 13912 tablet.cc:1722] T 5797f3ba59924b41b92fbd089397218e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.969045 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_074fc2ccf40d49e380e37ad5842cd459"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:10.941283 13950 tablet.cc:1722] T 5797f3ba59924b41b92fbd089397218e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:10.969935 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_074fc2ccf40d49e380e37ad5842cd459 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:10.969919 10810 consensus_peers.cc:487] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:10.973239 13933 tablet.cc:1722] T 2fb02f61b67147f793b3a2f063d8c56c P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.946555 13951 tablet.cc:1722] T d165ac025ce845c6b2b3621caaf01894 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.954968 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c997501cefd4e6b9e5824e5403dd39b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:10.975108 13915 tablet.cc:1722] T 844e735c671440c5bfe1035068c7334e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:10.976677 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:10.977067 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:10.977432 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:10.978026 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 1 got 0
W20260811 06:17:10.995920 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
I20260811 06:17:10.996425 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
W20260811 06:17:10.997134 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0813b34919a14a2481857e9f87b217c8 already in progress: creating tablet
W20260811 06:17:10.998311 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because the tablet was not found. No further retry: Not found: Tablet not found: 532208d7a02d448e8dac702ffe6c2ffc
I20260811 06:17:10.999044 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:11.004320 13950 tablet.cc:1722] T 22feadfa433d46cc9f5dc052b3421e56 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260811 06:17:11.000188 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2f243c792a634abf83484aef820dbb48 because the tablet was not found. No further retry: Not found: Tablet not found: 2f243c792a634abf83484aef820dbb48
W20260811 06:17:11.005124 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:11.005468 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:11.005851 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
W20260811 06:17:11.006193 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:11.006565 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:11.009761 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 92) took 2367 ms. Trace:
I20260811 06:17:11.010080 11670 rpcz_store.cc:276] 0811 06:17:08.642398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.962630 (+2320232us) service_pool.cc:227] Handling call
0811 06:17:10.963660 (+ 1030us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.964143 (+ 483us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:11.009396 (+ 45253us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:11.009512 (+ 116us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:11.009611 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.964856 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.964955 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.964961 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:10.964963 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.965051 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.965066 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.965071 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.965151 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:10.965154 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.965196 (+ 42us) write_op.cc:270] Start()
0811 06:17:10.965231 (+ 35us) write_op.cc:276] Timestamp: P: 1786429030965173 usec, L: 0
0811 06:17:10.965234 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.965470 (+ 236us) log.cc:842] Serialized 433 byte log entry
0811 06:17:11.007305 (+ 41835us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.007493 (+ 188us) write_op.cc:301] APPLY: starting
0811 06:17:11.007513 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.007561 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.007646 (+ 85us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.007880 (+ 234us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.007919 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:11.007925 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.008018 (+ 93us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.008093 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.008117 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:11.008124 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.008182 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.008185 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":745,"apply.run_wall_time_us":744,"num_ops":2,"prepare.queue_time_us":189,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":719,"raft.queue_time_us":6773,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":274,"replication_time_us":42040}]]}
I20260811 06:17:11.014107 13951 tablet.cc:1722] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.015401 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 93) took 2371 ms. Trace:
I20260811 06:17:11.015645 11672 rpcz_store.cc:276] 0811 06:17:08.643338 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.968344 (+2325006us) service_pool.cc:227] Handling call
0811 06:17:10.970141 (+ 1797us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:10.970596 (+ 455us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:11.014988 (+ 44392us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:11.015107 (+ 119us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:11.015202 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.971141 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.971238 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.971243 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:10.971246 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.971347 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.971357 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.971362 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.971437 (+ 75us) tablet.cc:699] Row locks acquired
0811 06:17:10.971439 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.971498 (+ 59us) write_op.cc:270] Start()
0811 06:17:10.971534 (+ 36us) write_op.cc:276] Timestamp: P: 1786429030971456 usec, L: 0
0811 06:17:10.971539 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.971729 (+ 190us) log.cc:842] Serialized 433 byte log entry
0811 06:17:11.007396 (+ 35667us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.008268 (+ 872us) write_op.cc:301] APPLY: starting
0811 06:17:11.008279 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.008386 (+ 107us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.008419 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.008529 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.008566 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:11.008571 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:11.008639 (+ 68us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.008684 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.008698 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:11.008703 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.008749 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.008752 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":842,"apply.run_cpu_time_us":523,"apply.run_wall_time_us":523,"num_ops":2,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":694,"prepare.run_wall_time_us":695,"raft.queue_time_us":836,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":35840}]]}
I20260811 06:17:11.017168 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_4ebccfdb6d154b9d95edf80cda05f0a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.022099 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ebccfdb6d154b9d95edf80cda05f0a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:11.038331 10555 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:11.038645 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 64338.1us
I20260811 06:17:11.041565 12726 ts_tablet_manager.cc:1918] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:10.976356 13912 tablet.cc:1722] T 22feadfa433d46cc9f5dc052b3421e56 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:10.987622 11361 raft_consensus.cc:348] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.043421 11361 raft_consensus.cc:374] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.043527 11361 raft_consensus.cc:729] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.043732 11361 consensus_queue.cc:260] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.043963 11362 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:11.044147 11362 ts_tablet_manager.cc:1397] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.004s
I20260811 06:17:11.044345 11361 ts_tablet_manager.cc:1428] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.109s user 0.001s sys 0.001s
I20260811 06:17:11.044648 11361 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.045374 11362 raft_consensus.cc:348] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:10.989993 13868 tablet.cc:1722] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.052086 13282 consensus_queue.cc:1035] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:11.052944 11361 tablet_bootstrap.cc:654] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.053938 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9d9a3943d3e7406fb0e41f3a9f5c5255 (table default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89]). Expected version 1 got 0
I20260811 06:17:11.055519 13912 tablet.cc:1722] T dd6584701c23406e83122bd2493b7972 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:11.056569 13915 tablet.cc:1722] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.058794 11362 raft_consensus.cc:374] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.059001 11362 raft_consensus.cc:729] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
W20260811 06:17:11.059412 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because the tablet was not found. No further retry: Not found: Tablet not found: f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:11.059379 11362 consensus_queue.cc:260] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.060276 11362 ts_tablet_manager.cc:1428] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260811 06:17:11.060631 11362 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:11.061056 13732 raft_consensus.cc:482] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.061350 13732 raft_consensus.cc:504] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.062505 13732 leader_election.cc:288] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:11.063017 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 916b91088d7d4024a02214c958c0825b because the tablet was not found. No further retry: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
I20260811 06:17:11.063361 11362 tablet_bootstrap.cc:654] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.063495 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:11.064517 10813 leader_election.cc:341] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.065037 13965 tablet.cc:1722] T d165ac025ce845c6b2b3621caaf01894 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:11.071959 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:11.072487 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:11.073026 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
W20260811 06:17:11.073535 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because the tablet was not found. No further retry: Not found: Tablet not found: 217f60a1ca044af38f9ee9093e021c27
W20260811 06:17:11.073900 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:11.074317 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:11.076927 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 94) took 2380 ms. Trace:
I20260811 06:17:11.077327 11672 rpcz_store.cc:276] 0811 06:17:08.696737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.016829 (+2320092us) service_pool.cc:227] Handling call
0811 06:17:11.022386 (+ 5557us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:11.022949 (+ 563us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:11.039831 (+ 16882us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:11.076620 (+ 36789us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:11.076753 (+ 133us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.023615 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.023755 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.023763 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:11.023765 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.023858 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.023873 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.023878 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.023964 (+ 86us) tablet.cc:699] Row locks acquired
0811 06:17:11.023966 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.024006 (+ 40us) write_op.cc:270] Start()
0811 06:17:11.024044 (+ 38us) write_op.cc:276] Timestamp: P: 1786429031023977 usec, L: 0
0811 06:17:11.024048 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.024778 (+ 730us) log.cc:842] Serialized 433 byte log entry
0811 06:17:11.036324 (+ 11546us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.036455 (+ 131us) write_op.cc:301] APPLY: starting
0811 06:17:11.036473 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.036517 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.036555 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.036677 (+ 122us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.036714 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:11.036721 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.036811 (+ 90us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.036880 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.036902 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:11.036910 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.036965 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.036969 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":567,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":859,"prepare.run_wall_time_us":1301,"replication_time_us":12239,"spinlock_wait_cycles":1154432}]]}
I20260811 06:17:11.079154 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet 1a2e55d5e0244c299d837aed98f94aad from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:11.061405 13868 tablet.cc:1722] T 0874f0e73267446fb873f4619f93307e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:11.084571 13933 tablet.cc:1722] T 844e735c671440c5bfe1035068c7334e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.086285 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:11.087599 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:11.087965 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:11.089001 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:11.089501 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:11.090085 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:11.097954 13701 tablet_replica.cc:330] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:11.099766 12882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42336 (request call id 0) took 7352 ms. Trace:
I20260811 06:17:10.959369 13954 raft_consensus.cc:504] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:11.103330 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 87695us
W20260811 06:17:11.095817 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:11.105603 10747 heartbeater.cc:347] Connected to a master server at 127.9.203.125:35327
I20260811 06:17:11.105686 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:11.106007 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:11.106348 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:11.106767 13943 tablet.cc:1722] T 9d9a3943d3e7406fb0e41f3a9f5c5255 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:11.106990 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because the tablet was not found. No further retry: Not found: Tablet not found: 5ca903ee846a4e5baf3dbb4302607c1f
W20260811 06:17:11.107318 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because the tablet was not found. No further retry: Not found: Tablet not found: 0dab2b8209e5401c84a187882ef21e08
W20260811 06:17:11.107625 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
W20260811 06:17:11.108107 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because the tablet was not found. No further retry: Not found: Tablet not found: 227bc4fd6cd84e5eb2043c52f95d606d
W20260811 06:17:11.108527 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2fcf7c7a470144c0a084aebc2032d896 because the tablet was not found. No further retry: Not found: Tablet not found: 2fcf7c7a470144c0a084aebc2032d896
W20260811 06:17:11.108821 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:11.109227 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1349b0ea48b848398d4bdda528358c30 already in progress: creating tablet
I20260811 06:17:11.109450 13954 leader_election.cc:288] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:11.109740 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:11.109844 12726 log.cc:1196] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:11.110016 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:11.110422 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
I20260811 06:17:11.111522 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:11.102320 11361 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.111894 11361 ts_tablet_manager.cc:1397] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.005s
I20260811 06:17:11.111960 13701 raft_consensus.cc:2229] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.112105 10655 raft_consensus.cc:2454] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:11.112306 13701 raft_consensus.cc:2258] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.112752 10810 leader_election.cc:302] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.113178 12944 raft_consensus.cc:2781] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:11.104588 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c997501cefd4e6b9e5824e5403dd39b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.110577 13741 raft_consensus.cc:482] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.113803 13701 ts_tablet_manager.cc:1905] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:11.109862 10564 leader_election.cc:341] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.114331 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:11.114897 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:11.113541 13741 raft_consensus.cc:504] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.115507 13741 leader_election.cc:288] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.114368 11361 raft_consensus.cc:348] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.118214 11361 raft_consensus.cc:374] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.118332 11361 raft_consensus.cc:729] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.118649 11361 consensus_queue.cc:260] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.118881 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:11.119318 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
I20260811 06:17:11.119370 11361 ts_tablet_manager.cc:1428] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:11.119642 11361 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.119915 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:11.121560 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:11.122378 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:11.122730 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet d165ac025ce845c6b2b3621caaf01894 (table default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b]). Expected version 1 got 0
I20260811 06:17:11.123456 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:11.123502 12726 ts_tablet_manager.cc:1939] T 6703e639ab2042e78fadc63bd18c7602 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.123848 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:11.100605 13801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:17:11.124156 13801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:17:11.125262 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.125851 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.126101 10922 raft_consensus.cc:2454] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:11.126509 13903 tablet.cc:1722] T 0874f0e73267446fb873f4619f93307e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:11.116654 13954 raft_consensus.cc:482] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.131665 10564 leader_election.cc:302] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.133989 11047 leader_election.cc:302] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:11.134361 13741 raft_consensus.cc:2781] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:11.134449 13741 raft_consensus.cc:482] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:11.134505 13741 raft_consensus.cc:3037] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.134884 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:11.135146 12944 raft_consensus.cc:482] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:11.135198 13954 raft_consensus.cc:504] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.135581 11672 catalog_manager.cc:6565] ReplaceTablet: tablet 1a2e55d5e0244c299d837aed98f94aad deleted and replaced by tablet 60c3a381b6744b8d989d644f2b643958
I20260811 06:17:11.135351 13915 tablet.cc:1722] T dd6584701c23406e83122bd2493b7972 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:11.135727 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 95) took 2391 ms. Trace:
I20260811 06:17:11.136096 13954 leader_election.cc:288] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.135866 11672 rpcz_store.cc:276] 0811 06:17:08.743929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.078929 (+2335000us) service_pool.cc:227] Handling call
0811 06:17:11.135670 (+ 56741us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.127871 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.127980 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.127987 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.127990 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.128131 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.128147 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.128152 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.128246 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:11.128249 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.128300 (+ 51us) write_op.cc:270] Start()
0811 06:17:11.128336 (+ 36us) write_op.cc:276] Timestamp: P: 1786429031128252 usec, L: 0
0811 06:17:11.128340 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.128525 (+ 185us) log.cc:842] Serialized 625 byte log entry
0811 06:17:11.133007 (+ 4482us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.133145 (+ 138us) write_op.cc:301] APPLY: starting
0811 06:17:11.133162 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.133210 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.133239 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.133373 (+ 134us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.133461 (+ 88us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.133467 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.133572 (+ 105us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.133639 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.133663 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:11.133670 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.134511 (+ 841us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.134518 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":698,"apply.run_wall_time_us":1438,"num_ops":2,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":753,"prepare.run_wall_time_us":753,"raft.queue_time_us":431,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":283,"replication_time_us":4621}]]}
I20260811 06:17:11.136437 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 187) took 3311 ms. Trace:
I20260811 06:17:11.136761 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet 61114d1bcdb94af7b6c55b0331accee5 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:11.138370 10564 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:11.138654 10555 leader_election.cc:341] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.139272 11365 tablet_bootstrap.cc:654] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.139355 13902 tablet.cc:1722] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.137136 13955 tablet.cc:1722] T 8bd026d2c6064a67b1c432efa4474a0e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.145263 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:11.145979 11361 tablet_bootstrap.cc:654] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.146941 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.101441 13866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36d6d06a0cb4489b5014178b9973219. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:17:11.147663 13866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 06:17:11.149580 13866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a36d6d06a0cb4489b5014178b9973219)
I20260811 06:17:11.149914 13866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:11.150276 13741 raft_consensus.cc:504] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.150911 13741 leader_election.cc:288] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.141832 12726 rpcz_store.cc:276] 0811 06:17:07.816013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.816292 (+ 279us) service_pool.cc:227] Handling call
0811 06:17:10.818913 (+3002621us) ts_tablet_manager.cc:1145] Deleting tablet 6703e639ab2042e78fadc63bd18c7602
0811 06:17:10.818922 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:10.888086 (+ 69164us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.041438 (+153352us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.127865 (+ 86427us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3002497}
I20260811 06:17:11.152113 10564 leader_election.cc:302] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.153380 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.153401 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 6703e639ab2042e78fadc63bd18c7602 (table default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]) successfully deleted
I20260811 06:17:11.154484 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:11.155193 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.155503 11672 catalog_manager.cc:6565] ReplaceTablet: tablet 61114d1bcdb94af7b6c55b0331accee5 deleted and replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc
I20260811 06:17:11.155867 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 96) took 2379 ms. Trace:
I20260811 06:17:11.156150 11672 rpcz_store.cc:276] 0811 06:17:08.776027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.136605 (+2360578us) service_pool.cc:227] Handling call
0811 06:17:11.153979 (+ 17374us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.153985 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:11.155649 (+ 1664us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.144198 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.144337 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.144343 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.144346 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.144506 (+ 160us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.144520 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.144525 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.144618 (+ 93us) tablet.cc:699] Row locks acquired
0811 06:17:11.144621 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.144663 (+ 42us) write_op.cc:270] Start()
0811 06:17:11.144699 (+ 36us) write_op.cc:276] Timestamp: P: 1786429031144624 usec, L: 0
0811 06:17:11.144703 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.144902 (+ 199us) log.cc:842] Serialized 659 byte log entry
0811 06:17:11.150120 (+ 5218us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.150271 (+ 151us) write_op.cc:301] APPLY: starting
0811 06:17:11.150288 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.150330 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.150385 (+ 55us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.150503 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.150558 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.150565 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.150650 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.150712 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.150736 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:11.150761 (+ 25us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":550,"apply.run_wall_time_us":549,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":806,"prepare.run_wall_time_us":806,"raft.queue_time_us":504,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":347,"replication_time_us":5392}]]}
I20260811 06:17:11.157475 11672 master_service.cc:946] ReplaceTablet: received request to replace tablet fdc323cf778548ae86f45f0fd8bd4a89 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:11.158640 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.159433 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 185) took 3336 ms. Trace:
I20260811 06:17:11.159488 12944 raft_consensus.cc:3037] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.159584 12726 rpcz_store.cc:276] 0811 06:17:07.815797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.816435 (+ 638us) service_pool.cc:227] Handling call
0811 06:17:11.151935 (+3335500us) ts_tablet_manager.cc:1145] Deleting tablet 847df543db4244a6b2900fc16fea7c07
0811 06:17:11.151949 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.152032 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3335380}
I20260811 06:17:11.160696 11663 catalog_manager.cc:5495] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:11.162034 11663 catalog_manager.cc:5495] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:11.162565 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:11.164796 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:11.165050 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.166234 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.170028 13939 raft_consensus.cc:2726] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:11.170089 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 65346.2us
W20260811 06:17:11.171334 10555 leader_election.cc:341] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.159399 13956 tablet.cc:1722] T 844e735c671440c5bfe1035068c7334e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.179076 13866 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
I20260811 06:17:11.185582 13701 ts_tablet_manager.cc:1918] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.186157 13701 log.cc:1196] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:11.186908 13701 ts_tablet_manager.cc:1939] T 2b0ae9a1d3b74c3985637439819b63ef P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:11.188460 13738 consensus_queue.cc:1035] T 2e1460fe55fb48f890f31e1cc86d1d23 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:11.192936 13956 tablet.cc:1722] T dd6584701c23406e83122bd2493b7972 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:11.192988 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 2b0ae9a1d3b74c3985637439819b63ef (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]) successfully deleted
W20260811 06:17:11.182768 10564 leader_election.cc:341] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:11.193648 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1a2e55d5e0244c299d837aed98f94aad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a2e55d5e0244c299d837aed98f94aad already in progress: creating tablet
I20260811 06:17:11.194243 13701 tablet_replica.cc:330] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:11.194797 13701 raft_consensus.cc:2229] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.195025 13701 pending_rounds.cc:62] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:11.195127 13701 pending_rounds.cc:68] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7317213309521805312 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "61114d1bcdb94af7b6c55b0331accee5" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_4f7e2cab315242af8d129fc6b73494be" dest_uuid: "24d29113b2454d9c93e23db3e3dac801" new_extra_config { } }
I20260811 06:17:11.196161 13701 raft_consensus.cc:2258] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.198026 13701 ts_tablet_manager.cc:1905] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.198282 13943 tablet.cc:1722] T d165ac025ce845c6b2b3621caaf01894 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.200196 13955 tablet.cc:1722] T 0874f0e73267446fb873f4619f93307e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260811 06:17:11.200960 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 188) took 3322 ms. Trace:
I20260811 06:17:11.201074 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.201457 13948 raft_consensus.cc:2726] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.204710 11361 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.204949 11361 ts_tablet_manager.cc:1397] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.006s
I20260811 06:17:11.205930 10564 leader_election.cc:302] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.208590 13764 mvcc.cc:205] Tried to move back new op lower bound from 7317213280711933952 to 7317213257925537792. Current Snapshot: MvccSnapshot[applied={T|T < 7317213280711933952}]
I20260811 06:17:11.209972 13941 raft_consensus.cc:2726] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.210033 13951 tablet.cc:1722] T 8bd026d2c6064a67b1c432efa4474a0e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.210218 13941 raft_consensus.cc:482] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.210177 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:11.210495 10659 raft_consensus.cc:2454] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:11.210472 13941 raft_consensus.cc:504] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.211509 13941 leader_election.cc:288] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.211967 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:11.212460 10663 raft_consensus.cc:3037] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.214900 13701 ts_tablet_manager.cc:1918] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:11.216264 10663 raft_consensus.cc:2454] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:11.216478 13701 log.cc:1196] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:11.217002 13701 ts_tablet_manager.cc:1939] T 61114d1bcdb94af7b6c55b0331accee5 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:11.219022 10564 leader_election.cc:341] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.219419 10564 leader_election.cc:302] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.219858 13941 raft_consensus.cc:2726] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.220441 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]) successfully deleted
I20260811 06:17:11.220624 13738 consensus_queue.cc:1035] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:11.221138 10564 consensus_peers.cc:487] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:11.216344 11361 raft_consensus.cc:348] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.225238 11361 raft_consensus.cc:374] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.225307 11361 raft_consensus.cc:729] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.225504 13902 tablet.cc:1722] T 22feadfa433d46cc9f5dc052b3421e56 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:11.225692 11361 consensus_queue.cc:260] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.225901 13933 tablet.cc:1722] T 8bd026d2c6064a67b1c432efa4474a0e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.201272 12726 rpcz_store.cc:276] 0811 06:17:07.837420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.837488 (+ 68us) service_pool.cc:227] Handling call
0811 06:17:11.159860 (+3322372us) ts_tablet_manager.cc:1145] Deleting tablet f12c8618198f4413b2727d04f850a10f
0811 06:17:11.159872 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.160026 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3322158}
I20260811 06:17:11.226462 12726 tablet_replica.cc:330] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.226675 12726 raft_consensus.cc:2229] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.226828 12726 raft_consensus.cc:2258] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.227368 12726 ts_tablet_manager.cc:1905] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.229977 13902 tablet.cc:1722] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.232517 11361 ts_tablet_manager.cc:1428] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.026s user 0.000s sys 0.002s
I20260811 06:17:11.233944 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e18f96539b76422ab3ae65bdfe2cf74d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:11.234153 13955 tablet.cc:1722] T 5797f3ba59924b41b92fbd089397218e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.234413 10913 raft_consensus.cc:3037] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.241374 11361 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.241766 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:11.243916 10555 leader_election.cc:341] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.244329 13950 tablet.cc:1722] T 2fb02f61b67147f793b3a2f063d8c56c P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.247107 13943 tablet.cc:1722] T 2fb02f61b67147f793b3a2f063d8c56c P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:11.247514 13738 raft_consensus.cc:482] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.247653 13738 raft_consensus.cc:504] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.254069 13738 leader_election.cc:288] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.267884 11365 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.270344 11361 tablet_bootstrap.cc:654] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.268074 11365 ts_tablet_manager.cc:1397] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.308s user 0.003s sys 0.008s
I20260811 06:17:11.288791 13956 tablet.cc:1722] T 5a17ccd48c8c460cb7ff59abf7ea19d9 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:11.283588 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "035eee1d37c94471a7cd697fb0fbb951" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:11.290417 11047 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.291273 12726 ts_tablet_manager.cc:1918] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.291385 12726 log.cc:1196] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:11.291658 12726 ts_tablet_manager.cc:1939] T 8c997501cefd4e6b9e5824e5403dd39b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.289538 12944 raft_consensus.cc:504] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.299104 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:11.299726 13975 log.cc:924] Time spent T 2e1460fe55fb48f890f31e1cc86d1d23 P 56a371f7ed104f68a5db9ca097eb237e: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
W20260811 06:17:11.301199 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet eede55349694488b9899ec56a80c8d5b consensus state has no leader
W20260811 06:17:11.301527 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 847df543db4244a6b2900fc16fea7c07 because the tablet was not found. No further retry: Not found: Tablet not found: 847df543db4244a6b2900fc16fea7c07
I20260811 06:17:11.303908 10913 raft_consensus.cc:2454] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:11.305862 12944 leader_election.cc:288] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:11.306563 10813 leader_election.cc:341] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.309485 11047 leader_election.cc:302] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:11.309796 13738 raft_consensus.cc:2781] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:11.309922 13738 raft_consensus.cc:686] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:11.310132 13738 consensus_queue.cc:237] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:11.312253 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 88) took 805 ms (client timeout 1000 ms). Trace:
W20260811 06:17:11.312534 11663 rpcz_store.cc:269] 0811 06:17:10.506409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.520359 (+ 13950us) service_pool.cc:227] Handling call
0811 06:17:11.312113 (+791754us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.163547 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.163660 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.163667 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.163670 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.163783 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.163798 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.163803 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.163905 (+ 102us) tablet.cc:699] Row locks acquired
0811 06:17:11.163907 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.163961 (+ 54us) write_op.cc:270] Start()
0811 06:17:11.163995 (+ 34us) write_op.cc:276] Timestamp: P: 1786429031163918 usec, L: 0
0811 06:17:11.163999 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.164202 (+ 203us) log.cc:842] Serialized 907 byte log entry
0811 06:17:11.303742 (+139540us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.303877 (+ 135us) write_op.cc:301] APPLY: starting
0811 06:17:11.303898 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.304019 (+ 121us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.304084 (+ 65us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.304162 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.304217 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:11.304223 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.304317 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.304388 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.304411 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:11.304418 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.304476 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.304479 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":660,"apply.run_wall_time_us":660,"num_ops":2,"prepare.queue_time_us":199,"prepare.run_cpu_time_us":751,"prepare.run_wall_time_us":751,"raft.queue_time_us":3895,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"replication_time_us":139714}]]}
I20260811 06:17:11.313503 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 585f92fc5b3d41bd97df525380fcab9f from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:11.314479 11663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 98) took 2027 ms. Trace:
I20260811 06:17:11.314627 11663 rpcz_store.cc:276] 0811 06:17:09.287273 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.313356 (+2026083us) service_pool.cc:227] Handling call
0811 06:17:11.314416 (+ 1060us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:11.315009 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 91f079882c3c46318f70190d5293868e from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:11.321868 13977 raft_consensus.cc:482] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.322063 13977 raft_consensus.cc:504] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.322739 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:11.322961 13977 leader_election.cc:288] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.323509 11672 catalog_manager.cc:6565] ReplaceTablet: tablet fdc323cf778548ae86f45f0fd8bd4a89 deleted and replaced by tablet 7b815bc117cf46db8250f33e5fec861d
I20260811 06:17:11.323722 11672 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 97) took 2070 ms. Trace:
I20260811 06:17:11.323977 11672 rpcz_store.cc:276] 0811 06:17:09.253630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.157194 (+1903564us) service_pool.cc:227] Handling call
0811 06:17:11.323609 (+166415us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.176260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.176366 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.176372 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.176375 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.176484 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.176495 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.176500 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.176575 (+ 75us) tablet.cc:699] Row locks acquired
0811 06:17:11.176577 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.176614 (+ 37us) write_op.cc:270] Start()
0811 06:17:11.176647 (+ 33us) write_op.cc:276] Timestamp: P: 1786429031176572 usec, L: 0
0811 06:17:11.176651 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.176834 (+ 183us) log.cc:842] Serialized 625 byte log entry
0811 06:17:11.321392 (+144558us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.321505 (+ 113us) write_op.cc:301] APPLY: starting
0811 06:17:11.321525 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.321588 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.321620 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.321845 (+ 225us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.321961 (+ 116us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.321968 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.322060 (+ 92us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.322131 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.322153 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:11.322161 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.322221 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.322225 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"apply.run_cpu_time_us":776,"apply.run_wall_time_us":775,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":643,"replication_time_us":144710}]]}
I20260811 06:17:11.325212 11672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_39662cb2c2484aff9fdaff055087b0ae" } modify_external_catalogs: true
I20260811 06:17:11.164232 12882 rpcz_store.cc:276] 0811 06:17:03.743522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:03.743584 (+ 62us) service_pool.cc:227] Handling call
0811 06:17:10.628696 (+6885112us) raft_consensus.cc:1457] Updating replica for 43 ops
0811 06:17:10.646175 (+ 17479us) raft_consensus.cc:1520] Early marking committed up to index 0
0811 06:17:10.646183 (+ 8us) raft_consensus.cc:1525] Triggering prepare for 43 ops
0811 06:17:10.646621 (+ 438us) write_op.cc:270] Start()
0811 06:17:10.646675 (+ 54us) write_op.cc:276] Timestamp: P: 1786429019791798 usec, L: 0
0811 06:17:10.659563 (+ 12888us) write_op.cc:270] Start()
0811 06:17:10.659609 (+ 46us) write_op.cc:276] Timestamp: P: 1786429019804877 usec, L: 0
0811 06:17:10.661350 (+ 1741us) write_op.cc:270] Start()
0811 06:17:10.661397 (+ 47us) write_op.cc:276] Timestamp: P: 1786429019807281 usec, L: 0
0811 06:17:10.661605 (+ 208us) write_op.cc:270] Start()
0811 06:17:10.661630 (+ 25us) write_op.cc:276] Timestamp: P: 1786429019810203 usec, L: 0
0811 06:17:10.663639 (+ 2009us) write_op.cc:270] Start()
0811 06:17:10.663668 (+ 29us) write_op.cc:276] Timestamp: P: 1786429019811809 usec, L: 0
0811 06:17:10.663823 (+ 155us) write_op.cc:270] Start()
0811 06:17:10.663846 (+ 23us) write_op.cc:276] Timestamp: P: 1786429019814253 usec, L: 0
0811 06:17:10.663977 (+ 131us) write_op.cc:270] Start()
0811 06:17:10.664061 (+ 84us) write_op.cc:276] Timestamp: P: 1786429019821882 usec, L: 0
0811 06:17:10.664215 (+ 154us) write_op.cc:270] Start()
0811 06:17:10.664236 (+ 21us) write_op.cc:276] Timestamp: P: 1786429019830856 usec, L: 0
0811 06:17:10.664362 (+ 126us) write_op.cc:270] Start()
0811 06:17:10.664382 (+ 20us) write_op.cc:276] Timestamp: P: 1786429019854709 usec, L: 0
0811 06:17:10.664566 (+ 184us) write_op.cc:270] Start()
0811 06:17:10.664589 (+ 23us) write_op.cc:276] Timestamp: P: 1786429019878941 usec, L: 0
0811 06:17:10.664742 (+ 153us) write_op.cc:270] Start()
0811 06:17:10.664767 (+ 25us) write_op.cc:276] Timestamp: P: 1786429020119533 usec, L: 0
0811 06:17:10.664874 (+ 107us) write_op.cc:270] Start()
0811 06:17:10.664890 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020120344 usec, L: 0
0811 06:17:10.665000 (+ 110us) write_op.cc:270] Start()
0811 06:17:10.665016 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020120965 usec, L: 0
0811 06:17:10.665121 (+ 105us) write_op.cc:270] Start()
0811 06:17:10.665136 (+ 15us) write_op.cc:276] Timestamp: P: 1786429020130015 usec, L: 0
0811 06:17:10.669431 (+ 4295us) write_op.cc:270] Start()
0811 06:17:10.669463 (+ 32us) write_op.cc:276] Timestamp: P: 1786429020191573 usec, L: 0
0811 06:17:10.669603 (+ 140us) write_op.cc:270] Start()
0811 06:17:10.669627 (+ 24us) write_op.cc:276] Timestamp: P: 1786429020206091 usec, L: 0
0811 06:17:10.670732 (+ 1105us) write_op.cc:270] Start()
0811 06:17:10.670764 (+ 32us) write_op.cc:276] Timestamp: P: 1786429020211018 usec, L: 0
0811 06:17:10.670906 (+ 142us) write_op.cc:270] Start()
0811 06:17:10.670922 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020211695 usec, L: 0
0811 06:17:10.671034 (+ 112us) write_op.cc:270] Start()
0811 06:17:10.671050 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020219597 usec, L: 0
0811 06:17:10.671157 (+ 107us) write_op.cc:270] Start()
0811 06:17:10.671173 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020655981 usec, L: 0
0811 06:17:10.671271 (+ 98us) write_op.cc:270] Start()
0811 06:17:10.671287 (+ 16us) write_op.cc:276] Timestamp: P: 1786429020786127 usec, L: 0
0811 06:17:10.671383 (+ 96us) write_op.cc:270] Start()
0811 06:17:10.671397 (+ 14us) write_op.cc:276] Timestamp: P: 1786429020906683 usec, L: 0
0811 06:17:10.671512 (+ 115us) write_op.cc:270] Start()
0811 06:17:10.671529 (+ 17us) write_op.cc:276] Timestamp: P: 1786429021364979 usec, L: 0
0811 06:17:10.671641 (+ 112us) write_op.cc:270] Start()
0811 06:17:10.671656 (+ 15us) write_op.cc:276] Timestamp: P: 1786429021437715 usec, L: 0
0811 06:17:10.671829 (+ 173us) write_op.cc:270] Start()
0811 06:17:10.671846 (+ 17us) write_op.cc:276] Timestamp: P: 1786429021887462 usec, L: 0
0811 06:17:10.671949 (+ 103us) write_op.cc:270] Start()
0811 06:17:10.671965 (+ 16us) write_op.cc:276] Timestamp: P: 1786429022000902 usec, L: 0
0811 06:17:10.672064 (+ 99us) write_op.cc:270] Start()
0811 06:17:10.672079 (+ 15us) write_op.cc:276] Timestamp: P: 1786429022006671 usec, L: 0
0811 06:17:10.672175 (+ 96us) write_op.cc:270] Start()
0811 06:17:10.672190 (+ 15us) write_op.cc:276] Timestamp: P: 1786429022023461 usec, L: 0
0811 06:17:10.672306 (+ 116us) write_op.cc:270] Start()
0811 06:17:10.672323 (+ 17us) write_op.cc:276] Timestamp: P: 1786429022124594 usec, L: 0
0811 06:17:10.672463 (+ 140us) write_op.cc:270] Start()
0811 06:17:10.672484 (+ 21us) write_op.cc:276] Timestamp: P: 1786429022251499 usec, L: 0
0811 06:17:10.672614 (+ 130us) write_op.cc:270] Start()
0811 06:17:10.672634 (+ 20us) write_op.cc:276] Timestamp: P: 1786429022299208 usec, L: 0
0811 06:17:10.672760 (+ 126us) write_op.cc:270] Start()
0811 06:17:10.672779 (+ 19us) write_op.cc:276] Timestamp: P: 1786429022338949 usec, L: 0
0811 06:17:10.672903 (+ 124us) write_op.cc:270] Start()
0811 06:17:10.672919 (+ 16us) write_op.cc:276] Timestamp: P: 1786429022428685 usec, L: 0
0811 06:17:10.673026 (+ 107us) write_op.cc:270] Start()
0811 06:17:10.673042 (+ 16us) write_op.cc:276] Timestamp: P: 1786429022863005 usec, L: 0
0811 06:17:10.673147 (+ 105us) write_op.cc:270] Start()
0811 06:17:10.673172 (+ 25us) write_op.cc:276] Timestamp: P: 1786429022877280 usec, L: 0
0811 06:17:10.673283 (+ 111us) write_op.cc:270] Start()
0811 06:17:10.673301 (+ 18us) write_op.cc:276] Timestamp: P: 1786429022894771 usec, L: 0
0811 06:17:10.673434 (+ 133us) write_op.cc:270] Start()
0811 06:17:10.673463 (+ 29us) write_op.cc:276] Timestamp: P: 1786429022915390 usec, L: 0
0811 06:17:10.673617 (+ 154us) write_op.cc:270] Start()
0811 06:17:10.673637 (+ 20us) write_op.cc:276] Timestamp: P: 1786429022947834 usec, L: 0
0811 06:17:10.683707 (+ 10070us) write_op.cc:270] Start()
0811 06:17:10.683751 (+ 44us) write_op.cc:276] Timestamp: P: 1786429023402489 usec, L: 0
0811 06:17:10.683969 (+ 218us) write_op.cc:270] Start()
0811 06:17:10.683993 (+ 24us) write_op.cc:276] Timestamp: P: 1786429023421509 usec, L: 0
0811 06:17:10.684119 (+ 126us) write_op.cc:270] Start()
0811 06:17:10.684135 (+ 16us) write_op.cc:276] Timestamp: P: 1786429023500796 usec, L: 0
0811 06:17:10.684252 (+ 117us) write_op.cc:270] Start()
0811 06:17:10.684269 (+ 17us) write_op.cc:276] Timestamp: P: 1786429023611312 usec, L: 0
0811 06:17:10.706832 (+ 22563us) log.cc:842] Serialized 33904 byte log entry
0811 06:17:10.725881 (+ 19049us) raft_consensus.cc:1631] Marking committed up to 612
0811 06:17:10.726043 (+ 162us) log.cc:842] Serialized 15 byte log entry
0811 06:17:11.094846 (+368803us) raft_consensus.cc:1683] Filling consensus response to leader.
0811 06:17:11.094908 (+ 62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0811 06:17:11.094939 (+ 31us) raft_consensus.cc:1671] finished
0811 06:17:11.094944 (+ 5us) raft_consensus.cc:1677] UpdateReplicas() finished
0811 06:17:11.095361 (+ 417us) inbound_call.cc:173] Queueing success response
0811 06:17:11.098264 (+ 2903us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x615000010a24. stack: 00007f901db3066e 00007f901db30430 00007f901cbb75ed 00000000008ea064 00000000008ea02d 00007f902c24d27d 00007f902c24d373 00007f902906f361 00007f9030bc4769 00007f9030bd7565 00007f9030bd7311 00007f902a34008d 00007f902907f68e 00007f902907f3dd 00000000009edb7c 00007f901db76344
0811 06:17:11.098325 (+ 61us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x615000010a24. stack: 00007f901db3066e 00007f901db30430 00007f901cbb75ed 00000000008ea064 00000000008ea02d 00007f902c24d27d 00007f902c24d373 00007f902906f361 00007f9030bc4769 00007f9030bd7565 00007f9030bd7311 00007f902a34008d 00007f902907f68e 00007f902907f3dd 00000000009edb7c 00007f901db76344
Related trace 'op':
0811 06:17:10.654892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.672065 (+ 17173us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.672073 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:10.672076 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.672269 (+ 193us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.672290 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.672296 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.672393 (+ 97us) tablet.cc:699] Row locks acquired
0811 06:17:10.673370 (+ 977us) write_op.cc:260] PREPARE: finished
0811 06:17:10.737074 (+ 63704us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.927134 (+190060us) write_op.cc:301] APPLY: starting
0811 06:17:10.927162 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.927509 (+ 347us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.927512 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.927742 (+ 230us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.928027 (+ 285us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.928076 (+ 49us) write_op.cc:312] APPLY: finished
0811 06:17:10.928355 (+ 279us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.928554 (+ 199us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.928676 (+ 122us) write_op.cc:454] Released schema lock
0811 06:17:10.928692 (+ 16us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.928756 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.928766 (+ 10us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.673460 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.673560 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.673566 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:10.673568 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.673652 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.673690 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.673696 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.673770 (+ 74us) tablet.cc:699] Row locks acquired
0811 06:17:10.673772 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.927060 (+253288us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.928961 (+ 1901us) write_op.cc:301] APPLY: starting
0811 06:17:10.928977 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.929018 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.929020 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.929073 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.929103 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.929154 (+ 51us) write_op.cc:312] APPLY: finished
0811 06:17:10.929232 (+ 78us) log.cc:842] Serialized 23 byte log entry
0811 06:17:10.929300 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.929314 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:10.929319 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.929352 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.929355 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.673841 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.673919 (+ 78us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.673924 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:10.673926 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.673995 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.674005 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.674009 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.674067 (+ 58us) tablet.cc:699] Row locks acquired
0811 06:17:10.674069 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.949276 (+275207us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.951727 (+ 2451us) write_op.cc:301] APPLY: starting
0811 06:17:10.951749 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.951809 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.951812 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.952036 (+ 224us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.952075 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.952141 (+ 66us) write_op.cc:312] APPLY: finished
0811 06:17:10.952268 (+ 127us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.952709 (+ 441us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.952790 (+ 81us) write_op.cc:454] Released schema lock
0811 06:17:10.952799 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.952848 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.952851 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.674124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.674191 (+ 67us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.674195 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:10.674197 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.674251 (+ 54us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.674260 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.674264 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.674312 (+ 48us) tablet.cc:699] Row locks acquired
0811 06:17:10.674314 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.949344 (+275030us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.952948 (+ 3604us) write_op.cc:301] APPLY: starting
0811 06:17:10.952961 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.952996 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.952998 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.953097 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.953126 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.953155 (+ 29us) write_op.cc:312] APPLY: finished
0811 06:17:10.953220 (+ 65us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.953461 (+ 241us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.953475 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:10.953481 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.953511 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.953514 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.674358 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.674416 (+ 58us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.674419 (+ 3us) write_op.cc:435] Acquired schema lock
0811 06:17:10.674421 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.674477 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.674485 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.674490 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.674522 (+ 32us) tablet.cc:699] Row locks acquired
0811 06:17:10.674524 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.949402 (+274878us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.953590 (+ 4188us) write_op.cc:301] APPLY: starting
0811 06:17:10.953600 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.953626 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.953629 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.953662 (+ 33us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.953684 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.963188 (+ 9504us) write_op.cc:312] APPLY: finished
0811 06:17:10.963285 (+ 97us) log.cc:842] Serialized 23 byte log entry
0811 06:17:10.963586 (+ 301us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.963601 (+ 15us) write_op.cc:454] Released schema lock
0811 06:17:10.963608 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.963644 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.963647 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.674566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.755908 (+ 81342us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.755917 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:10.755920 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.756057 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.756073 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.756078 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.756158 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:10.756161 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.983896 (+227735us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.984406 (+ 510us) write_op.cc:301] APPLY: starting
0811 06:17:10.984427 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.984474 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.984476 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.984537 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.984574 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.984604 (+ 30us) write_op.cc:312] APPLY: finished
0811 06:17:10.984702 (+ 98us) log.cc:842] Serialized 23 byte log entry
0811 06:17:10.985013 (+ 311us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.985035 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:10.985043 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.985082 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.985085 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.756254 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.756353 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.756359 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:10.756360 (+ 1us) tablet.cc:660] Decoding operations
0811 06:17:10.756434 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.756446 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.756450 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.756545 (+ 95us) tablet.cc:699] Row locks acquired
0811 06:17:10.756547 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.983970 (+227423us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.985173 (+ 1203us) write_op.cc:301] APPLY: starting
0811 06:17:10.985185 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.985222 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.985224 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.985335 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.985365 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.985429 (+ 64us) write_op.cc:312] APPLY: finished
0811 06:17:10.985499 (+ 70us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.992425 (+ 6926us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.992452 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:10.992463 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.992524 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.992527 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.756614 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.756694 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.756699 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:10.756701 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.756771 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.756783 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.756788 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.756851 (+ 63us) tablet.cc:699] Row locks acquired
0811 06:17:10.756854 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:10.984013 (+227159us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.992648 (+ 8635us) write_op.cc:301] APPLY: starting
0811 06:17:10.992662 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.992706 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.992708 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.992850 (+ 142us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.992883 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.992920 (+ 37us) write_op.cc:312] APPLY: finished
0811 06:17:10.993020 (+ 100us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.993595 (+ 575us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.993613 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:10.993620 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.993656 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.993660 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.756949 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.757021 (+ 72us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.757025 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:10.757028 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.757101 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.757111 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.757116 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.757171 (+ 55us) tablet.cc:699] Row locks acquired
0811 06:17:10.757173 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.984057 (+226884us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.993781 (+ 9724us) write_op.cc:301] APPLY: starting
0811 06:17:10.994517 (+ 736us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.994558 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.994561 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.994660 (+ 99us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.994693 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:10.994721 (+ 28us) write_op.cc:312] APPLY: finished
0811 06:17:10.994807 (+ 86us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.011802 (+ 16995us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.011837 (+ 35us) write_op.cc:454] Released schema lock
0811 06:17:11.011847 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.011897 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.011901 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.757225 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.859493 (+102268us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.859502 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:10.859505 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.859656 (+ 151us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.859673 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.859680 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.859780 (+ 100us) tablet.cc:699] Row locks acquired
0811 06:17:10.859783 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.069888 (+210105us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.070062 (+ 174us) write_op.cc:301] APPLY: starting
0811 06:17:11.070081 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.070131 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.070133 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.070290 (+ 157us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.070376 (+ 86us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.070448 (+ 72us) write_op.cc:312] APPLY: finished
0811 06:17:11.070554 (+ 106us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.070868 (+ 314us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.070893 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:11.070901 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.070947 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.070950 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.859961 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.860059 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.860066 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.860068 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.860168 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.860179 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.860184 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.860233 (+ 49us) tablet.cc:699] Row locks acquired
0811 06:17:10.860236 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.069985 (+209749us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.071056 (+ 1071us) write_op.cc:301] APPLY: starting
0811 06:17:11.071069 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.071103 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.071105 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.071143 (+ 38us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.071170 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.071197 (+ 27us) write_op.cc:312] APPLY: finished
0811 06:17:11.071264 (+ 67us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.071500 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.071514 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:11.071520 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.071548 (+ 28us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.071551 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:10.860295 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.860362 (+ 67us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.860366 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:10.860368 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.860442 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.860451 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.860455 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.860692 (+ 237us) tablet.cc:699] Row locks acquired
0811 06:17:10.860696 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:11.074668 (+213972us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.074809 (+ 141us) write_op.cc:301] APPLY: starting
0811 06:17:11.074822 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.074895 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.074898 (+
I20260811 06:17:11.328583 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:11.329628 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc323cf778548ae86f45f0fd8bd4a89 already in progress: creating tablet
I20260811 06:17:11.329993 11672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_39662cb2c2484aff9fdaff055087b0ae" } modify_external_catalogs: true
I20260811 06:17:11.331142 13794 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:17:11.331691 13794 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: LEADER
I20260811 06:17:11.338673 11362 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:11.338629 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.349133 11362 ts_tablet_manager.cc:1397] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.278s user 0.008s sys 0.003s
I20260811 06:17:11.349144 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "585f92fc5b3d41bd97df525380fcab9f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:11.350163 11047 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.356796 11362 raft_consensus.cc:348] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.357080 11362 raft_consensus.cc:374] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.357139 11362 raft_consensus.cc:729] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.357319 11362 consensus_queue.cc:260] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.357913 11362 ts_tablet_manager.cc:1428] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:11.359993 13983 tablet_replica.cc:330] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:11.360190 13983 raft_consensus.cc:2229] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:11.360425 13983 pending_rounds.cc:62] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:11.362152 11362 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:11.360471 13983 pending_rounds.cc:68] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213309620088832 op_type: NO_OP noop_request { }
I20260811 06:17:11.365658 13983 raft_consensus.cc:2866] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:11.366297 13983 raft_consensus.cc:2258] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.375594 13983 ts_tablet_manager.cc:1905] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.376747 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 5 candidate_status { last_received { term: 4 index: 612 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
W20260811 06:17:11.388509 10813 consensus_peers.cc:487] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:11.388622 11362 tablet_bootstrap.cc:654] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.420404 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 91f079882c3c46318f70190d5293868e
I20260811 06:17:11.421053 11663 catalog_manager.cc:6565] ReplaceTablet: tablet 91f079882c3c46318f70190d5293868e deleted and replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91
I20260811 06:17:11.421382 11663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 99) took 2026 ms. Trace:
I20260811 06:17:11.422511 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.423659 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:11.424897 11361 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.425034 11361 ts_tablet_manager.cc:1397] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.184s user 0.006s sys 0.000s
I20260811 06:17:11.425806 13983 ts_tablet_manager.cc:1918] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:11.425947 13983 log.cc:1196] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:11.425817 11361 raft_consensus.cc:348] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.426034 11361 raft_consensus.cc:374] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.426116 11361 raft_consensus.cc:729] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.426303 13983 ts_tablet_manager.cc:1939] T 1a2e55d5e0244c299d837aed98f94aad P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:11.427035 13983 tablet_replica.cc:330] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:11.427224 13983 raft_consensus.cc:2229] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:11.427188 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 91f079882c3c46318f70190d5293868e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91f079882c3c46318f70190d5293868e already in progress: creating tablet
I20260811 06:17:11.428771 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 5 candidate_status { last_received { term: 4 index: 612 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:17:11.429625 12740 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29fb239be50c4171bdbc75e064555197; no voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219
I20260811 06:17:11.421559 11663 rpcz_store.cc:276] 0811 06:17:09.394832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.314867 (+1920035us) service_pool.cc:227] Handling call
0811 06:17:11.421174 (+106307us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.363514 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.363723 (+ 209us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.363730 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.363733 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.363894 (+ 161us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.363910 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.363915 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.364002 (+ 87us) tablet.cc:699] Row locks acquired
0811 06:17:11.364005 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.364046 (+ 41us) write_op.cc:270] Start()
0811 06:17:11.364084 (+ 38us) write_op.cc:276] Timestamp: P: 1786429031364025 usec, L: 0
0811 06:17:11.364087 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.364373 (+ 286us) log.cc:842] Serialized 625 byte log entry
0811 06:17:11.416327 (+ 51954us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.417696 (+ 1369us) write_op.cc:301] APPLY: starting
0811 06:17:11.417753 (+ 57us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.417804 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.417900 (+ 96us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.418082 (+ 182us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.418141 (+ 59us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.418148 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.418243 (+ 95us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.418310 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.418335 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:11.418342 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.418402 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.418406 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":775,"apply.run_wall_time_us":774,"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":940,"prepare.run_wall_time_us":940,"replication_time_us":51974}]]}
I20260811 06:17:11.431185 11663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_44c05bf06b9b40f4bd44080f3207b882" } modify_external_catalogs: true
I20260811 06:17:11.431484 11663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_44c05bf06b9b40f4bd44080f3207b882" } modify_external_catalogs: true
I20260811 06:17:11.328017 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:11.434523 10649 raft_consensus.cc:3037] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.435801 13983 raft_consensus.cc:2258] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.436965 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]) successfully deleted
I20260811 06:17:11.438349 13741 raft_consensus.cc:482] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.438607 13741 raft_consensus.cc:504] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.439277 13741 leader_election.cc:288] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.448626 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:11.449211 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:11.449617 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:11.450536 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:11.450810 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:11.451210 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8bd026d2c6064a67b1c432efa4474a0e (table default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387]). Expected version 1 got 0
I20260811 06:17:11.451494 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:11.451947 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
I20260811 06:17:11.452347 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:11.452589 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:11.452899 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:11.453679 11670 catalog_manager.cc:5495] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:11.454383 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:11.454603 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:11.455490 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:11.455835 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:11.456257 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:11.456564 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet dd6584701c23406e83122bd2493b7972 (table default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3]). Expected version 2 got 0
I20260811 06:17:11.456935 11670 catalog_manager.cc:5495] T 19f45416a7ae45b3a8b26dd98b672f36 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:11.457666 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:11.458156 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:11.458200 13948 raft_consensus.cc:482] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.458952 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:11.459283 13866 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 06:17:11.459501 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:11.461027 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:11.461822 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:11.462352 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 844e735c671440c5bfe1035068c7334e (table default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1]). Expected version 1 got 0
I20260811 06:17:11.462774 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:11.462672 11361 consensus_queue.cc:260] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.463155 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:11.463680 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:11.464030 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:11.464389 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]). Expected version 2 got 0
I20260811 06:17:11.464764 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0874f0e73267446fb873f4619f93307e (table default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658]). Expected version 3 got 0
I20260811 06:17:11.467229 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]). Expected version 1 got 0
I20260811 06:17:11.467605 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:11.468082 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:11.468534 11670 catalog_manager.cc:5495] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:11.469343 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:11.469734 11670 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_021b3433e8a447318649cd83bcc5a326 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 1 got 0
W20260811 06:17:11.470361 11676 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55b38127e97f400f879afc94c0672906 consensus state has no leader
I20260811 06:17:11.470791 11676 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 83) took 4333 ms. Trace:
I20260811 06:17:11.470934 11676 rpcz_store.cc:276] 0811 06:17:07.137696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.275795 (+3138099us) service_pool.cc:227] Handling call
0811 06:17:10.276344 (+ 549us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:10.276563 (+ 219us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:10.436192 (+159629us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:10.436281 (+ 89us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:10.447509 (+ 11228us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:11.470677 (+1023168us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.437348 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.437503 (+ 155us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.437510 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:10.437513 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.437625 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.437640 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.437644 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.437861 (+ 217us) tablet.cc:699] Row locks acquired
0811 06:17:10.437865 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:10.437904 (+ 39us) write_op.cc:270] Start()
0811 06:17:10.437945 (+ 41us) write_op.cc:276] Timestamp: P: 1786429030437880 usec, L: 0
0811 06:17:10.437950 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.438148 (+ 198us) log.cc:842] Serialized 405 byte log entry
0811 06:17:10.446088 (+ 7940us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.446233 (+ 145us) write_op.cc:301] APPLY: starting
0811 06:17:10.446250 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.446294 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.446322 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.446382 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.446418 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.446424 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.446510 (+ 86us) log.cc:842] Serialized 23 byte log entry
0811 06:17:10.446681 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.446704 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:10.446711 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.446774 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.446778 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":611,"apply.run_wall_time_us":611,"num_ops":1,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":853,"prepare.run_wall_time_us":937,"raft.queue_time_us":527,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":420,"replication_time_us":8110}]]}
I20260811 06:17:11.473869 10649 raft_consensus.cc:2454] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:11.474337 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.474624 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.474972 10810 leader_election.cc:302] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.475399 13571 raft_consensus.cc:2781] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:11.475517 13571 raft_consensus.cc:686] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:11.458386 13948 raft_consensus.cc:504] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.478837 13948 leader_election.cc:288] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.478816 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet dc4a4e8bfe3b43aeb0c1617dcb29e685
I20260811 06:17:11.479535 11684 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 84) took 3270 ms. Trace:
I20260811 06:17:11.479599 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 189) took 3641 ms. Trace:
I20260811 06:17:11.479691 12726 rpcz_store.cc:276] 0811 06:17:07.837771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.837814 (+ 43us) service_pool.cc:227] Handling call
0811 06:17:11.226399 (+3388585us) ts_tablet_manager.cc:1145] Deleting tablet 8c997501cefd4e6b9e5824e5403dd39b
0811 06:17:11.226411 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.255090 (+ 28679us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.291189 (+ 36099us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.479580 (+188391us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":3388430}
I20260811 06:17:11.479681 11684 rpcz_store.cc:276] 0811 06:17:08.208762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.347038 (+2138276us) service_pool.cc:227] Handling call
0811 06:17:10.452918 (+105880us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:10.454641 (+ 1723us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:10.454702 (+ 61us) catalog_manager.cc:2761] Locking tablets
0811 06:17:10.454833 (+ 131us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:10.477680 (+ 22847us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:10.478073 (+ 393us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:11.478688 (+1000615us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:11.479412 (+ 724us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.455669 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.455779 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.455785 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:10.455787 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:10.455907 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.455922 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.455927 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:10.456089 (+ 162us) tablet.cc:699] Row locks acquired
0811 06:17:10.456091 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.456132 (+ 41us) write_op.cc:270] Start()
0811 06:17:10.456170 (+ 38us) write_op.cc:276] Timestamp: P: 1786429030456103 usec, L: 0
0811 06:17:10.456174 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.456372 (+ 198us) log.cc:842] Serialized 728 byte log entry
0811 06:17:10.461823 (+ 5451us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.462112 (+ 289us) write_op.cc:301] APPLY: starting
0811 06:17:10.462130 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.462179 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.462239 (+ 60us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.462310 (+ 71us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.462360 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:10.462367 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:10.462451 (+ 84us) log.cc:842] Serialized 29 byte log entry
0811 06:17:10.462515 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.462535 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:10.462542 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.462598 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.462601 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":545,"apply.run_wall_time_us":545,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":803,"prepare.run_wall_time_us":804,"raft.queue_time_us":703,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":310,"replication_time_us":5623}]]}
I20260811 06:17:11.481015 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d58c8185f2b547b58e81aeb849c8a9ad" } new_table_name: "default.Table_bc33f4d4731d4f2d97d3b73e083ea78e" modify_external_catalogs: true
I20260811 06:17:11.472640 11365 raft_consensus.cc:348] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.481870 11365 raft_consensus.cc:374] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.481945 11365 raft_consensus.cc:729] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.482131 11365 consensus_queue.cc:260] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.482698 11365 ts_tablet_manager.cc:1428] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.194s user 0.001s sys 0.001s
W20260811 06:17:11.484784 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 91) took 3840 ms (client timeout 1000 ms). Trace:
I20260811 06:17:11.484866 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 190) took 3474 ms. Trace:
I20260811 06:17:11.484949 12726 rpcz_store.cc:276] 0811 06:17:08.009979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.010068 (+ 89us) service_pool.cc:227] Handling call
0811 06:17:11.479956 (+3469888us) ts_tablet_manager.cc:1145] Deleting tablet 7bcc463affbb4154877624aec28435bc
0811 06:17:11.484723 (+ 4767us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.484848 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3469662}
I20260811 06:17:11.485489 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 191) took 2530 ms. Trace:
W20260811 06:17:11.484933 11679 rpcz_store.cc:269] 0811 06:17:07.644648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:07.897353 (+252705us) service_pool.cc:227] Handling call
0811 06:17:11.484739 (+3587386us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:08.884032 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:08.884155 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:08.884163 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:08.884165 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:08.884333 (+ 168us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:08.884347 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:08.884352 (+ 5us) tablet.cc:683] Acquiring locks for 3 operations
0811 06:17:08.884482 (+ 130us) tablet.cc:699] Row locks acquired
0811 06:17:08.884485 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:08.884532 (+ 47us) write_op.cc:270] Start()
0811 06:17:08.884569 (+ 37us) write_op.cc:276] Timestamp: P: 1786429028884501 usec, L: 0
0811 06:17:08.884573 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:08.884876 (+ 303us) log.cc:842] Serialized 1284 byte log entry
0811 06:17:08.889530 (+ 4654us) op_driver.cc:444] REPLICATION: finished
0811 06:17:08.893839 (+ 4309us) write_op.cc:301] APPLY: starting
0811 06:17:08.893859 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:08.893953 (+ 94us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:08.893983 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:08.894089 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:08.894126 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0811 06:17:08.894133 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:08.894277 (+ 144us) log.cc:842] Serialized 35 byte log entry
0811 06:17:08.894356 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.894381 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:08.894388 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:08.894448 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:08.894451 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":73564,"reported_tablets":200,"child_traces":[["op",{"apply.queue_time_us":4207,"apply.run_cpu_time_us":683,"apply.run_wall_time_us":682,"num_ops":3,"prepare.queue_time_us":1301,"prepare.run_cpu_time_us":990,"prepare.run_wall_time_us":991,"raft.queue_time_us":485,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":357,"replication_time_us":4905}]]}
I20260811 06:17:11.485559 12726 rpcz_store.cc:276] 0811 06:17:08.954713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.954795 (+ 82us) service_pool.cc:227] Handling call
0811 06:17:11.485208 (+2530413us) ts_tablet_manager.cc:1145] Deleting tablet 1649493bd0924ee48fd5044d7288932d
0811 06:17:11.485379 (+ 171us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.485474 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2530167}
I20260811 06:17:11.486066 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 192) took 2426 ms. Trace:
I20260811 06:17:11.486133 12726 rpcz_store.cc:276] 0811 06:17:09.059178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.059264 (+ 86us) service_pool.cc:227] Handling call
0811 06:17:11.485767 (+2426503us) ts_tablet_manager.cc:1145] Deleting tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f
0811 06:17:11.485972 (+ 205us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.486051 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2426255}
I20260811 06:17:11.487542 11361 ts_tablet_manager.cc:1428] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.062s user 0.003s sys 0.000s
I20260811 06:17:11.488238 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:11.488260 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 198) took 1724 ms. Trace:
I20260811 06:17:11.488344 12726 rpcz_store.cc:276] 0811 06:17:09.763490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.767228 (+ 3738us) service_pool.cc:227] Handling call
0811 06:17:11.486305 (+1719077us) ts_tablet_manager.cc:1145] Deleting tablet 12971f852ea943b78d967f7672680cad
0811 06:17:11.488136 (+ 1831us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.488242 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1718736}
W20260811 06:17:11.490830 11601 catalog_manager.cc:4914] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): alter failed for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]),no further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:11.491093 13983 ts_tablet_manager.cc:1905] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.491460 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet d4d44dea35e94ed788b7e1e5a8a24d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.491670 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.491727 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.492009 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 199) took 1692 ms. Trace:
I20260811 06:17:11.492091 12726 rpcz_store.cc:276] 0811 06:17:09.799612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.799672 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:11.488563 (+1688891us) ts_tablet_manager.cc:1145] Deleting tablet f6f682f675c344b6b5955e834f94091f
0811 06:17:11.491864 (+ 3301us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.491989 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688671}
I20260811 06:17:11.492384 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.492573 11361 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.475752 13571 consensus_queue.cc:237] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:11.495508 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 already in progress: creating tablet
I20260811 06:17:11.496207 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 207) took 1233 ms. Trace:
I20260811 06:17:11.496301 12726 rpcz_store.cc:276] 0811 06:17:10.263173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.263342 (+ 169us) service_pool.cc:227] Handling call
0811 06:17:11.492312 (+1228970us) ts_tablet_manager.cc:1145] Deleting tablet 085179a610734942b9dd050ce9cf56d4
0811 06:17:11.496067 (+ 3755us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.496186 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228769}
I20260811 06:17:11.496606 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 215) took 1210 ms. Trace:
I20260811 06:17:11.496670 12726 rpcz_store.cc:276] 0811 06:17:10.286629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.286693 (+ 64us) service_pool.cc:227] Handling call
0811 06:17:11.496528 (+1209835us) ts_tablet_manager.cc:1145] Deleting tablet 2fcf7c7a470144c0a084aebc2032d896
0811 06:17:11.496538 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.496594 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209336}
I20260811 06:17:11.496948 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 216) took 1210 ms. Trace:
I20260811 06:17:11.497007 12726 rpcz_store.cc:276] 0811 06:17:10.286718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.286877 (+ 159us) service_pool.cc:227] Handling call
0811 06:17:11.496860 (+1209983us) ts_tablet_manager.cc:1145] Deleting tablet 9a79e23d311a447480c70393259cbfae
0811 06:17:11.496868 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.496935 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209618}
I20260811 06:17:11.497246 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 217) took 1210 ms. Trace:
I20260811 06:17:11.497299 12726 rpcz_store.cc:276] 0811 06:17:10.286954 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287025 (+ 71us) service_pool.cc:227] Handling call
0811 06:17:11.497167 (+1210142us) ts_tablet_manager.cc:1145] Deleting tablet 32407c8872464da2b1470a8ae21c86fd
0811 06:17:11.497175 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.497235 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209860}
I20260811 06:17:11.497541 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 218) took 1210 ms. Trace:
I20260811 06:17:11.497597 12726 rpcz_store.cc:276] 0811 06:17:10.287092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287348 (+ 256us) service_pool.cc:227] Handling call
0811 06:17:11.497462 (+1210114us) ts_tablet_manager.cc:1145] Deleting tablet c2527862e75b42aa9091456b0f5f994e
0811 06:17:11.497471 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.497530 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209917}
I20260811 06:17:11.497867 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 220) took 1210 ms. Trace:
I20260811 06:17:11.497934 12726 rpcz_store.cc:276] 0811 06:17:10.287285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287361 (+ 76us) service_pool.cc:227] Handling call
0811 06:17:11.497777 (+1210416us) ts_tablet_manager.cc:1145] Deleting tablet 79f307f50e044435be880079219170d8
0811 06:17:11.497786 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.497854 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210218}
I20260811 06:17:11.490361 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.500945 11365 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.502797 11365 tablet_bootstrap.cc:654] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:11.507848 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d6280a32b6c49f5886fa1ff8745b740 consensus state has no leader
I20260811 06:17:11.508395 11361 tablet_bootstrap.cc:654] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.509339 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 102) took 1425 ms. Trace:
I20260811 06:17:11.509925 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 213) took 1223 ms. Trace:
I20260811 06:17:11.510044 12726 rpcz_store.cc:276] 0811 06:17:10.286453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287543 (+ 1090us) service_pool.cc:227] Handling call
0811 06:17:11.509782 (+1222239us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:11.509802 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.509902 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210431}
I20260811 06:17:11.510529 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 222) took 1223 ms. Trace:
I20260811 06:17:11.510619 12726 rpcz_store.cc:276] 0811 06:17:10.287487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287590 (+ 103us) service_pool.cc:227] Handling call
0811 06:17:11.510380 (+1222790us) ts_tablet_manager.cc:1145] Deleting tablet b79f635593b04cd59d43d54f702a8cc6
0811 06:17:11.510391 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.510511 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1222638}
I20260811 06:17:11.509516 11684 rpcz_store.cc:276] 0811 06:17:10.083013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.480516 (+1397503us) service_pool.cc:227] Handling call
0811 06:17:11.481292 (+ 776us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.481592 (+ 300us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:11.494649 (+ 13057us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:11.494752 (+ 103us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:11.507436 (+ 12684us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.507443 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:11.507525 (+ 82us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:11.508371 (+ 846us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.495754 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.495921 (+ 167us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.495928 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.495931 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.496037 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.496051 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.496056 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.496117 (+ 61us) tablet.cc:699] Row locks acquired
0811 06:17:11.496120 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.496156 (+ 36us) write_op.cc:270] Start()
0811 06:17:11.496191 (+ 35us) write_op.cc:276] Timestamp: P: 1786429031496124 usec, L: 0
0811 06:17:11.496195 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.496381 (+ 186us) log.cc:842] Serialized 405 byte log entry
0811 06:17:11.503783 (+ 7402us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.503920 (+ 137us) write_op.cc:301] APPLY: starting
0811 06:17:11.503937 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.503982 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.504059 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.504117 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.504157 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.504163 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.504258 (+ 95us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.504343 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.504367 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:11.504374 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":84,"apply.run_cpu_time_us":518,"apply.run_wall_time_us":517,"num_ops":1,"prepare.queue_time_us":492,"prepare.run_cpu_time_us":736,"prepare.run_wall_time_us":736,"raft.queue_time_us":1788,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":303,"replication_time_us":7560}]]}
I20260811 06:17:11.510943 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 210) took 1224 ms. Trace:
I20260811 06:17:11.511026 12726 rpcz_store.cc:276] 0811 06:17:10.286136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.286413 (+ 277us) service_pool.cc:227] Handling call
0811 06:17:11.510839 (+1224426us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:17:11.510850 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.510928 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223061}
I20260811 06:17:11.511309 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 219) took 1224 ms. Trace:
I20260811 06:17:11.511389 12726 rpcz_store.cc:276] 0811 06:17:10.287197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287579 (+ 382us) service_pool.cc:227] Handling call
0811 06:17:11.511230 (+1223651us) ts_tablet_manager.cc:1145] Deleting tablet 217f60a1ca044af38f9ee9093e021c27
0811 06:17:11.511240 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.511294 (+ 54us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223443}
I20260811 06:17:11.511665 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 221) took 1224 ms. Trace:
I20260811 06:17:11.511742 12726 rpcz_store.cc:276] 0811 06:17:10.287370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287838 (+ 468us) service_pool.cc:227] Handling call
0811 06:17:11.511587 (+1223749us) ts_tablet_manager.cc:1145] Deleting tablet 0813b34919a14a2481857e9f87b217c8
0811 06:17:11.511597 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.511650 (+ 53us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223608}
I20260811 06:17:11.512001 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 214) took 1225 ms. Trace:
I20260811 06:17:11.512079 12726 rpcz_store.cc:276] 0811 06:17:10.286543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287715 (+ 1172us) service_pool.cc:227] Handling call
0811 06:17:11.511925 (+1224210us) ts_tablet_manager.cc:1145] Deleting tablet 035eee1d37c94471a7cd697fb0fbb951
0811 06:17:11.511935 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.511987 (+ 52us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223925}
I20260811 06:17:11.512638 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_34897d99ed2841d195d7833a0bcdd2c4" } new_table_name: "default.Table_aae70e5ddc0c49fea99f4f77e876a4fd" modify_external_catalogs: true
I20260811 06:17:11.513371 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 209) took 1227 ms. Trace:
I20260811 06:17:11.513475 12726 rpcz_store.cc:276] 0811 06:17:10.286035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287792 (+ 1757us) service_pool.cc:227] Handling call
0811 06:17:11.512331 (+1224539us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:17:11.512340 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.513352 (+ 1012us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1224099}
I20260811 06:17:11.513808 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 211) took 1227 ms. Trace:
I20260811 06:17:11.513891 12726 rpcz_store.cc:276] 0811 06:17:10.286224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.287990 (+ 1766us) service_pool.cc:227] Handling call
0811 06:17:11.513680 (+1225690us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:11.513691 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.513792 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1225284}
I20260811 06:17:11.514158 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 223) took 1225 ms. Trace:
I20260811 06:17:11.514245 12726 rpcz_store.cc:276] 0811 06:17:10.288414 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.288461 (+ 47us) service_pool.cc:227] Handling call
0811 06:17:11.514083 (+1225622us) ts_tablet_manager.cc:1145] Deleting tablet f5ad5529d4844f61b0888624e7c8b3ce
0811 06:17:11.514092 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.514143 (+ 51us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1225434}
I20260811 06:17:11.515599 11362 tablet_bootstrap.cc:492] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:11.515754 11362 ts_tablet_manager.cc:1397] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.154s user 0.006s sys 0.010s
I20260811 06:17:11.516448 11362 raft_consensus.cc:348] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.516677 11362 raft_consensus.cc:374] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.516743 11362 raft_consensus.cc:729] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.500648 10922 raft_consensus.cc:2454] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:11.490885 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.521205 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 52ecffcf4a0e46428caed6f7d72199bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.521227 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet a1981dc26be24ec5afaa3c0bb5c46c8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.521642 11047 leader_election.cc:302] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
W20260811 06:17:11.521703 10555 leader_election.cc:341] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.522066 13741 raft_consensus.cc:2781] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:11.522212 13741 raft_consensus.cc:482] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:11.522364 13741 raft_consensus.cc:3037] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.525311 13741 raft_consensus.cc:504] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.526769 13741 leader_election.cc:288] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.500438 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.530224 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.516945 11362 consensus_queue.cc:260] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.531184 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:11.531391 10913 raft_consensus.cc:3037] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.533774 12726 tablet_replica.cc:330] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.534018 12726 raft_consensus.cc:2229] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.534206 12726 raft_consensus.cc:2258] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.534667 11362 ts_tablet_manager.cc:1428] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260811 06:17:11.534983 11362 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:11.535708 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 with delete_type TABLET_DATA_DELETED (replaced by tablet a33fc402d3084b458929d76b8fc22adb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.535828 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.536057 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.538240 11362 tablet_bootstrap.cc:654] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.539108 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.540261 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.540458 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.540704 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.540848 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 532208d7a02d448e8dac702ffe6c2ffc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.541108 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.541240 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.541736 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet f4f14a0add084048b92a501476ad6588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.542062 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.542224 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.542423 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.542905 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e5b4cdeb464861ada487eeb1b901a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.543313 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad5529d4844f61b0888624e7c8b3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.544009 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.549677 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.554160 12726 ts_tablet_manager.cc:1905] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:11.554445 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5195c4d7b09d45b8873575e1f67a5cb3 consensus state has no leader
I20260811 06:17:11.554826 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 103) took 1457 ms. Trace:
I20260811 06:17:11.555011 11684 rpcz_store.cc:276] 0811 06:17:10.097647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.512035 (+1414388us) service_pool.cc:227] Handling call
0811 06:17:11.513950 (+ 1915us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.514525 (+ 575us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:11.514712 (+ 187us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:11.514797 (+ 85us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:11.525303 (+ 10506us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.525310 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:11.525390 (+ 80us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:11.554680 (+ 29290us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.517041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.517147 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.517153 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.517155 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.517253 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.517266 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.517270 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.517330 (+ 60us) tablet.cc:699] Row locks acquired
0811 06:17:11.517333 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.517375 (+ 42us) write_op.cc:270] Start()
0811 06:17:11.517408 (+ 33us) write_op.cc:276] Timestamp: P: 1786429031517340 usec, L: 0
0811 06:17:11.517412 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.517601 (+ 189us) log.cc:842] Serialized 405 byte log entry
0811 06:17:11.521978 (+ 4377us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.522080 (+ 102us) write_op.cc:301] APPLY: starting
0811 06:17:11.522094 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.522130 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.522155 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.522201 (+ 46us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.522230 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.522236 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.522305 (+ 69us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.522360 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.522378 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:11.522384 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":58,"apply.run_cpu_time_us":359,"apply.run_wall_time_us":358,"num_ops":1,"prepare.queue_time_us":1699,"prepare.run_cpu_time_us":670,"prepare.run_wall_time_us":669,"raft.queue_time_us":81,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":295,"replication_time_us":4541}]]}
I20260811 06:17:11.556870 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_317717a9da1a41028e46bcebb073c694" } new_table_name: "default.Table_8121b021912d44ca88b933509ff2698b" modify_external_catalogs: true
I20260811 06:17:11.558110 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet c5c3e243e72f4cffb3318246ab428bd6
W20260811 06:17:11.565423 11653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 93) took 1865 ms (client timeout 1000 ms). Trace:
W20260811 06:17:11.566990 11653 rpcz_store.cc:269] 0811 06:17:09.699904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:09.805615 (+105711us) service_pool.cc:227] Handling call
0811 06:17:11.564975 (+1759360us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:10.331034 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:10.331184 (+ 150us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:10.331192 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:10.331195 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:10.331312 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:10.331328 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:10.331333 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:10.331414 (+ 81us) tablet.cc:699] Row locks acquired
0811 06:17:10.331416 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:10.331462 (+ 46us) write_op.cc:270] Start()
0811 06:17:10.331502 (+ 40us) write_op.cc:276] Timestamp: P: 1786429030331382 usec, L: 0
0811 06:17:10.331507 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:10.331719 (+ 212us) log.cc:842] Serialized 530 byte log entry
0811 06:17:10.336344 (+ 4625us) op_driver.cc:444] REPLICATION: finished
0811 06:17:10.336473 (+ 129us) write_op.cc:301] APPLY: starting
0811 06:17:10.336490 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:10.336535 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:10.336564 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:10.336626 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:10.336660 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:10.336666 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:10.336749 (+ 83us) log.cc:842] Serialized 23 byte log entry
0811 06:17:10.336820 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.336841 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:10.336848 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:10.336906 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:10.336910 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24279,"reported_tablets":192,"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":491,"apply.run_wall_time_us":491,"num_ops":1,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":810,"prepare.run_wall_time_us":810,"raft.queue_time_us":476,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":241,"replication_time_us":4799}]]}
I20260811 06:17:11.569679 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_80c64d7a49ca45e3bfad0438b70ed13d" } modify_external_catalogs: true
W20260811 06:17:11.570273 11683 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 92) took 2786 ms (client timeout 1000 ms). Trace:
I20260811 06:17:11.570536 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_80c64d7a49ca45e3bfad0438b70ed13d" } modify_external_catalogs: true
W20260811 06:17:11.571646 11601 catalog_manager.cc:4914] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): alter failed for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]),no further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:11.573189 12944 raft_consensus.cc:482] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:11.570843 11683 rpcz_store.cc:269] 0811 06:17:08.783396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.895499 (+112103us) service_pool.cc:227] Handling call
0811 06:17:09.693770 (+798271us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.693777 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:11.570151 (+1876374us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:09.684900 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:09.685033 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:09.685041 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:09.685043 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:09.685171 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:09.685188 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:09.685193 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:09.685341 (+ 148us) tablet.cc:699] Row locks acquired
0811 06:17:09.685343 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:09.685384 (+ 41us) write_op.cc:270] Start()
0811 06:17:09.685422 (+ 38us) write_op.cc:276] Timestamp: P: 1786429029685336 usec, L: 0
0811 06:17:09.685426 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:09.685622 (+ 196us) log.cc:842] Serialized 907 byte log entry
0811 06:17:09.689704 (+ 4082us) op_driver.cc:444] REPLICATION: finished
0811 06:17:09.689846 (+ 142us) write_op.cc:301] APPLY: starting
0811 06:17:09.689863 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:09.689911 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:09.689937 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:09.690009 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:09.690045 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:09.690068 (+ 23us) write_op.cc:312] APPLY: finished
0811 06:17:09.690151 (+ 83us) log.cc:842] Serialized 29 byte log entry
0811 06:17:09.690214 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:09.690237 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:09.690244 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":83263,"reported_tablets":190,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":459,"apply.run_wall_time_us":459,"num_ops":2,"prepare.queue_time_us":974,"prepare.run_cpu_time_us":826,"prepare.run_wall_time_us":826,"raft.queue_time_us":535,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"replication_time_us":4254,"spinlock_wait_cycles":352128}]]}
I20260811 06:17:11.573627 13983 ts_tablet_manager.cc:1918] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:11.574160 13983 log.cc:1196] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:11.573333 12944 raft_consensus.cc:504] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.575521 12944 leader_election.cc:288] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.575160 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e13f1a2d6d924970ae68d9a31b0f6903" } modify_external_catalogs: true
W20260811 06:17:11.576467 10810 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
I20260811 06:17:11.577075 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1349b0ea48b848398d4bdda528358c30" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.577544 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e13f1a2d6d924970ae68d9a31b0f6903" } modify_external_catalogs: true
I20260811 06:17:11.579231 13983 ts_tablet_manager.cc:1939] T 61114d1bcdb94af7b6c55b0331accee5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:11.579494 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.575871 10913 raft_consensus.cc:2454] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:11.580165 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.582733 13983 tablet_replica.cc:330] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:11.583163 13983 raft_consensus.cc:2229] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.583665 13983 raft_consensus.cc:2258] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:11.586308 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 365274us
I20260811 06:17:11.588353 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.588745 12726 ts_tablet_manager.cc:1918] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:11.588861 12726 log.cc:1196] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/14a36a644dc4491dad838ce4e19793ab
W20260811 06:17:11.589733 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 93) took 2673 ms (client timeout 1000 ms). Trace:
W20260811 06:17:11.590045 11655 rpcz_store.cc:269] 0811 06:17:08.915962 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:08.946637 (+ 30675us) service_pool.cc:227] Handling call
0811 06:17:11.589605 (+2642968us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20092,"reported_tablets":195}
W20260811 06:17:11.590225 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f12c8618198f4413b2727d04f850a10f because the tablet was not found. No further retry: Not found: Tablet not found: f12c8618198f4413b2727d04f850a10f
I20260811 06:17:11.590636 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d6b851b238cc407c91a9e72f70ac3b5a" } new_table_name: "default.Table_6f37222dddb540a59514bf3552a3b5d1" modify_external_catalogs: true
I20260811 06:17:11.592329 11663 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 101) took 1585 ms. Trace:
I20260811 06:17:11.592578 11663 rpcz_store.cc:276] 0811 06:17:10.007206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.430977 (+1423771us) service_pool.cc:227] Handling call
0811 06:17:11.431605 (+ 628us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.431745 (+ 140us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:11.431810 (+ 65us) catalog_manager.cc:2761] Locking tablets
0811 06:17:11.431937 (+ 127us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:11.445850 (+ 13913us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:11.445974 (+ 124us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:11.557903 (+111929us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:11.592192 (+ 34289us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.434300 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.434417 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.434423 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.434425 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.434533 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.434547 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.434552 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.434659 (+ 107us) tablet.cc:699] Row locks acquired
0811 06:17:11.434662 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.434704 (+ 42us) write_op.cc:270] Start()
0811 06:17:11.434738 (+ 34us) write_op.cc:276] Timestamp: P: 1786429031434674 usec, L: 0
0811 06:17:11.434742 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.434962 (+ 220us) log.cc:842] Serialized 728 byte log entry
0811 06:17:11.439872 (+ 4910us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.442395 (+ 2523us) write_op.cc:301] APPLY: starting
0811 06:17:11.442415 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.442460 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.442501 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.442578 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.442614 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:11.442620 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.442705 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.442772 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.442794 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:11.442802 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.442863 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.442867 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2452,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":540,"num_ops":2,"prepare.queue_time_us":857,"prepare.run_cpu_time_us":781,"prepare.run_wall_time_us":780,"raft.queue_time_us":978,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":331,"replication_time_us":5106}]]}
I20260811 06:17:11.593989 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_0ee1f4c875444b0b942b5d5af34212d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.596411 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ee1f4c875444b0b942b5d5af34212d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.596763 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.597608 14025 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 06:17:11.597831 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:11.597994 11601 catalog_manager.cc:4914] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): alter failed for tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]),no further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:11.598179 12726 ts_tablet_manager.cc:1939] T 14a36a644dc4491dad838ce4e19793ab P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.598181 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 8c997501cefd4e6b9e5824e5403dd39b (table default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]) successfully deleted
W20260811 06:17:11.599057 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:11.599045 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 208) took 1313 ms. Trace:
I20260811 06:17:11.599135 12726 rpcz_store.cc:276] 0811 06:17:10.285922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.288070 (+ 2148us) service_pool.cc:227] Handling call
0811 06:17:11.533690 (+1245620us) ts_tablet_manager.cc:1145] Deleting tablet 14a36a644dc4491dad838ce4e19793ab
0811 06:17:11.533707 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.583762 (+ 50055us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.588641 (+ 4879us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.599023 (+ 10382us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244626}
W20260811 06:17:11.599436 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:11.599514 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 224) took 1310 ms. Trace:
I20260811 06:17:11.599586 12726 rpcz_store.cc:276] 0811 06:17:10.289266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.289771 (+ 505us) service_pool.cc:227] Handling call
0811 06:17:11.599386 (+1309615us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:11.599398 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.599496 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309444}
I20260811 06:17:11.599895 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 225) took 1310 ms. Trace:
I20260811 06:17:11.599980 12726 rpcz_store.cc:276] 0811 06:17:10.289921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.289974 (+ 53us) service_pool.cc:227] Handling call
0811 06:17:11.599791 (+1309817us) ts_tablet_manager.cc:1145] Deleting tablet 5e990aa374204f2b95c08b04121176bc
0811 06:17:11.599801 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.599879 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309566}
W20260811 06:17:11.600054 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:11.600266 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 226) took 1309 ms. Trace:
I20260811 06:17:11.600335 12726 rpcz_store.cc:276] 0811 06:17:10.290742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.290802 (+ 60us) service_pool.cc:227] Handling call
0811 06:17:11.600186 (+1309384us) ts_tablet_manager.cc:1145] Deleting tablet ab32f96671984766a54b5ee904c465f7
0811 06:17:11.600195 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.600250 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309140}
I20260811 06:17:11.600580 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 227) took 1309 ms. Trace:
I20260811 06:17:11.600649 12726 rpcz_store.cc:276] 0811 06:17:10.291341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.291394 (+ 53us) service_pool.cc:227] Handling call
0811 06:17:11.600510 (+1309116us) ts_tablet_manager.cc:1145] Deleting tablet a67daf4bdf45464b916905f432f0ec9c
0811 06:17:11.600519 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.600567 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308905}
I20260811 06:17:11.600894 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 228) took 1308 ms. Trace:
I20260811 06:17:11.600970 12726 rpcz_store.cc:276] 0811 06:17:10.292373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.292452 (+ 79us) service_pool.cc:227] Handling call
0811 06:17:11.600824 (+1308372us) ts_tablet_manager.cc:1145] Deleting tablet f9fd17e8c6264f898493c15b0aa5518d
0811 06:17:11.600833 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.600881 (+ 48us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308168}
I20260811 06:17:11.601207 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 229) took 1308 ms. Trace:
W20260811 06:17:11.603616 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c5c3e243e72f4cffb3318246ab428bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5c3e243e72f4cffb3318246ab428bd6 already in progress: creating tablet
I20260811 06:17:11.604657 13983 ts_tablet_manager.cc:1905] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.606628 11365 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.606784 11365 ts_tablet_manager.cc:1397] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.106s user 0.005s sys 0.010s
I20260811 06:17:11.606693 12843 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" instance_seqno: 1786429007072051) as {username='slave'} at 127.9.203.67:55085; Asking this server to re-register.
I20260811 06:17:11.607476 11365 raft_consensus.cc:348] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.607679 11365 raft_consensus.cc:374] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.607735 11365 raft_consensus.cc:729] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.607915 11365 consensus_queue.cc:260] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.608640 11365 ts_tablet_manager.cc:1428] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:11.608892 11365 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.610328 11365 tablet_bootstrap.cc:654] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.601269 12726 rpcz_store.cc:276] 0811 06:17:10.292937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.293322 (+ 385us) service_pool.cc:227] Handling call
0811 06:17:11.601140 (+1307818us) ts_tablet_manager.cc:1145] Deleting tablet 0dab2b8209e5401c84a187882ef21e08
0811 06:17:11.601148 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.601193 (+ 45us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1307603}
I20260811 06:17:11.611316 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 230) took 1317 ms. Trace:
I20260811 06:17:11.611361 11235 heartbeater.cc:464] Registering TS with master...
I20260811 06:17:11.611652 10744 heartbeater.cc:347] Connected to a master server at 127.9.203.124:45045
I20260811 06:17:11.615263 11361 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.615432 11361 ts_tablet_manager.cc:1397] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.123s user 0.001s sys 0.004s
I20260811 06:17:11.616392 11361 raft_consensus.cc:348] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.616606 11361 raft_consensus.cc:374] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.616658 11361 raft_consensus.cc:729] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:11.617277 10813 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.617405 10813 leader_election.cc:302] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.617858 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.618559 12944 raft_consensus.cc:2726] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.620675 12864 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" instance_seqno: 1786429005277287) as {username='slave'} at 127.9.203.65:57333; Asking this server to re-register.
I20260811 06:17:11.611407 12726 rpcz_store.cc:276] 0811 06:17:10.293518 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.294107 (+ 589us) service_pool.cc:227] Handling call
0811 06:17:11.611200 (+1317093us) ts_tablet_manager.cc:1145] Deleting tablet b0cdc826a1d8460aba1aae684c13131d
0811 06:17:11.611211 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.611296 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1316931}
I20260811 06:17:11.621229 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 231) took 1327 ms. Trace:
I20260811 06:17:11.621347 11047 leader_election.cc:302] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:11.621325 12726 rpcz_store.cc:276] 0811 06:17:10.294077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.294141 (+ 64us) service_pool.cc:227] Handling call
0811 06:17:11.621084 (+1326943us) ts_tablet_manager.cc:1145] Deleting tablet 45fc206d95a244e395d19328ae289485
0811 06:17:11.621097 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.621208 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24,"tablet-delete.queue_time_us":1326794}
I20260811 06:17:11.621707 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 233) took 1326 ms. Trace:
I20260811 06:17:11.621953 13738 raft_consensus.cc:2781] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:11.621851 12726 rpcz_store.cc:276] 0811 06:17:10.295596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.295652 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:11.621614 (+1325962us) ts_tablet_manager.cc:1145] Deleting tablet 78d94d27431a4d5e93f1c1ce8c7b6752
0811 06:17:11.621625 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.621691 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325797}
I20260811 06:17:11.622068 13738 raft_consensus.cc:686] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:11.622287 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 232) took 1327 ms. Trace:
I20260811 06:17:11.622282 13738 consensus_queue.cc:237] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.623566 12843 ts_manager.cc:194] Registered new tserver with Master: f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.623700 10744 heartbeater.cc:464] Registering TS with master...
W20260811 06:17:11.626083 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
I20260811 06:17:11.622372 12726 rpcz_store.cc:276] 0811 06:17:10.294825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.295742 (+ 917us) service_pool.cc:227] Handling call
0811 06:17:11.622168 (+1326426us) ts_tablet_manager.cc:1145] Deleting tablet 1f48707b4fb746f49eaaf91b5b81e814
0811 06:17:11.622178 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.622268 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1326235}
I20260811 06:17:11.626778 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 234) took 1330 ms. Trace:
I20260811 06:17:11.626859 12726 rpcz_store.cc:276] 0811 06:17:10.296576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.296718 (+ 142us) service_pool.cc:227] Handling call
0811 06:17:11.626674 (+1329956us) ts_tablet_manager.cc:1145] Deleting tablet 52953438e7c248b1a758ee219405d7da
0811 06:17:11.626684 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.626760 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1329770}
I20260811 06:17:11.627147 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 235) took 1329 ms. Trace:
I20260811 06:17:11.627221 12726 rpcz_store.cc:276] 0811 06:17:10.297320 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.297370 (+ 50us) service_pool.cc:227] Handling call
0811 06:17:11.627064 (+1329694us) ts_tablet_manager.cc:1145] Deleting tablet 45ebef95922f4e7f93533b54c07b7cec
0811 06:17:11.627074 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.627131 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1329526}
I20260811 06:17:11.627481 12726 tablet_replica.cc:330] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:11.627534 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
I20260811 06:17:11.627678 12726 raft_consensus.cc:2229] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.627847 12726 raft_consensus.cc:2258] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.628408 12726 ts_tablet_manager.cc:1905] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:11.629459 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:11.629917 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2fcf7c7a470144c0a084aebc2032d896 because the tablet was not found. No further retry: Not found: Tablet not found: 2fcf7c7a470144c0a084aebc2032d896
I20260811 06:17:11.631376 11361 consensus_queue.cc:260] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.632133 11361 ts_tablet_manager.cc:1428] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260811 06:17:11.632555 11361 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:11.634673 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:11.635176 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
W20260811 06:17:11.636665 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:11.637225 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:11.638209 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because the tablet was not found. No further retry: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:11.639425 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_58a2488cc0fa41369792941575db1367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.640127 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:11.640625 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
W20260811 06:17:11.640969 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58a2488cc0fa41369792941575db1367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.641408 11361 tablet_bootstrap.cc:654] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:11.640975 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because the tablet was not found. No further retry: Not found: Tablet not found: 217f60a1ca044af38f9ee9093e021c27
W20260811 06:17:11.641888 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
W20260811 06:17:11.642256 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because the tablet was not found. No further retry: Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
W20260811 06:17:11.642879 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:11.643224 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:11.643698 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because the tablet was not found. No further retry: Not found: Tablet not found: f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:11.648916 13571 consensus_queue.cc:1035] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:11.650450 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.650496 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.651407 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.651505 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.651832 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.652166 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.652558 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.652930 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.653244 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:11.654866 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca903ee846a4e5baf3dbb4302607c1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.656889 12843 ts_manager.cc:194] Registered new tserver with Master: 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755)
I20260811 06:17:11.658443 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 227bc4fd6cd84e5eb2043c52f95d606d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:52 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.659224 11362 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:11.659346 11362 ts_tablet_manager.cc:1397] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.124s user 0.009s sys 0.001s
I20260811 06:17:11.660061 11362 raft_consensus.cc:348] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.660290 11362 raft_consensus.cc:374] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.660348 11362 raft_consensus.cc:729] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.660542 11362 consensus_queue.cc:260] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.661151 11362 ts_tablet_manager.cc:1428] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:11.661412 11362 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:11.666510 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.666844 12944 raft_consensus.cc:482] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.666966 12944 raft_consensus.cc:504] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:11.667527 12944 leader_election.cc:288] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.667969 13948 raft_consensus.cc:482] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.668114 13948 raft_consensus.cc:504] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.668645 13948 leader_election.cc:288] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.669392 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:11.669662 10663 raft_consensus.cc:2454] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:11.671114 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0813b34919a14a2481857e9f87b217c8" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:11.671763 10813 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.673142 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d90d3d23454c5bbeba1bb900b68c73" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:11.673326 10663 raft_consensus.cc:3037] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:11.673493 10810 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
I20260811 06:17:11.673597 10810 leader_election.cc:302] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.673095 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:11.674031 13571 raft_consensus.cc:2726] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.674597 11676 catalog_manager.cc:5495] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:11.676092 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:11.676733 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.676823 10663 raft_consensus.cc:2454] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:11.677031 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.677210 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.668942 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_fb2139d3ef694b7296f2121a4c5a6920"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:11.685343 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.685671 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 0dab2b8209e5401c84a187882ef21e08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.685915 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.686076 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.686213 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:11.686383 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb2139d3ef694b7296f2121a4c5a6920 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.687217 11365 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.687361 11365 ts_tablet_manager.cc:1397] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
I20260811 06:17:11.687624 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]) successfully deleted
I20260811 06:17:11.687610 12838 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" instance_seqno: 1786429006216023) as {username='slave'} at 127.9.203.66:46359; Asking this server to re-register.
W20260811 06:17:11.687918 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc323cf778548ae86f45f0fd8bd4a89 already in progress: creating tablet
I20260811 06:17:11.688282 11365 raft_consensus.cc:348] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.688504 11365 raft_consensus.cc:374] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.688556 11365 raft_consensus.cc:729] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.689292 11365 consensus_queue.cc:260] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.690026 11365 ts_tablet_manager.cc:1428] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 06:17:11.690363 11365 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.690758 11361 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.690896 11361 ts_tablet_manager.cc:1397] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.003s
I20260811 06:17:11.691644 11361 raft_consensus.cc:348] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.691843 11361 raft_consensus.cc:374] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.691861 11365 tablet_bootstrap.cc:654] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.691901 11361 raft_consensus.cc:729] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.692114 11361 consensus_queue.cc:260] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.697535 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.697834 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.686476 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:11.698892 11046 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:11.699025 11046 leader_election.cc:302] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:11.699705 13740 raft_consensus.cc:2726] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.699879 13740 consensus_queue.cc:1035] T 19e7d97649c94ef3a73a0ea9acc57ab2 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:11.702991 11046 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:11.703114 11046 leader_election.cc:302] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:11.703540 13740 raft_consensus.cc:2726] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.705103 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:11.705179 10564 leader_election.cc:341] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.705305 10564 leader_election.cc:302] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.705528 13948 raft_consensus.cc:2726] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.705772 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 14a36a644dc4491dad838ce4e19793ab (table default.Table_4e15808f30a44360b496919b3bc6c412 [id=4968af03a1a142288a30bac3f6ac9154]) successfully deleted
W20260811 06:17:11.706295 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
W20260811 06:17:11.706574 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
W20260811 06:17:11.706856 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ab32f96671984766a54b5ee904c465f7 because the tablet was not found. No further retry: Not found: Tablet not found: ab32f96671984766a54b5ee904c465f7
W20260811 06:17:11.707140 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a67daf4bdf45464b916905f432f0ec9c because the tablet was not found. No further retry: Not found: Tablet not found: a67daf4bdf45464b916905f432f0ec9c
W20260811 06:17:11.707612 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f9fd17e8c6264f898493c15b0aa5518d because the tablet was not found. No further retry: Not found: Tablet not found: f9fd17e8c6264f898493c15b0aa5518d
W20260811 06:17:11.707903 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because the tablet was not found. No further retry: Not found: Tablet not found: 0dab2b8209e5401c84a187882ef21e08
I20260811 06:17:11.711038 10998 heartbeater.cc:464] Registering TS with master...
I20260811 06:17:11.712705 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_4013a762d62b4bdcb6b48f3959d92274"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:11.716864 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:11.719702 11361 ts_tablet_manager.cc:1428] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
W20260811 06:17:11.720283 10813 consensus_peers.cc:487] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:11.720858 10555 leader_election.cc:341] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.722587 11362 tablet_bootstrap.cc:654] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.727360 11361 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.728796 12726 ts_tablet_manager.cc:1918] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.728876 11361 tablet_bootstrap.cc:654] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.728950 12726 log.cc:1196] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:11.729298 12726 ts_tablet_manager.cc:1939] T 05867781f7954fb280cc83b2a13d0d61 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:11.729816 10564 leader_election.cc:341] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.730319 10564 leader_election.cc:302] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.731871 13948 raft_consensus.cc:2726] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:11.732725 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4013a762d62b4bdcb6b48f3959d92274 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.733489 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:11.736235 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b0cdc826a1d8460aba1aae684c13131d because the tablet was not found. No further retry: Not found: Tablet not found: b0cdc826a1d8460aba1aae684c13131d
W20260811 06:17:11.736613 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:11.736972 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because the tablet was not found. No further retry: Not found: Tablet not found: 78d94d27431a4d5e93f1c1ce8c7b6752
W20260811 06:17:11.737283 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:11.737598 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 52953438e7c248b1a758ee219405d7da because the tablet was not found. No further retry: Not found: Tablet not found: 52953438e7c248b1a758ee219405d7da
W20260811 06:17:11.737890 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45ebef95922f4e7f93533b54c07b7cec because the tablet was not found. No further retry: Not found: Tablet not found: 45ebef95922f4e7f93533b54c07b7cec
I20260811 06:17:11.738142 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.739250 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48 (DEFAULT_TABLE table=default.Table_4ebccfdb6d154b9d95edf80cda05f0a0 [id=aba157e14b8b4226a4ec4e6ca7b5e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.739708 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.739898 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:11.740895 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_bc9f6672cc9c4af8b3c2a586982a446a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.741696 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc9f6672cc9c4af8b3c2a586982a446a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.741948 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48 (DEFAULT_TABLE table=default.Table_4ebccfdb6d154b9d95edf80cda05f0a0 [id=aba157e14b8b4226a4ec4e6ca7b5e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.741989 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 82c61b7270e84f4ba4b225e3629d9105 (DEFAULT_TABLE table=default.Table_074fc2ccf40d49e380e37ad5842cd459 [id=e1b58e46dbac443c88c71548307f1a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.742336 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c61b7270e84f4ba4b225e3629d9105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.730111 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 236) took 1431 ms. Trace:
I20260811 06:17:11.746754 12726 rpcz_store.cc:276] 0811 06:17:10.298411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.298537 (+ 126us) service_pool.cc:227] Handling call
0811 06:17:11.627436 (+1328899us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:17:11.627445 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.657527 (+ 30082us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.728678 (+ 71151us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.730094 (+ 1416us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1328670}
I20260811 06:17:11.747226 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 237) took 1448 ms. Trace:
I20260811 06:17:11.747315 12726 rpcz_store.cc:276] 0811 06:17:10.299282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.299348 (+ 66us) service_pool.cc:227] Handling call
0811 06:17:11.747102 (+1447754us) ts_tablet_manager.cc:1145] Deleting tablet 5ca903ee846a4e5baf3dbb4302607c1f
0811 06:17:11.747117 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.747209 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447526}
I20260811 06:17:11.747563 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 239) took 1447 ms. Trace:
I20260811 06:17:11.747628 12726 rpcz_store.cc:276] 0811 06:17:10.300420 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.300475 (+ 55us) service_pool.cc:227] Handling call
0811 06:17:11.747497 (+1447022us) ts_tablet_manager.cc:1145] Deleting tablet a1981dc26be24ec5afaa3c0bb5c46c8c
0811 06:17:11.747506 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.747552 (+ 46us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446835}
I20260811 06:17:11.747817 12726 tablet_replica.cc:330] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.748006 12726 raft_consensus.cc:2229] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.748157 12726 raft_consensus.cc:2258] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.748682 12726 ts_tablet_manager.cc:1905] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.753995 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:11.754313 10564 leader_election.cc:341] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:11.754551 10564 leader_election.cc:302] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:11.754809 13948 raft_consensus.cc:2726] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:11.755752 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 05867781f7954fb280cc83b2a13d0d61 (table default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]) successfully deleted
W20260811 06:17:11.756165 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because the tablet was not found. No further retry: Not found: Tablet not found: 5ca903ee846a4e5baf3dbb4302607c1f
I20260811 06:17:11.756215 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48 (DEFAULT_TABLE table=default.Table_4ebccfdb6d154b9d95edf80cda05f0a0 [id=aba157e14b8b4226a4ec4e6ca7b5e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:17:11.756559 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because the tablet was not found. No further retry: Not found: Tablet not found: a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:11.756681 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a0594a33ea84ac2ad3a1dd33b9e6d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.758857 12864 ts_manager.cc:194] Registered new tserver with Master: 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:11.762869 12726 ts_tablet_manager.cc:1918] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.763006 12726 log.cc:1196] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:11.763280 12726 ts_tablet_manager.cc:1939] T 8741294bc33e454a9c4ef1717ccef80f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.766534 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 82c61b7270e84f4ba4b225e3629d9105 (DEFAULT_TABLE table=default.Table_074fc2ccf40d49e380e37ad5842cd459 [id=e1b58e46dbac443c88c71548307f1a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.767015 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c61b7270e84f4ba4b225e3629d9105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.767269 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_e747fbaa33fe45919e9a98d164e35ec0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:11.768126 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 238) took 1467 ms. Trace:
W20260811 06:17:11.768337 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e747fbaa33fe45919e9a98d164e35ec0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.768241 12726 rpcz_store.cc:276] 0811 06:17:10.300297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.300490 (+ 193us) service_pool.cc:227] Handling call
0811 06:17:11.747778 (+1447288us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:17:11.747786 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.758261 (+ 10475us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.762785 (+ 4524us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.768097 (+ 5312us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446622}
I20260811 06:17:11.768596 12726 tablet_replica.cc:330] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.768826 12726 raft_consensus.cc:2229] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.769017 12726 raft_consensus.cc:2258] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.769609 12726 ts_tablet_manager.cc:1905] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.770922 10867 tablet_service.cc:1467] Processing CreateTablet for tablet d09f083839bf49c3adb3685daa44255e (DEFAULT_TABLE table=default.Table_f8c48033535b4dd8b57f15cf3226a694 [id=2dfdbc4dfabd4aeea775a442fb12ca45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.771371 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f083839bf49c3adb3685daa44255e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.773742 10871 tablet_service.cc:1467] Processing CreateTablet for tablet a3b18ef2160041aaad0d54dc8a414b8f (DEFAULT_TABLE table=default.Table_b88946419495411893f36709d4fc89a0 [id=6950184698ea4e4aba0c0923135fdbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.774279 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b18ef2160041aaad0d54dc8a414b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.775852 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 314a569c95414c04b8b505ca471caa6b (DEFAULT_TABLE table=default.Table_3904756a25ec4d7fa60a32a772b51c40 [id=cd08e0906d304862a077396fea8fa752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.776291 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 69eb9349f9db42daac5bf0114dce7190 (DEFAULT_TABLE table=default.Table_da057f3b5778478693bfc55ec32d45ba [id=8d0a96f8078f49d38d109d8c5840438e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.776619 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69eb9349f9db42daac5bf0114dce7190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.777125 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_54c41581e5074a0288d05734e120740a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:11.778951 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 69eb9349f9db42daac5bf0114dce7190 (DEFAULT_TABLE table=default.Table_da057f3b5778478693bfc55ec32d45ba [id=8d0a96f8078f49d38d109d8c5840438e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.779387 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69eb9349f9db42daac5bf0114dce7190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.781307 11365 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.781523 11365 ts_tablet_manager.cc:1397] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.003s
I20260811 06:17:11.782114 11098 tablet_service.cc:1467] Processing CreateTablet for tablet a3b18ef2160041aaad0d54dc8a414b8f (DEFAULT_TABLE table=default.Table_b88946419495411893f36709d4fc89a0 [id=6950184698ea4e4aba0c0923135fdbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.782500 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b18ef2160041aaad0d54dc8a414b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.782811 11365 raft_consensus.cc:348] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.783084 11365 raft_consensus.cc:374] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.783185 11365 raft_consensus.cc:729] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.783450 11365 consensus_queue.cc:260] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.784194 11365 ts_tablet_manager.cc:1428] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:11.784642 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314a569c95414c04b8b505ca471caa6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:11.784890 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54c41581e5074a0288d05734e120740a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.784940 12726 ts_tablet_manager.cc:1918] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.785036 12726 log.cc:1196] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:11.785317 12726 ts_tablet_manager.cc:1939] T ae1118c96cff4ea387f3d0ee94bef79b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.787135 13983 ts_tablet_manager.cc:1918] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.789820 11365 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.790014 13983 log.cc:1196] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/91f079882c3c46318f70190d5293868e
I20260811 06:17:11.792237 11365 tablet_bootstrap.cc:654] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.794348 12726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36594 (request call id 212) took 1508 ms. Trace:
I20260811 06:17:11.794456 12726 rpcz_store.cc:276] 0811 06:17:10.286307 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.309244 (+ 22937us) service_pool.cc:227] Handling call
0811 06:17:11.768541 (+1459297us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:17:11.768554 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:11.781407 (+ 12853us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.784836 (+ 3429us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:11.794323 (+ 9487us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459033}
I20260811 06:17:11.794785 12726 tablet_replica.cc:330] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.794993 12726 raft_consensus.cc:2229] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.795128 12726 raft_consensus.cc:2258] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.795639 12726 ts_tablet_manager.cc:1905] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.802074 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 8741294bc33e454a9c4ef1717ccef80f (table default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]) successfully deleted
I20260811 06:17:11.802991 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 82c61b7270e84f4ba4b225e3629d9105 (DEFAULT_TABLE table=default.Table_074fc2ccf40d49e380e37ad5842cd459 [id=e1b58e46dbac443c88c71548307f1a3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.803310 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet ae1118c96cff4ea387f3d0ee94bef79b (table default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]) successfully deleted
I20260811 06:17:11.803272 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 314a569c95414c04b8b505ca471caa6b (DEFAULT_TABLE table=default.Table_3904756a25ec4d7fa60a32a772b51c40 [id=cd08e0906d304862a077396fea8fa752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.803434 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c61b7270e84f4ba4b225e3629d9105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.803642 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314a569c95414c04b8b505ca471caa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.803938 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 69eb9349f9db42daac5bf0114dce7190 (DEFAULT_TABLE table=default.Table_da057f3b5778478693bfc55ec32d45ba [id=8d0a96f8078f49d38d109d8c5840438e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.804251 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69eb9349f9db42daac5bf0114dce7190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.805987 10610 tablet_service.cc:1467] Processing CreateTablet for tablet d09f083839bf49c3adb3685daa44255e (DEFAULT_TABLE table=default.Table_f8c48033535b4dd8b57f15cf3226a694 [id=2dfdbc4dfabd4aeea775a442fb12ca45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.806362 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f083839bf49c3adb3685daa44255e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.815094 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 314a569c95414c04b8b505ca471caa6b (DEFAULT_TABLE table=default.Table_3904756a25ec4d7fa60a32a772b51c40 [id=cd08e0906d304862a077396fea8fa752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.817040 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314a569c95414c04b8b505ca471caa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.815886 13571 consensus_queue.cc:1035] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260811 06:17:11.817289 11103 tablet_service.cc:1467] Processing CreateTablet for tablet d09f083839bf49c3adb3685daa44255e (DEFAULT_TABLE table=default.Table_f8c48033535b4dd8b57f15cf3226a694 [id=2dfdbc4dfabd4aeea775a442fb12ca45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.790441 13983 ts_tablet_manager.cc:1939] T 91f079882c3c46318f70190d5293868e P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:11.822075 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f083839bf49c3adb3685daa44255e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.822507 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]) successfully deleted
I20260811 06:17:11.828302 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:11.833576 11365 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.833771 11365 ts_tablet_manager.cc:1397] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.000s
I20260811 06:17:11.834669 12726 ts_tablet_manager.cc:1918] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.834781 11365 raft_consensus.cc:348] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.835005 11365 raft_consensus.cc:374] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.835592 11365 raft_consensus.cc:729] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.835837 11365 consensus_queue.cc:260] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.836541 11365 ts_tablet_manager.cc:1428] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:11.836803 11365 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.834792 12726 log.cc:1196] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:11.838330 12726 ts_tablet_manager.cc:1939] T 1a2e55d5e0244c299d837aed98f94aad P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.840046 12726 tablet_replica.cc:330] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.840255 12726 raft_consensus.cc:2229] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:11.840961 12726 raft_consensus.cc:2258] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.842573 12726 ts_tablet_manager.cc:1905] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.844941 11103 tablet_service.cc:1467] Processing CreateTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 (DEFAULT_TABLE table=default.Table_7f4c4be1ee2342f4858a10f9067b541e [id=c7064eecafc94d908e972280c99b7990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.845427 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcfab8bff5bd4a6cb7ea85dae3a48888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:11.829298 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 516e3c37321f4c7b9f3373164682a0ff already in progress: creating tablet
I20260811 06:17:11.850209 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:11.839578 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]) successfully deleted
I20260811 06:17:11.850617 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:11.851073 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
W20260811 06:17:11.851815 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a183d0915a5a48c2a26994d47f6fe266 already in progress: creating tablet
I20260811 06:17:11.852180 10613 tablet_service.cc:1467] Processing CreateTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 (DEFAULT_TABLE table=default.Table_7f4c4be1ee2342f4858a10f9067b541e [id=c7064eecafc94d908e972280c99b7990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.852634 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcfab8bff5bd4a6cb7ea85dae3a48888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:11.853207 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d4d44dea35e94ed788b7e1e5a8a24d8e because the tablet was not found. No further retry: Not found: Tablet not found: d4d44dea35e94ed788b7e1e5a8a24d8e
W20260811 06:17:11.853582 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8741294bc33e454a9c4ef1717ccef80f already in progress: creating tablet
W20260811 06:17:11.854038 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae1118c96cff4ea387f3d0ee94bef79b already in progress: creating tablet
W20260811 06:17:11.854676 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e329d808c59c4f66bbc515d751255e96 already in progress: creating tablet
W20260811 06:17:11.855036 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 52ecffcf4a0e46428caed6f7d72199bd because the tablet was not found. No further retry: Not found: Tablet not found: 52ecffcf4a0e46428caed6f7d72199bd
W20260811 06:17:11.855456 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a1981dc26be24ec5afaa3c0bb5c46c8c because the tablet was not found. No further retry: Not found: Tablet not found: a1981dc26be24ec5afaa3c0bb5c46c8c
I20260811 06:17:11.856305 10610 tablet_service.cc:1467] Processing CreateTablet for tablet a3b18ef2160041aaad0d54dc8a414b8f (DEFAULT_TABLE table=default.Table_b88946419495411893f36709d4fc89a0 [id=6950184698ea4e4aba0c0923135fdbe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.856873 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_1e647362a1ce49cdbb427dbbbd25e3cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:11.857231 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3b18ef2160041aaad0d54dc8a414b8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:11.857668 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e647362a1ce49cdbb427dbbbd25e3cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.858206 11362 tablet_bootstrap.cc:492] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:11.860599 11361 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.860752 11361 ts_tablet_manager.cc:1397] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.133s user 0.001s sys 0.006s
I20260811 06:17:11.861569 11361 raft_consensus.cc:348] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.861820 11361 raft_consensus.cc:374] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.861873 11361 raft_consensus.cc:729] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.862740 10860 tablet_service.cc:1467] Processing CreateTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 (DEFAULT_TABLE table=default.Table_7f4c4be1ee2342f4858a10f9067b541e [id=c7064eecafc94d908e972280c99b7990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.864308 11119 tablet_service.cc:1467] Processing CreateTablet for tablet d7c3505a956b4a7aa36b7a4f60701a24 (DEFAULT_TABLE table=default.Table_e2fc0d1ac1ad4323b928a7981dc924ef [id=b3b5d9e17c8a43e08e556dcbb2506a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.864679 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c3505a956b4a7aa36b7a4f60701a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.865514 11362 ts_tablet_manager.cc:1397] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.000s
I20260811 06:17:11.866412 10623 tablet_service.cc:1467] Processing CreateTablet for tablet d7c3505a956b4a7aa36b7a4f60701a24 (DEFAULT_TABLE table=default.Table_e2fc0d1ac1ad4323b928a7981dc924ef [id=b3b5d9e17c8a43e08e556dcbb2506a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.866477 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 4efe31efef564fd7a61aaba3ad6ba7d1 (DEFAULT_TABLE table=default.Table_b1b7c4426f9a4326a2c5e6656099762d [id=75e49f05f7f64062943087aba81671e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.866417 11362 raft_consensus.cc:348] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.866691 11362 raft_consensus.cc:374] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.866760 11362 raft_consensus.cc:729] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.866824 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efe31efef564fd7a61aaba3ad6ba7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.866832 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c3505a956b4a7aa36b7a4f60701a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.866961 11362 consensus_queue.cc:260] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.867573 11362 ts_tablet_manager.cc:1428] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:11.870389 10872 tablet_service.cc:1467] Processing CreateTablet for tablet d7c3505a956b4a7aa36b7a4f60701a24 (DEFAULT_TABLE table=default.Table_e2fc0d1ac1ad4323b928a7981dc924ef [id=b3b5d9e17c8a43e08e556dcbb2506a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.871050 11365 tablet_bootstrap.cc:654] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.879680 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7c3505a956b4a7aa36b7a4f60701a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.882131 11362 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:11.882628 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_84f114df1d1c48bea906f941dd150e5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.883529 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84f114df1d1c48bea906f941dd150e5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.883824 11362 tablet_bootstrap.cc:654] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.887508 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcfab8bff5bd4a6cb7ea85dae3a48888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.891561 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 4efe31efef564fd7a61aaba3ad6ba7d1 (DEFAULT_TABLE table=default.Table_b1b7c4426f9a4326a2c5e6656099762d [id=75e49f05f7f64062943087aba81671e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.892015 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efe31efef564fd7a61aaba3ad6ba7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.890692 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_443a5cc509444e14a1cc048dca1e2e44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:11.893438 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_443a5cc509444e14a1cc048dca1e2e44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:11.902544 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 (DEFAULT_TABLE table=default.Table_1796e17e33e24c69bbf95e8514e84395 [id=4346380965984e0ba8b007b4ddf393a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.903057 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4d1035d5b0435a8a3611e5e15c1547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.904306 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 (DEFAULT_TABLE table=default.Table_1796e17e33e24c69bbf95e8514e84395 [id=4346380965984e0ba8b007b4ddf393a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.904695 11361 consensus_queue.cc:260] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.852443 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
I20260811 06:17:11.911345 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 22feadfa433d46cc9f5dc052b3421e56 (table default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3]). Expected version 2 got 0
I20260811 06:17:11.911751 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:11.912772 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:11.916193 12944 consensus_queue.cc:1035] T 3410afec34ae469d9a07cc9d16cf082c P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:11.917671 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4d1035d5b0435a8a3611e5e15c1547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.922602 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:11.923596 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:11.924724 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5797f3ba59924b41b92fbd089397218e (table default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86]). Expected version 1 got 0
I20260811 06:17:11.926719 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:11.928519 11361 ts_tablet_manager.cc:1428] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260811 06:17:11.928562 12944 raft_consensus.cc:482] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:11.928699 12944 raft_consensus.cc:504] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.929420 12944 leader_election.cc:288] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.930544 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:11.930688 12726 ts_tablet_manager.cc:1918] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:11.930851 12726 log.cc:1196] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:11.931234 12726 ts_tablet_manager.cc:1939] T 61114d1bcdb94af7b6c55b0331accee5 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.931838 11361 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:11.932268 12726 tablet_replica.cc:330] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.932765 12726 raft_consensus.cc:2229] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.932936 12726 raft_consensus.cc:2258] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.933147 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:11.933377 10663 raft_consensus.cc:2454] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:11.933506 12726 ts_tablet_manager.cc:1905] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.933894 11361 tablet_bootstrap.cc:654] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.934527 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:11.934738 11159 raft_consensus.cc:2454] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:11.935081 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:11.937543 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 (DEFAULT_TABLE table=default.Table_1796e17e33e24c69bbf95e8514e84395 [id=4346380965984e0ba8b007b4ddf393a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.936890 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]) successfully deleted
I20260811 06:17:11.938959 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:11.939587 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 60c3a381b6744b8d989d644f2b643958 (DEFAULT_TABLE table=default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.939997 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c3a381b6744b8d989d644f2b643958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.946915 11365 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.947067 11365 ts_tablet_manager.cc:1397] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.110s user 0.007s sys 0.004s
I20260811 06:17:11.947242 10810 leader_election.cc:302] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:11.947636 12944 raft_consensus.cc:2781] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:11.947721 12944 raft_consensus.cc:482] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:11.947786 12944 raft_consensus.cc:3037] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.948027 11365 raft_consensus.cc:348] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.948228 11365 raft_consensus.cc:374] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.948276 11365 raft_consensus.cc:729] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.948462 11365 consensus_queue.cc:260] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.949026 11365 ts_tablet_manager.cc:1428] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:11.949295 11365 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:11.949477 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (DEFAULT_TABLE table=default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.949935 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.954514 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (DEFAULT_TABLE table=default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.954631 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 7b815bc117cf46db8250f33e5fec861d (DEFAULT_TABLE table=default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.955001 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.955194 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b815bc117cf46db8250f33e5fec861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.958673 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 4efe31efef564fd7a61aaba3ad6ba7d1 (DEFAULT_TABLE table=default.Table_b1b7c4426f9a4326a2c5e6656099762d [id=75e49f05f7f64062943087aba81671e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.959100 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4efe31efef564fd7a61aaba3ad6ba7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.959712 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4d1035d5b0435a8a3611e5e15c1547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.960865 11365 tablet_bootstrap.cc:654] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:11.967908 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 7b815bc117cf46db8250f33e5fec861d (DEFAULT_TABLE table=default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.968334 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b815bc117cf46db8250f33e5fec861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.969913 12726 ts_tablet_manager.cc:1918] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:11.970042 12726 log.cc:1196] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/91f079882c3c46318f70190d5293868e
I20260811 06:17:11.970388 12726 ts_tablet_manager.cc:1939] T 91f079882c3c46318f70190d5293868e P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:11.971383 12726 tablet_replica.cc:330] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:11.971688 12726 raft_consensus.cc:2229] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:11.971863 12726 raft_consensus.cc:2258] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:11.972287 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 60c3a381b6744b8d989d644f2b643958 (DEFAULT_TABLE table=default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:11.972685 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c3a381b6744b8d989d644f2b643958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:11.971871 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 91f079882c3c46318f70190d5293868e (table default.Table_d27b07ecce6448f09fb6ec0051be431c [id=4fc37a54ea874c138c32769644dbc40c]) successfully deleted
W20260811 06:17:11.981171 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc323cf778548ae86f45f0fd8bd4a89 already in progress: creating tablet
W20260811 06:17:11.984061 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 585f92fc5b3d41bd97df525380fcab9f already in progress: creating tablet
I20260811 06:17:11.984247 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:11.984419 11361 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:11.984539 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:11.984584 11361 ts_tablet_manager.cc:1397] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20260811 06:17:11.984766 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
W20260811 06:17:11.984792 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035eee1d37c94471a7cd697fb0fbb951 already in progress: creating tablet
I20260811 06:17:11.984934 12726 ts_tablet_manager.cc:1905] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:11.985145 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:11.985323 11361 raft_consensus.cc:348] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.985548 11361 raft_consensus.cc:374] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.985605 11361 raft_consensus.cc:729] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:11.985509 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2cae52ba275f4d2fbd7014a1c6c01dc0 because the tablet was not found. No further retry: Not found: Tablet not found: 2cae52ba275f4d2fbd7014a1c6c01dc0
I20260811 06:17:11.985831 11361 consensus_queue.cc:260] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.986366 11361 ts_tablet_manager.cc:1428] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 06:17:11.986372 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2fcf7c7a470144c0a084aebc2032d896 because the tablet was not found. No further retry: Not found: Tablet not found: 2fcf7c7a470144c0a084aebc2032d896
W20260811 06:17:11.986783 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:11.988977 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:11.992409 11365 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:11.992540 11365 ts_tablet_manager.cc:1397] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260811 06:17:11.991060 12944 raft_consensus.cc:504] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.996762 12944 leader_election.cc:288] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:11.997659 11365 raft_consensus.cc:348] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.997973 11365 raft_consensus.cc:374] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:11.998092 11365 raft_consensus.cc:729] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:11.998104 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:11.998327 10663 raft_consensus.cc:3037] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:11.998451 11365 consensus_queue.cc:260] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:11.999109 11365 ts_tablet_manager.cc:1428] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:11.999421 11365 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.001817 11361 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.003410 11361 tablet_bootstrap.cc:654] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.001297 10663 raft_consensus.cc:2454] T 4ef97b47809940f4bfee89cc0515edcf P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:12.006574 10810 leader_election.cc:302] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:12.006923 12944 raft_consensus.cc:2781] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.007054 12944 raft_consensus.cc:686] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:12.007259 12944 consensus_queue.cc:237] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.007795 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:12.009625 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet a183d0915a5a48c2a26994d47f6fe266 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.010892 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 61671753b0964b3987bd3f33226857b7 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.011281 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ef97b47809940f4bfee89cc0515edcf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:12.011485 11157 raft_consensus.cc:3037] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.014504 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 60c3a381b6744b8d989d644f2b643958 (DEFAULT_TABLE table=default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.018471 13740 raft_consensus.cc:482] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.018643 13740 raft_consensus.cc:504] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.019261 13740 leader_election.cc:288] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.021060 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.021288 10663 raft_consensus.cc:2454] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:12.021759 11046 leader_election.cc:302] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:12.022053 13740 raft_consensus.cc:2781] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.022286 13740 raft_consensus.cc:482] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.022358 13740 raft_consensus.cc:3037] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.022753 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c3a381b6744b8d989d644f2b643958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.023098 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (DEFAULT_TABLE table=default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.023605 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.028940 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.031144 11047 leader_election.cc:341] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.031194 13740 raft_consensus.cc:504] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.031842 13740 leader_election.cc:288] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.032999 13983 tablet_replica.cc:330] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.033234 13983 raft_consensus.cc:2229] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.033399 13983 raft_consensus.cc:2258] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.034022 13983 ts_tablet_manager.cc:1905] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.034861 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 7b815bc117cf46db8250f33e5fec861d (DEFAULT_TABLE table=default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.035243 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b815bc117cf46db8250f33e5fec861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.041246 11157 raft_consensus.cc:2454] T 4ef97b47809940f4bfee89cc0515edcf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:11.985699 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:12.042659 13983 ts_tablet_manager.cc:1918] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.042856 13983 log.cc:1196] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/8b282afe70184b0fb68d0e7cdcbcd2b7
I20260811 06:17:12.043030 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:12.044186 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:12.044499 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:12.043524 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:12.044991 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
W20260811 06:17:12.045432 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
W20260811 06:17:12.046178 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 532208d7a02d448e8dac702ffe6c2ffc because the tablet was not found. No further retry: Not found: Tablet not found: 532208d7a02d448e8dac702ffe6c2ffc
W20260811 06:17:12.047011 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:12.048291 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:12.048599 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f4f14a0add084048b92a501476ad6588 because the tablet was not found. No further retry: Not found: Tablet not found: f4f14a0add084048b92a501476ad6588
I20260811 06:17:12.046749 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:12.050037 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2fb02f61b67147f793b3a2f063d8c56c (table default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85]). Expected version 1 got 0
I20260811 06:17:12.050328 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5a17ccd48c8c460cb7ff59abf7ea19d9 (table default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63]). Expected version 2 got 0
I20260811 06:17:12.050889 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:12.051224 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:12.051656 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:12.051924 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
W20260811 06:17:12.051960 11047 leader_election.cc:341] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.052294 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
I20260811 06:17:12.052656 11679 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:12.053396 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 814b7a212b164b4f8551ece59f57fafd
W20260811 06:17:12.053452 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab consensus state has no leader
I20260811 06:17:12.053635 11655 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 107) took 1400 ms. Trace:
I20260811 06:17:12.053959 11683 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 106) took 1572 ms. Trace:
I20260811 06:17:12.053767 11655 rpcz_store.cc:276] 0811 06:17:10.653049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.590324 (+937275us) service_pool.cc:227] Handling call
0811 06:17:11.590855 (+ 531us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.591057 (+ 202us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:11.592008 (+ 951us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:11.592092 (+ 84us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:11.633830 (+ 41738us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:12.053587 (+419757us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.592594 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.592688 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.592694 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.592696 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.592848 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.592860 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.592865 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.592933 (+ 68us) tablet.cc:699] Row locks acquired
0811 06:17:11.592936 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.592971 (+ 35us) write_op.cc:270] Start()
0811 06:17:11.593006 (+ 35us) write_op.cc:276] Timestamp: P: 1786429031592930 usec, L: 0
0811 06:17:11.593010 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.593260 (+ 250us) log.cc:842] Serialized 405 byte log entry
0811 06:17:11.613373 (+ 20113us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.613527 (+ 154us) write_op.cc:301] APPLY: starting
0811 06:17:11.613544 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.613589 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.613616 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.613671 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.613707 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.613736 (+ 29us) write_op.cc:312] APPLY: finished
0811 06:17:11.613823 (+ 87us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.613895 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.613914 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:11.613921 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.613983 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.613988 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":518,"num_ops":1,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":747,"prepare.run_wall_time_us":748,"replication_time_us":20337}]]}
I20260811 06:17:12.054072 11683 rpcz_store.cc:276] 0811 06:17:10.481592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.574029 (+1092437us) service_pool.cc:227] Handling call
0811 06:17:11.578294 (+ 4265us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.578829 (+ 535us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:11.579088 (+ 259us) catalog_manager.cc:2761] Locking tablets
0811 06:17:11.669822 (+ 90734us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:11.679024 (+ 9202us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:11.679119 (+ 95us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:12.053340 (+374221us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:12.053876 (+ 536us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.670477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.670585 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.670592 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.670594 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.670703 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.670714 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.670719 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.670813 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:11.670816 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.670855 (+ 39us) write_op.cc:270] Start()
0811 06:17:11.670886 (+ 31us) write_op.cc:276] Timestamp: P: 1786429031670806 usec, L: 0
0811 06:17:11.670889 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.671069 (+ 180us) log.cc:842] Serialized 728 byte log entry
0811 06:17:11.677207 (+ 6138us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.677297 (+ 90us) write_op.cc:301] APPLY: starting
0811 06:17:11.677311 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.677379 (+ 68us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.677415 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.677487 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.677522 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:11.677527 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:11.677604 (+ 77us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.677677 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.677698 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:11.677704 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.677786 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.677789 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":48,"apply.run_cpu_time_us":541,"apply.run_wall_time_us":540,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":663,"prepare.run_wall_time_us":1016,"replication_time_us":6297}]]}
I20260811 06:17:12.054749 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d27b07ecce6448f09fb6ec0051be431c" } new_table_name: "default.Table_826e7e8816374e1fa8267fa3a90704c9" modify_external_catalogs: true
I20260811 06:17:12.054841 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ae32a31bc8f64e96a549037c0d65f64e" } modify_external_catalogs: true
I20260811 06:17:12.055069 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_ae32a31bc8f64e96a549037c0d65f64e" } modify_external_catalogs: true
W20260811 06:17:12.055688 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4124f64656614c91b7d9115c2efbecd1 consensus state has no leader
I20260811 06:17:12.055877 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 104) took 1952 ms. Trace:
I20260811 06:17:12.055970 11684 rpcz_store.cc:276] 0811 06:17:10.103355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.556470 (+1453115us) service_pool.cc:227] Handling call
0811 06:17:11.557185 (+ 715us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.557368 (+ 183us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:11.557597 (+ 229us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:11.557680 (+ 83us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:11.668066 (+110386us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:12.055820 (+387754us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.661407 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.661552 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.661559 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.661561 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.661692 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.661708 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.661735 (+ 27us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.661813 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:11.661815 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.661863 (+ 48us) write_op.cc:270] Start()
0811 06:17:11.661902 (+ 39us) write_op.cc:276] Timestamp: P: 1786429031661812 usec, L: 0
0811 06:17:11.661906 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.662127 (+ 221us) log.cc:842] Serialized 405 byte log entry
0811 06:17:11.666663 (+ 4536us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.666771 (+ 108us) write_op.cc:301] APPLY: starting
0811 06:17:11.666788 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.666835 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.666874 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.666938 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.666973 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.666980 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.667062 (+ 82us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.667125 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.667147 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:11.667154 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.667215 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.667218 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":510,"num_ops":1,"prepare.queue_time_us":736,"prepare.run_cpu_time_us":858,"prepare.run_wall_time_us":1356,"raft.queue_time_us":40,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":427,"replication_time_us":4732}]]}
I20260811 06:17:12.056813 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e10cdfa6b7f143c7a53cc6405f3e93dd" } new_table_name: "default.Table_f4976af097324949ac059ce0cab288b4" modify_external_catalogs: true
I20260811 06:17:12.056849 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.057505 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.057916 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:12.058414 11672 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 100) took 2083 ms. Trace:
I20260811 06:17:12.058547 11672 rpcz_store.cc:276] 0811 06:17:09.974453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.324926 (+1350473us) service_pool.cc:227] Handling call
0811 06:17:11.330222 (+ 5296us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.330391 (+ 169us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:11.330458 (+ 67us) catalog_manager.cc:2761] Locking tablets
0811 06:17:11.666336 (+335878us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:11.673557 (+ 7221us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:11.673634 (+ 77us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:12.057858 (+384224us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:12.058350 (+ 492us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.667186 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.667302 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.667307 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:11.667320 (+ 13us) tablet.cc:660] Decoding operations
0811 06:17:11.667450 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.667464 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.667469 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.667588 (+ 119us) tablet.cc:699] Row locks acquired
0811 06:17:11.667591 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.667629 (+ 38us) write_op.cc:270] Start()
0811 06:17:11.667659 (+ 30us) write_op.cc:276] Timestamp: P: 1786429031667580 usec, L: 0
0811 06:17:11.667662 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.667843 (+ 181us) log.cc:842] Serialized 728 byte log entry
0811 06:17:11.672910 (+ 5067us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.673007 (+ 97us) write_op.cc:301] APPLY: starting
0811 06:17:11.673022 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.673068 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.673109 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.673190 (+ 81us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.673229 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:11.673235 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.673312 (+ 77us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.673389 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.673409 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:11.673417 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.673475 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.673478 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":518,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":780,"replication_time_us":5226}]]}
I20260811 06:17:12.059343 11672 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_8baf40088898402196034a63aa016e8b" } new_table_name: "default.Table_fa8b97325e9b40c4b82252c1090734da" modify_external_catalogs: true
I20260811 06:17:12.061676 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.062036 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.062458 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_2736666c0c1e402cb4179d3d3c5c39f8 [id=f1e28a412606439d97b23c7a273d94e3] alter complete (version 2)
W20260811 06:17:12.067198 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:12.067662 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3b5bb21784e34ad7addf144e0b10a444 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5bb21784e34ad7addf144e0b10a444 already in progress: creating tablet
I20260811 06:17:12.053678 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:12.068495 11653 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 105) took 1604 ms. Trace:
W20260811 06:17:12.068773 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f50ee875a8e4fa3b5738c9660a46c91 has no consensus state
I20260811 06:17:12.068876 13740 raft_consensus.cc:482] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.069006 13740 raft_consensus.cc:504] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.069623 13740 leader_election.cc:288] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.070133 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.071184 11047 leader_election.cc:341] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.068698 11653 rpcz_store.cc:276] 0811 06:17:10.464285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.569048 (+1104763us) service_pool.cc:227] Handling call
0811 06:17:11.571333 (+ 2285us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:11.572050 (+ 717us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:11.572435 (+ 385us) catalog_manager.cc:2761] Locking tablets
0811 06:17:11.615753 (+ 43318us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:11.636178 (+ 20425us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.636187 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:11.636280 (+ 93us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:11.636518 (+ 238us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:12.053530 (+417012us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:12.068433 (+ 14903us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.616486 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.616593 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.616598 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:11.616601 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.616719 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.616731 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.616736 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:11.616838 (+ 102us) tablet.cc:699] Row locks acquired
0811 06:17:11.616840 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.616877 (+ 37us) write_op.cc:270] Start()
0811 06:17:11.616908 (+ 31us) write_op.cc:276] Timestamp: P: 1786429031616832 usec, L: 0
0811 06:17:11.616911 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.617116 (+ 205us) log.cc:842] Serialized 759 byte log entry
0811 06:17:11.630500 (+ 13384us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.630660 (+ 160us) write_op.cc:301] APPLY: starting
0811 06:17:11.630676 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.630716 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.630764 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.630834 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.630867 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:11.630873 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.630972 (+ 99us) log.cc:842] Serialized 29 byte log entry
0811 06:17:11.631039 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.631061 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:11.631068 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":470,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":696,"prepare.run_wall_time_us":695,"replication_time_us":13561,"spinlock_wait_cycles":25344}]]}
I20260811 06:17:12.071988 11653 master_service.cc:946] ReplaceTablet: received request to replace tablet c2d9627d9f88466ba499aa175151f46a from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.072652 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.073220 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:12.073293 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10211a4e95464e9e9e2b2e70d23086a5 already in progress: creating tablet
W20260811 06:17:12.076610 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 369a031402a24a6a91f0c7ba8a5f288a consensus state has no leader
I20260811 06:17:12.080013 11362 tablet_bootstrap.cc:492] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.080153 11362 ts_tablet_manager.cc:1397] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.198s user 0.009s sys 0.000s
I20260811 06:17:12.081063 11362 raft_consensus.cc:348] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.081342 11362 raft_consensus.cc:374] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.081393 11362 raft_consensus.cc:729] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.081585 11362 consensus_queue.cc:260] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.082150 11362 ts_tablet_manager.cc:1428] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:12.082424 11362 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.084206 11362 tablet_bootstrap.cc:654] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.031781 11365 tablet_bootstrap.cc:654] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.034505 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5c3e243e72f4cffb3318246ab428bd6" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:12.085865 10663 raft_consensus.cc:3037] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.066766 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.043313 13983 ts_tablet_manager.cc:1939] T 8b282afe70184b0fb68d0e7cdcbcd2b7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.070345 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.089320 13983 tablet_replica.cc:330] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.089321 10658 raft_consensus.cc:2454] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:12.089545 13983 raft_consensus.cc:2229] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.070531 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.089691 13983 raft_consensus.cc:2258] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.090430 10663 raft_consensus.cc:2454] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:12.091495 13983 ts_tablet_manager.cc:1905] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.091648 11046 leader_election.cc:302] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.092083 11046 leader_election.cc:302] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.092465 13738 raft_consensus.cc:2781] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.092540 13738 raft_consensus.cc:482] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.092597 13738 raft_consensus.cc:3037] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.095602 13738 raft_consensus.cc:504] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.096310 13738 leader_election.cc:288] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.096469 13738 raft_consensus.cc:2781] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.096880 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:12.097152 13738 raft_consensus.cc:686] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
W20260811 06:17:12.097406 11047 leader_election.cc:341] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.097479 13738 consensus_queue.cc:237] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.098666 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:12.098888 10658 raft_consensus.cc:3037] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.102562 10658 raft_consensus.cc:2454] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:12.103267 11046 leader_election.cc:302] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.103736 13740 raft_consensus.cc:2781] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.103868 13740 raft_consensus.cc:686] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:12.104080 13740 consensus_queue.cc:237] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.105538 12944 raft_consensus.cc:482] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.105703 12944 raft_consensus.cc:504] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.107371 12944 leader_election.cc:288] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:12.079280 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:12.110040 10813 leader_election.cc:341] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:12.111114 11362 tablet_bootstrap.cc:492] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.111346 11362 ts_tablet_manager.cc:1397] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260811 06:17:12.112366 11362 raft_consensus.cc:348] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.112587 11362 raft_consensus.cc:374] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.112651 11362 raft_consensus.cc:729] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.112829 11362 consensus_queue.cc:260] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.113358 11362 ts_tablet_manager.cc:1428] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260811 06:17:12.112594 10810 leader_election.cc:341] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:12.113541 10810 leader_election.cc:302] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.113667 11362 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.114424 13732 raft_consensus.cc:2726] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.115440 11362 tablet_bootstrap.cc:654] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.117200 11365 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.117347 11365 ts_tablet_manager.cc:1397] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.118s user 0.004s sys 0.001s
I20260811 06:17:12.118125 11365 raft_consensus.cc:348] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.118445 11365 raft_consensus.cc:374] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.118520 11365 raft_consensus.cc:729] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.118700 11365 consensus_queue.cc:260] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.119215 11365 ts_tablet_manager.cc:1428] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:12.123749 11655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3904756a25ec4d7fa60a32a772b51c40" } modify_external_catalogs: true
I20260811 06:17:12.124007 11655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3904756a25ec4d7fa60a32a772b51c40" } modify_external_catalogs: true
I20260811 06:17:12.125538 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_03ea575165d8494da39475cc368ffb4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.126169 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03ea575165d8494da39475cc368ffb4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:12.127435 11672 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02bb2819d9cc4880803ef959c131b9ac consensus state has no leader
I20260811 06:17:12.127735 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 (table default.Table_d118a4eb489941a6a06cd47e966d09a4 [id=46f17c64df2d4ef89146fb30cffea20b]) successfully deleted
I20260811 06:17:12.131999 12726 ts_tablet_manager.cc:1918] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.132136 12726 log.cc:1196] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/dc4a4e8bfe3b43aeb0c1617dcb29e685
I20260811 06:17:12.132478 12726 ts_tablet_manager.cc:1939] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:12.135258 11365 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.137126 11365 tablet_bootstrap.cc:654] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.140022 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_fdd68632cc9f41e8943d0a2e509efb44 [id=93a54bf553fa4e01b74b150cc9a1790b] alter complete (version 1)
I20260811 06:17:12.141607 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 2df64ad168f341be899eba30e55b7f44
I20260811 06:17:12.143265 12726 tablet_replica.cc:330] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:12.143486 12726 raft_consensus.cc:2229] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.143646 12726 raft_consensus.cc:2258] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.143739 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (table default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]) successfully deleted
I20260811 06:17:12.144212 12726 ts_tablet_manager.cc:1905] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:12.144273 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because the tablet was not found. No further retry: Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
W20260811 06:17:12.144676 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because the tablet was not found. No further retry: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
W20260811 06:17:12.145001 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 916b91088d7d4024a02214c958c0825b because the tablet was not found. No further retry: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
W20260811 06:17:12.145277 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because the tablet was not found. No further retry: Not found: Tablet not found: 2b0ae9a1d3b74c3985637439819b63ef
W20260811 06:17:12.145634 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because the tablet was not found. No further retry: Not found: Tablet not found: 6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:12.145845 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.147044 11361 tablet_bootstrap.cc:492] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.147181 11361 ts_tablet_manager.cc:1397] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.145s user 0.032s sys 0.033s
I20260811 06:17:12.147378 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.147890 11361 raft_consensus.cc:348] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:12.148048 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
I20260811 06:17:12.148144 11361 raft_consensus.cc:374] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.148196 11361 raft_consensus.cc:729] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.148387 11361 consensus_queue.cc:260] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.148917 11361 ts_tablet_manager.cc:1428] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:12.149194 11361 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.150590 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.152520 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 61671753b0964b3987bd3f33226857b7
I20260811 06:17:12.152905 13983 ts_tablet_manager.cc:1918] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.153035 13983 log.cc:1196] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/0813b34919a14a2481857e9f87b217c8
I20260811 06:17:12.153051 11663 catalog_manager.cc:6565] ReplaceTablet: tablet 61671753b0964b3987bd3f33226857b7 deleted and replaced by tablet 811e63e51151415bb994921facf8db73
I20260811 06:17:12.153391 13983 ts_tablet_manager.cc:1939] T 0813b34919a14a2481857e9f87b217c8 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.154121 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.154336 13983 tablet_replica.cc:330] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.154528 13983 raft_consensus.cc:2229] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:12.154764 13983 pending_rounds.cc:62] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:12.154814 13983 pending_rounds.cc:68] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213307686010880 op_type: NO_OP noop_request { }
I20260811 06:17:12.154937 13983 raft_consensus.cc:2866] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:12.155020 13983 raft_consensus.cc:2258] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:12.155037 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:12.155537 13983 ts_tablet_manager.cc:1905] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.155814 11679 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507] alter complete (version 1)
I20260811 06:17:12.158660 11361 tablet_bootstrap.cc:654] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.159124 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.161803 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 0813b34919a14a2481857e9f87b217c8 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
I20260811 06:17:12.162272 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.163514 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d1fe3a300abc4684b30275587b5bad38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.164433 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1fe3a300abc4684b30275587b5bad38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.165205 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_6f45c201be9b4c2db67d8fa0da996890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.165905 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f45c201be9b4c2db67d8fa0da996890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.171363 11362 tablet_bootstrap.cc:492] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.171518 11362 ts_tablet_manager.cc:1397] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.003s
I20260811 06:17:12.172421 11362 raft_consensus.cc:348] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.172621 11362 raft_consensus.cc:374] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.172660 11362 raft_consensus.cc:729] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.172823 11362 consensus_queue.cc:260] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.173461 11362 ts_tablet_manager.cc:1428] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260811 06:17:12.174429 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:12.175263 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:12.175987 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
I20260811 06:17:12.177561 11653 catalog_manager.cc:6565] ReplaceTablet: tablet c2d9627d9f88466ba499aa175151f46a deleted and replaced by tablet 9f44d4df9df7407890790c80fc71f8cb
I20260811 06:17:12.178357 11361 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.178499 11361 ts_tablet_manager.cc:1397] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260811 06:17:12.178968 13948 raft_consensus.cc:482] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.179106 13948 raft_consensus.cc:504] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.179497 11361 raft_consensus.cc:348] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.179697 11361 raft_consensus.cc:374] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.179760 11361 raft_consensus.cc:729] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.179731 13948 leader_election.cc:288] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.179935 11361 consensus_queue.cc:260] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.180397 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.180543 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.180754 11361 ts_tablet_manager.cc:1428] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 06:17:12.180935 10564 leader_election.cc:341] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.181026 11361 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:12.181413 10555 leader_election.cc:341] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.181511 10555 leader_election.cc:302] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.182303 13948 raft_consensus.cc:2726] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.182816 11361 tablet_bootstrap.cc:654] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.185362 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.188634 11362 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.193262 11365 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.193403 11365 ts_tablet_manager.cc:1397] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.004s
I20260811 06:17:12.194407 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.194469 11365 raft_consensus.cc:348] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.194700 11365 raft_consensus.cc:374] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.194777 11365 raft_consensus.cc:729] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.195060 11365 consensus_queue.cc:260] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.195623 11365 ts_tablet_manager.cc:1428] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:12.195875 11365 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.197095 11684 master_service.cc:946] ReplaceTablet: received request to replace tablet 10211a4e95464e9e9e2b2e70d23086a5 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.198377 11365 tablet_bootstrap.cc:654] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.200448 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_448d0fedf54f4ddead773973ba6320d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:12.201576 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d6cfa0edc19a4324b197f2f3ef57746d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:12.203123 13977 raft_consensus.cc:482] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.203289 13977 raft_consensus.cc:504] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:12.203409 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6cfa0edc19a4324b197f2f3ef57746d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.203867 13977 leader_election.cc:288] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.204988 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.205457 10663 raft_consensus.cc:2454] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:12.205845 11046 leader_election.cc:302] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:12.206094 13282 raft_consensus.cc:2781] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.206166 13282 raft_consensus.cc:482] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.206223 13282 raft_consensus.cc:3037] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:12.208508 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_448d0fedf54f4ddead773973ba6320d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.208940 13282 raft_consensus.cc:504] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.209542 13282 leader_election.cc:288] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.206107 13741 consensus_queue.cc:1035] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260811 06:17:12.210821 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:12.211208 10663 raft_consensus.cc:3037] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.214269 12726 ts_tablet_manager.cc:1918] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.214457 10663 raft_consensus.cc:2454] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:12.214941 11046 leader_election.cc:302] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:12.215235 13977 raft_consensus.cc:2781] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.215342 13977 raft_consensus.cc:686] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:12.215392 11361 tablet_bootstrap.cc:492] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.215500 11361 ts_tablet_manager.cc:1397] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260811 06:17:12.215586 13977 consensus_queue.cc:237] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.216502 11361 raft_consensus.cc:348] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.216725 11361 raft_consensus.cc:374] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.216781 11361 raft_consensus.cc:729] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.216981 11361 consensus_queue.cc:260] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.217959 11362 tablet_bootstrap.cc:654] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.219787 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.219199 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:12.221881 11047 leader_election.cc:341] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:12.222223 11047 leader_election.cc:341] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.224937 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet fd91e4f85cc64de9a13c598a3695f8a1 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.226089 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_2cdccd111a2c4d3a8ca5d261d5dda356"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.226841 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cdccd111a2c4d3a8ca5d261d5dda356 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.237483 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_502e2afdd41247c0b5d88a6826b41e02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.238413 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_502e2afdd41247c0b5d88a6826b41e02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.239828 13983 ts_tablet_manager.cc:1918] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:12.239967 13983 log.cc:1196] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/916b91088d7d4024a02214c958c0825b
I20260811 06:17:12.214506 12726 log.cc:1196] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c5c3e243e72f4cffb3318246ab428bd6
I20260811 06:17:12.241056 12726 ts_tablet_manager.cc:1939] T c5c3e243e72f4cffb3318246ab428bd6 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:12.241740 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_48b56fe9266b43b2b4f5ba274f3f8370"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.242506 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48b56fe9266b43b2b4f5ba274f3f8370 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.244264 12726 tablet_replica.cc:330] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:12.244263 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c5c3e243e72f4cffb3318246ab428bd6 (table default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]) successfully deleted
I20260811 06:17:12.244553 12726 raft_consensus.cc:2229] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:12.244609 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
I20260811 06:17:12.244802 12726 raft_consensus.cc:2258] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:12.244884 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10211a4e95464e9e9e2b2e70d23086a5 already in progress: creating tablet
I20260811 06:17:12.246367 11365 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.246608 11365 ts_tablet_manager.cc:1397] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.002s
I20260811 06:17:12.246856 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_f0b55e2b448349c5b236feb929d9cf6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.247800 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0b55e2b448349c5b236feb929d9cf6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.217665 11361 ts_tablet_manager.cc:1428] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:12.248394 11361 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.250274 11361 tablet_bootstrap.cc:654] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.252892 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_bf06a85d85b9455682bba38518caf4b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.254321 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf06a85d85b9455682bba38518caf4b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.247550 11365 raft_consensus.cc:348] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.258181 11365 raft_consensus.cc:374] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.258349 11365 raft_consensus.cc:729] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.258780 11365 consensus_queue.cc:260] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.259568 11365 ts_tablet_manager.cc:1428] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260811 06:17:12.260051 11365 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.261329 13983 ts_tablet_manager.cc:1939] T 916b91088d7d4024a02214c958c0825b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.265584 11683 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_91a2a9c15d324a14af5161c4cd05fb24" } new_table_name: "default.Table_22419b35407c47a6ae1cc32c15b56e1d" modify_external_catalogs: true
I20260811 06:17:12.265839 13282 consensus_queue.cc:1035] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:12.274631 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c096b132248d4375b8754794d46d6030" } new_table_name: "default.Table_d4486408cf04456dab448807e8c08e90" modify_external_catalogs: true
I20260811 06:17:12.278646 11362 tablet_bootstrap.cc:492] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.278786 11362 ts_tablet_manager.cc:1397] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.007s
I20260811 06:17:12.281432 13983 tablet_replica.cc:330] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.281661 13983 raft_consensus.cc:2229] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.281330 11362 raft_consensus.cc:348] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.281780 11362 raft_consensus.cc:374] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.281834 13983 raft_consensus.cc:2258] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.282398 13983 ts_tablet_manager.cc:1905] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.281837 11362 raft_consensus.cc:729] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.282891 11362 consensus_queue.cc:260] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.286332 11362 ts_tablet_manager.cc:1428] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:12.286645 11362 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.275436 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_6f45c201be9b4c2db67d8fa0da996890" } modify_external_catalogs: true
I20260811 06:17:12.290747 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_6f45c201be9b4c2db67d8fa0da996890" } modify_external_catalogs: true
I20260811 06:17:12.283080 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 916b91088d7d4024a02214c958c0825b (table default.Table_c4379e29a9da4cd2a3822f42fdc76315 [id=b90771b4a8334565ac1a30ad3a5ab2ea]) successfully deleted
I20260811 06:17:12.293671 11362 tablet_bootstrap.cc:654] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.299124 12726 ts_tablet_manager.cc:1905] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:12.305959 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a0e5b4cdeb464861ada487eeb1b901a6 because the tablet was not found. No further retry: Not found: Tablet not found: a0e5b4cdeb464861ada487eeb1b901a6
I20260811 06:17:12.306181 11365 tablet_bootstrap.cc:654] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:12.306563 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f5ad5529d4844f61b0888624e7c8b3ce because the tablet was not found. No further retry: Not found: Tablet not found: f5ad5529d4844f61b0888624e7c8b3ce
I20260811 06:17:12.307171 13983 ts_tablet_manager.cc:1918] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260811 06:17:12.307094 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:12.314733 11653 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 692957088ebc41e18fbebed550543744
I20260811 06:17:12.314908 13983 log.cc:1196] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/1349b0ea48b848398d4bdda528358c30
I20260811 06:17:12.315498 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_f4f8f5c098d5406a8529fc0efccae4f3" } modify_external_catalogs: true
I20260811 06:17:12.315763 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_f4f8f5c098d5406a8529fc0efccae4f3" } modify_external_catalogs: true
I20260811 06:17:12.314280 11362 tablet_bootstrap.cc:492] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.318085 11362 ts_tablet_manager.cc:1397] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.001s
I20260811 06:17:12.319180 11362 raft_consensus.cc:348] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.319404 11362 raft_consensus.cc:374] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.319468 11362 raft_consensus.cc:729] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.319607 13983 ts_tablet_manager.cc:1939] T 1349b0ea48b848398d4bdda528358c30 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.319670 11362 consensus_queue.cc:260] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.321154 13983 tablet_replica.cc:330] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.325603 13983 raft_consensus.cc:2229] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.326244 13983 raft_consensus.cc:2258] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.328469 11361 tablet_bootstrap.cc:492] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.328666 11361 ts_tablet_manager.cc:1397] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.006s
I20260811 06:17:12.329345 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 3882b410e51745ddb414e38ab7932ce0 (DEFAULT_TABLE table=default.Table_84f114df1d1c48bea906f941dd150e5e [id=b0ae0e02e1cb41bbaed24a600c847e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.329865 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3882b410e51745ddb414e38ab7932ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.329681 11361 raft_consensus.cc:348] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.330010 11361 raft_consensus.cc:374] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.330066 11361 raft_consensus.cc:729] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:12.330287 11588 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 369a031402a24a6a91f0c7ba8a5f288a consensus state has no leader
I20260811 06:17:12.330291 11361 consensus_queue.cc:260] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.330518 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 1349b0ea48b848398d4bdda528358c30 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]) successfully deleted
W20260811 06:17:12.330791 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e990aa374204f2b95c08b04121176bc already in progress: creating tablet
I20260811 06:17:12.330884 11361 ts_tablet_manager.cc:1428] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:12.331094 11362 ts_tablet_manager.cc:1428] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260811 06:17:12.331166 11361 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:12.331147 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because the tablet was not found. No further retry: Not found: Tablet not found: 217f60a1ca044af38f9ee9093e021c27
I20260811 06:17:12.331386 11362 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.332208 13983 ts_tablet_manager.cc:1905] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.333051 13282 raft_consensus.cc:482] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.333180 13282 raft_consensus.cc:504] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.333700 13282 leader_election.cc:288] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.334419 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.334455 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd53ac72e2e3450a9f777316742653bc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.337159 11046 leader_election.cc:302] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.337565 13282 raft_consensus.cc:2726] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.339026 11361 tablet_bootstrap.cc:654] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.345578 13983 ts_tablet_manager.cc:1918] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.345935 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 3882b410e51745ddb414e38ab7932ce0 (DEFAULT_TABLE table=default.Table_84f114df1d1c48bea906f941dd150e5e [id=b0ae0e02e1cb41bbaed24a600c847e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.346457 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3882b410e51745ddb414e38ab7932ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.350863 12726 ts_tablet_manager.cc:1918] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.351061 12726 log.cc:1196] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:12.351717 12726 ts_tablet_manager.cc:1939] T 3b5bb21784e34ad7addf144e0b10a444 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:12.358001 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet fd91e4f85cc64de9a13c598a3695f8a1
I20260811 06:17:12.358460 11663 catalog_manager.cc:6565] ReplaceTablet: tablet fd91e4f85cc64de9a13c598a3695f8a1 deleted and replaced by tablet 18b082ed126e41afbac160ebba87e769
I20260811 06:17:12.358868 11663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3b1ac4a64e764c4199189b7239086a89" } modify_external_catalogs: true
I20260811 06:17:12.359063 11663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3b1ac4a64e764c4199189b7239086a89" } modify_external_catalogs: true
I20260811 06:17:12.360601 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.360950 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:12.361734 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
I20260811 06:17:12.362852 11361 tablet_bootstrap.cc:492] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.363015 11361 ts_tablet_manager.cc:1397] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.003s
I20260811 06:17:12.363487 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa (DEFAULT_TABLE table=default.Table_54c41581e5074a0288d05734e120740a [id=00ab322766a84b4e81f7323881cff2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.363943 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.364248 11361 raft_consensus.cc:348] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.364445 11361 raft_consensus.cc:374] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.364496 11361 raft_consensus.cc:729] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.364483 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 3b5bb21784e34ad7addf144e0b10a444 (table default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]) successfully deleted
I20260811 06:17:12.364701 11361 consensus_queue.cc:260] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:12.364817 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:12.365186 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:12.365285 11361 ts_tablet_manager.cc:1428] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:12.365676 11361 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:12.366933 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
W20260811 06:17:12.367388 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
I20260811 06:17:12.370687 10626 tablet_service.cc:1467] Processing CreateTablet for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa (DEFAULT_TABLE table=default.Table_54c41581e5074a0288d05734e120740a [id=00ab322766a84b4e81f7323881cff2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.371290 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.373473 13983 log.cc:1196] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:12.374511 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 3882b410e51745ddb414e38ab7932ce0 (DEFAULT_TABLE table=default.Table_84f114df1d1c48bea906f941dd150e5e [id=b0ae0e02e1cb41bbaed24a600c847e76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.355827 11362 tablet_bootstrap.cc:654] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.374881 13983 ts_tablet_manager.cc:1939] T 2b0ae9a1d3b74c3985637439819b63ef P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.374931 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3882b410e51745ddb414e38ab7932ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.376634 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 978a7b9a41e84d7c981d481d28e529a5 (DEFAULT_TABLE table=default.Table_bc9f6672cc9c4af8b3c2a586982a446a [id=a6abdbdc7fae4d1caebba5fd168a375c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.377144 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978a7b9a41e84d7c981d481d28e529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.379547 13983 tablet_replica.cc:330] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.379876 13983 raft_consensus.cc:2229] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.380223 13983 raft_consensus.cc:2258] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.380878 13983 ts_tablet_manager.cc:1905] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.377664 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:12.382093 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:12.386297 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:12.386615 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 628041532743486184df7d91d460be44 (DEFAULT_TABLE table=default.Table_4013a762d62b4bdcb6b48f3959d92274 [id=3b0d36627491469781992b2646f21dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.387199 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628041532743486184df7d91d460be44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.387985 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (DEFAULT_TABLE table=default.Table_58a2488cc0fa41369792941575db1367 [id=1e63357b8e1e4c769761f84a22125a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.388362 13983 ts_tablet_manager.cc:1918] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.388415 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.388563 13983 log.cc:1196] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:12.389053 13983 ts_tablet_manager.cc:1939] T 6703e639ab2042e78fadc63bd18c7602 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.391305 13983 tablet_replica.cc:330] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.391582 13983 raft_consensus.cc:2229] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.391788 13983 raft_consensus.cc:2258] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.392433 13983 ts_tablet_manager.cc:1905] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.395849 11365 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.396085 11365 ts_tablet_manager.cc:1397] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.136s user 0.010s sys 0.003s
I20260811 06:17:12.397141 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:12.398126 12944 raft_consensus.cc:482] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.398283 12944 raft_consensus.cc:504] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.398969 12944 leader_election.cc:288] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:12.400027 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.400382 10658 raft_consensus.cc:2379] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:12.401288 10623 tablet_service.cc:1467] Processing CreateTablet for tablet fca6e42333aa40f49ccfc9c337272bab (DEFAULT_TABLE table=default.Table_0ee1f4c875444b0b942b5d5af34212d2 [id=d753ed1e9c2a4b23b8959e783a0da682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.401536 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f (DEFAULT_TABLE table=default.Table_1e647362a1ce49cdbb427dbbbd25e3cf [id=02442c4ec6aa4ef395b29132fe17ab14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.401849 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca6e42333aa40f49ccfc9c337272bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.402132 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.403046 13983 ts_tablet_manager.cc:1918] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:12.403235 13983 log.cc:1196] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/78d94d27431a4d5e93f1c1ce8c7b6752
I20260811 06:17:12.403820 13983 ts_tablet_manager.cc:1939] T 78d94d27431a4d5e93f1c1ce8c7b6752 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.406136 13983 tablet_replica.cc:330] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.406452 13983 raft_consensus.cc:2229] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.406780 13983 raft_consensus.cc:2258] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.407706 13983 ts_tablet_manager.cc:1905] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.411429 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (DEFAULT_TABLE table=default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.411888 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f50ee875a8e4fa3b5738c9660a46c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.412290 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (DEFAULT_TABLE table=default.Table_58a2488cc0fa41369792941575db1367 [id=1e63357b8e1e4c769761f84a22125a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.412281 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 628041532743486184df7d91d460be44 (DEFAULT_TABLE table=default.Table_4013a762d62b4bdcb6b48f3959d92274 [id=3b0d36627491469781992b2646f21dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.412281 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 978a7b9a41e84d7c981d481d28e529a5 (DEFAULT_TABLE table=default.Table_bc9f6672cc9c4af8b3c2a586982a446a [id=a6abdbdc7fae4d1caebba5fd168a375c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.412721 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.412871 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978a7b9a41e84d7c981d481d28e529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.413188 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:12.413697 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:12.413754 13282 raft_consensus.cc:482] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.414003 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:12.414305 11672 catalog_manager.cc:5495] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:12.415258 11672 catalog_manager.cc:5495] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:12.415719 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:12.416185 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_8d08b9ac405c4d6ebef14f95d93b988b [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 2 got 0
I20260811 06:17:12.416630 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:12.420885 11365 raft_consensus.cc:348] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.421139 11365 raft_consensus.cc:374] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.421200 11365 raft_consensus.cc:729] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.421375 11365 consensus_queue.cc:260] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.422485 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 76e1ccffa6a640b5a540e5146794affe (DEFAULT_TABLE table=default.Table_fb2139d3ef694b7296f2121a4c5a6920 [id=4ab9b615c6ba41318ed54e8d4d2f61da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.422897 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e1ccffa6a640b5a540e5146794affe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.423627 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 769ae734a84246c98426b1863bc21f16 (DEFAULT_TABLE table=default.Table_e747fbaa33fe45919e9a98d164e35ec0 [id=abd99814120c4332a2f94aa91a349705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.423966 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769ae734a84246c98426b1863bc21f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.413544 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (DEFAULT_TABLE table=default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.413748 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7716cda181d444a99d69cbc9ade3269e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.427578 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 769ae734a84246c98426b1863bc21f16 (DEFAULT_TABLE table=default.Table_e747fbaa33fe45919e9a98d164e35ec0 [id=abd99814120c4332a2f94aa91a349705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.428123 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f (DEFAULT_TABLE table=default.Table_1e647362a1ce49cdbb427dbbbd25e3cf [id=02442c4ec6aa4ef395b29132fe17ab14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.427598 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f50ee875a8e4fa3b5738c9660a46c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.428787 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769ae734a84246c98426b1863bc21f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.429239 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.429703 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628041532743486184df7d91d460be44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.429677 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 76e1ccffa6a640b5a540e5146794affe (DEFAULT_TABLE table=default.Table_fb2139d3ef694b7296f2121a4c5a6920 [id=4ab9b615c6ba41318ed54e8d4d2f61da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.429896 11361 tablet_bootstrap.cc:654] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.430008 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e1ccffa6a640b5a540e5146794affe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.414042 13282 raft_consensus.cc:504] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.430859 13983 ts_tablet_manager.cc:1918] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.431442 10813 leader_election.cc:302] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.431819 12944 raft_consensus.cc:3037] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.432215 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa (DEFAULT_TABLE table=default.Table_54c41581e5074a0288d05734e120740a [id=00ab322766a84b4e81f7323881cff2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.432663 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60dcfd27f9b94d20a90bef02d4f0dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.434015 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f (DEFAULT_TABLE table=default.Table_1e647362a1ce49cdbb427dbbbd25e3cf [id=02442c4ec6aa4ef395b29132fe17ab14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.434435 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.434671 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 2b0ae9a1d3b74c3985637439819b63ef (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]) successfully deleted
I20260811 06:17:12.434862 12944 raft_consensus.cc:2726] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.436118 10858 tablet_service.cc:1467] Processing CreateTablet for tablet 978a7b9a41e84d7c981d481d28e529a5 (DEFAULT_TABLE table=default.Table_bc9f6672cc9c4af8b3c2a586982a446a [id=a6abdbdc7fae4d1caebba5fd168a375c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.436535 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 978a7b9a41e84d7c981d481d28e529a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.436703 13732 consensus_queue.cc:1035] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:12.438519 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.442028 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 628041532743486184df7d91d460be44 (DEFAULT_TABLE table=default.Table_4013a762d62b4bdcb6b48f3959d92274 [id=3b0d36627491469781992b2646f21dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.442400 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628041532743486184df7d91d460be44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.444512 11365 ts_tablet_manager.cc:1428] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260811 06:17:12.444828 11365 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.446029 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (DEFAULT_TABLE table=default.Table_58a2488cc0fa41369792941575db1367 [id=1e63357b8e1e4c769761f84a22125a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.446534 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.447463 11365 tablet_bootstrap.cc:654] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.450006 10864 tablet_service.cc:1467] Processing CreateTablet for tablet fca6e42333aa40f49ccfc9c337272bab (DEFAULT_TABLE table=default.Table_0ee1f4c875444b0b942b5d5af34212d2 [id=d753ed1e9c2a4b23b8959e783a0da682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.450337 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca6e42333aa40f49ccfc9c337272bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.452585 13983 log.cc:1196] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/c5c3e243e72f4cffb3318246ab428bd6
I20260811 06:17:12.454066 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (DEFAULT_TABLE table=default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.454403 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f50ee875a8e4fa3b5738c9660a46c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.458231 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 76e1ccffa6a640b5a540e5146794affe (DEFAULT_TABLE table=default.Table_fb2139d3ef694b7296f2121a4c5a6920 [id=4ab9b615c6ba41318ed54e8d4d2f61da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.458647 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76e1ccffa6a640b5a540e5146794affe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.459084 13983 ts_tablet_manager.cc:1939] T c5c3e243e72f4cffb3318246ab428bd6 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.461884 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 769ae734a84246c98426b1863bc21f16 (DEFAULT_TABLE table=default.Table_e747fbaa33fe45919e9a98d164e35ec0 [id=abd99814120c4332a2f94aa91a349705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.462340 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769ae734a84246c98426b1863bc21f16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:12.471515 11046 leader_election.cc:341] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 91f079882c3c46318f70190d5293868e
I20260811 06:17:12.473925 11119 tablet_service.cc:1467] Processing CreateTablet for tablet fca6e42333aa40f49ccfc9c337272bab (DEFAULT_TABLE table=default.Table_0ee1f4c875444b0b942b5d5af34212d2 [id=d753ed1e9c2a4b23b8959e783a0da682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:12.474349 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca6e42333aa40f49ccfc9c337272bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:12.475751 13741 raft_consensus.cc:482] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.475889 13741 raft_consensus.cc:504] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:12.477963 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5ca903ee846a4e5baf3dbb4302607c1f because the tablet was not found. No further retry: Not found: Tablet not found: 5ca903ee846a4e5baf3dbb4302607c1f
W20260811 06:17:12.478461 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 227bc4fd6cd84e5eb2043c52f95d606d because the tablet was not found. No further retry: Not found: Tablet not found: 227bc4fd6cd84e5eb2043c52f95d606d
I20260811 06:17:12.482259 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 6703e639ab2042e78fadc63bd18c7602 (table default.Table_c7fdf6b388124805afa944307aead1d1 [id=7e1b6b2700f9460eb2aeb2a3ca24e483]) successfully deleted
W20260811 06:17:12.482656 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05867781f7954fb280cc83b2a13d0d61 already in progress: creating tablet
I20260811 06:17:12.484745 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:12.485072 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:12.485332 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
W20260811 06:17:12.484992 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:12.485886 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c997501cefd4e6b9e5824e5403dd39b already in progress: creating tablet
W20260811 06:17:12.486219 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:12.486493 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0dab2b8209e5401c84a187882ef21e08 because the tablet was not found. No further retry: Not found: Tablet not found: 0dab2b8209e5401c84a187882ef21e08
I20260811 06:17:12.487617 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:12.487087 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 78d94d27431a4d5e93f1c1ce8c7b6752 (table default.Table_11e2d0b45ca14dd0b8a9eee225d47b4c [id=28d8219e2db14510b4fe773f7bddb990]) successfully deleted
W20260811 06:17:12.488237 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 already in progress: creating tablet
W20260811 06:17:12.488653 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a04766ede03342efb594aaf081e112af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a04766ede03342efb594aaf081e112af already in progress: creating tablet
W20260811 06:17:12.488890 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 12971f852ea943b78d967f7672680cad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12971f852ea943b78d967f7672680cad already in progress: creating tablet
I20260811 06:17:12.489377 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:12.493301 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:12.494243 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:12.497038 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:12.500852 13282 leader_election.cc:288] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.501307 13948 raft_consensus.cc:482] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.501447 13948 raft_consensus.cc:504] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.501999 13741 leader_election.cc:288] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.502157 13948 leader_election.cc:288] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.502236 11365 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.502377 11365 ts_tablet_manager.cc:1397] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.001s
I20260811 06:17:12.503527 11365 raft_consensus.cc:348] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.503759 11365 raft_consensus.cc:374] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.503813 11365 raft_consensus.cc:729] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.503999 11365 consensus_queue.cc:260] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.504545 11365 ts_tablet_manager.cc:1428] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:12.506454 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:12.507184 11365 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.508802 11365 tablet_bootstrap.cc:654] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.513121 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
W20260811 06:17:12.489656 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 14a36a644dc4491dad838ce4e19793ab because the tablet was not found. No further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:12.519869 11365 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.520038 11365 ts_tablet_manager.cc:1397] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260811 06:17:12.520116 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:12.520748 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:12.521073 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:12.521147 11365 raft_consensus.cc:348] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.521404 11365 raft_consensus.cc:374] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.521466 11365 raft_consensus.cc:729] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.521662 11365 consensus_queue.cc:260] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.522262 11365 ts_tablet_manager.cc:1428] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 06:17:12.529812 10813 consensus_peers.cc:487] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:12.529964 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 59275.3us
I20260811 06:17:12.531018 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:12.531710 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:12.534260 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:12.534536 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:12.534986 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
W20260811 06:17:12.535064 11047 leader_election.cc:341] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 91f079882c3c46318f70190d5293868e
I20260811 06:17:12.535218 11047 leader_election.cc:302] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.535676 13977 raft_consensus.cc:2726] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.535707 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:12.536024 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:12.536316 11672 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_c096b132248d4375b8754794d46d6030 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 1 got 0
W20260811 06:17:12.537863 11047 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:12.540954 11365 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.542411 11365 tablet_bootstrap.cc:654] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.543614 11679 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_edd6f59b376846248a03f18cd0c9ebe9 [id=04cae46b1a9844d6b9924d529d8fb387] alter complete (version 1)
I20260811 06:17:12.545295 13948 raft_consensus.cc:482] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.545456 13948 raft_consensus.cc:504] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.546133 13948 leader_election.cc:288] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.546770 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.547016 10923 raft_consensus.cc:2454] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:12.547539 10555 leader_election.cc:302] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:12.548269 13948 raft_consensus.cc:2781] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.548382 13948 raft_consensus.cc:482] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.548445 13948 raft_consensus.cc:3037] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.548902 11365 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.549047 11365 ts_tablet_manager.cc:1397] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 06:17:12.549835 11365 raft_consensus.cc:348] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.550051 11365 raft_consensus.cc:374] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.550107 11365 raft_consensus.cc:729] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.550319 11365 consensus_queue.cc:260] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.550873 11365 ts_tablet_manager.cc:1428] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:12.551158 11365 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.552528 11365 tablet_bootstrap.cc:654] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.554988 13948 raft_consensus.cc:504] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.556654 13948 leader_election.cc:288] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.557145 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:12.557348 10923 raft_consensus.cc:3037] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.567252 11365 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.567418 11365 ts_tablet_manager.cc:1397] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260811 06:17:12.568209 11365 raft_consensus.cc:348] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.568442 11365 raft_consensus.cc:374] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.568508 11365 raft_consensus.cc:729] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.568717 11365 consensus_queue.cc:260] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.569358 11365 ts_tablet_manager.cc:1428] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:12.569650 11365 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.571205 11365 tablet_bootstrap.cc:654] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.577510 13948 raft_consensus.cc:482] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.577737 13948 raft_consensus.cc:504] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.578343 13948 leader_election.cc:288] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.579001 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.579663 10555 leader_election.cc:341] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.585980 11365 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:12.586231 11365 ts_tablet_manager.cc:1397] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260811 06:17:12.587073 11365 raft_consensus.cc:348] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.587375 11365 raft_consensus.cc:374] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.588775 11365 raft_consensus.cc:729] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.589116 11365 consensus_queue.cc:260] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.589807 11365 ts_tablet_manager.cc:1428] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:12.590263 11365 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:12.592128 11365 tablet_bootstrap.cc:654] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.602708 11361 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.602878 11361 ts_tablet_manager.cc:1397] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.237s user 0.006s sys 0.000s
W20260811 06:17:12.610733 11683 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 485e465a43c14fc8ad3a70c6e3ee7628 consensus state has no leader
I20260811 06:17:12.612618 11361 raft_consensus.cc:348] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.612833 11361 raft_consensus.cc:374] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.612882 11361 raft_consensus.cc:729] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.613166 11361 consensus_queue.cc:260] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.613781 11361 ts_tablet_manager.cc:1428] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:17:12.614179 11361 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.623711 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_1d92d36d1121431d96ae878f85642170 [id=7d8f4d920e5c406e93fefc7efadabd89] alter complete (version 1)
I20260811 06:17:12.628904 13732 raft_consensus.cc:482] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.630424 10923 raft_consensus.cc:2454] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:12.631036 11361 tablet_bootstrap.cc:654] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.631054 10555 leader_election.cc:302] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:12.635599 13948 raft_consensus.cc:2781] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.635977 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e329d808c59c4f66bbc515d751255e96" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.636125 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet c5c3e243e72f4cffb3318246ab428bd6 (table default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]) successfully deleted
W20260811 06:17:12.636663 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
I20260811 06:17:12.636644 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.636847 11157 raft_consensus.cc:2454] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
W20260811 06:17:12.636983 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:12.637374 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:12.637692 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
I20260811 06:17:12.637831 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "754b5fec454d44608b62ddec7d58bfac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:12.638038 11157 raft_consensus.cc:3037] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:12.638217 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3b5bb21784e34ad7addf144e0b10a444 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5bb21784e34ad7addf144e0b10a444 already in progress: creating tablet
W20260811 06:17:12.638526 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10211a4e95464e9e9e2b2e70d23086a5 already in progress: creating tablet
I20260811 06:17:12.629066 13732 raft_consensus.cc:504] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:12.638927 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:12.639207 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:12.639240 13732 leader_election.cc:288] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:12.639488 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
W20260811 06:17:12.639695 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
W20260811 06:17:12.640995 10810 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:12.641136 11157 raft_consensus.cc:2454] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:12.641815 11156 raft_consensus.cc:3037] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.641824 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "585f92fc5b3d41bd97df525380fcab9f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.611972 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e329d808c59c4f66bbc515d751255e96" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.642086 11153 raft_consensus.cc:2454] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:12.642613 10555 leader_election.cc:341] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.644731 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.645418 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.646011 12726 tablet_replica.cc:330] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:12.646260 12726 raft_consensus.cc:2229] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.646420 12726 raft_consensus.cc:2258] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.646746 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.647078 12726 ts_tablet_manager.cc:1905] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.648192 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fcf7c7a470144c0a084aebc2032d896 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.648710 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.649684 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.649976 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.652103 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 314a569c95414c04b8b505ca471caa6b
I20260811 06:17:12.652879 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_8d08b9ac405c4d6ebef14f95d93b988b" } new_table_name: "default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8" modify_external_catalogs: true
I20260811 06:17:12.655061 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.655926 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_2fd5d4cf14df4e679c46e04d0c42f8cc [id=da44c33a0b9d49fa8b0df0afa70e6fd3] alter complete (version 2)
I20260811 06:17:12.643788 10813 leader_election.cc:302] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:12.665005 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.665766 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:12.666103 13740 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s user 0.006s sys 0.013s
W20260811 06:17:12.666551 13740 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s user 0.007s sys 0.013s
I20260811 06:17:12.666667 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_3826ea7f52ba4532a58bb15b37cb67e5 [id=b582c8dd39f849cf8dd18e3aa7d41658] alter complete (version 3)
I20260811 06:17:12.668604 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.671842 11361 tablet_bootstrap.cc:492] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.671990 11361 ts_tablet_manager.cc:1397] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.003s
W20260811 06:17:12.672142 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:12.673133 11361 raft_consensus.cc:348] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.673360 11361 raft_consensus.cc:374] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.673406 11361 raft_consensus.cc:729] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.673583 11361 consensus_queue.cc:260] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.677302 11361 ts_tablet_manager.cc:1428] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:17:12.679193 11361 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.679580 12944 raft_consensus.cc:2781] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.679682 12944 raft_consensus.cc:482] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.679749 12944 raft_consensus.cc:3037] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.680294 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_a84138d5e3c74165a9b2e3ea799b1356 [id=60579e2911f54f6eada4bb1ee1da78d1] alter complete (version 1)
W20260811 06:17:12.681576 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 197436us
I20260811 06:17:12.682021 11362 tablet_bootstrap.cc:492] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.682159 11362 ts_tablet_manager.cc:1397] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.351s user 0.045s sys 0.061s
I20260811 06:17:12.682866 11362 raft_consensus.cc:348] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.683091 11362 raft_consensus.cc:374] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.683156 11362 raft_consensus.cc:729] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.683337 11362 consensus_queue.cc:260] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.683898 11362 ts_tablet_manager.cc:1428] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:12.684090 11361 tablet_bootstrap.cc:654] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.685243 11362 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.686813 11362 tablet_bootstrap.cc:654] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.689591 12944 raft_consensus.cc:504] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.690263 12944 leader_election.cc:288] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:12.695186 11362 tablet_bootstrap.cc:492] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:12.695335 11362 ts_tablet_manager.cc:1397] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
W20260811 06:17:12.698199 10810 leader_election.cc:341] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:12.698979 11362 raft_consensus.cc:348] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.699203 11362 raft_consensus.cc:374] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.699254 11362 raft_consensus.cc:729] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.699399 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_b3e57e08da2a440ea87dba0f379d1b47 [id=8b0b0301a2c646719cae9bc25f613a63] alter complete (version 2)
I20260811 06:17:12.699427 11362 consensus_queue.cc:260] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.699960 11362 ts_tablet_manager.cc:1428] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260811 06:17:12.700206 11362 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:12.701560 11362 tablet_bootstrap.cc:654] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.703662 14100 raft_consensus.cc:482] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.703994 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "585f92fc5b3d41bd97df525380fcab9f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:12.704198 11156 raft_consensus.cc:3037] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.709792 14099 consensus_queue.cc:1035] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:12.710081 11156 raft_consensus.cc:2454] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:12.703907 14100 raft_consensus.cc:504] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.710773 14100 leader_election.cc:288] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.710731 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_21af64f531d94d2ca6bd55161d03a654 [id=076c234f71704866b8327a959de28b86] alter complete (version 1)
I20260811 06:17:12.711743 10813 leader_election.cc:302] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:12.712222 13732 raft_consensus.cc:2781] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.712334 13732 raft_consensus.cc:686] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:12.712566 13732 consensus_queue.cc:237] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.719661 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_bbd56f7550904a7dab2b0faa4f932eee [id=5cd54d1a139f4121a3d2ab449eb86c85] alter complete (version 1)
W20260811 06:17:12.721752 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 89) took 1286 ms (client timeout 1000 ms). Trace:
W20260811 06:17:12.722087 11047 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
I20260811 06:17:12.722261 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.722554 13701 tablet_replica.cc:330] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:12.722757 13701 raft_consensus.cc:2229] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.722927 13701 raft_consensus.cc:2258] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.723595 13701 ts_tablet_manager.cc:1905] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.724651 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.730762 13701 ts_tablet_manager.cc:1918] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.731415 13701 log.cc:1196] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:12.734191 13701 ts_tablet_manager.cc:1939] T 585f92fc5b3d41bd97df525380fcab9f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:12.735882 11361 tablet_bootstrap.cc:492] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.736413 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 585f92fc5b3d41bd97df525380fcab9f (table default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]) successfully deleted
W20260811 06:17:12.737960 10564 leader_election.cc:341] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.738379 10564 leader_election.cc:302] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.745517 11361 ts_tablet_manager.cc:1397] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.068s user 0.007s sys 0.006s
I20260811 06:17:12.746392 11361 raft_consensus.cc:348] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:12.746625 11361 raft_consensus.cc:374] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.746683 11361 raft_consensus.cc:729] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.746877 11361 consensus_queue.cc:260] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:12.747450 11361 ts_tablet_manager.cc:1428] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:12.747766 11361 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.747814 12726 ts_tablet_manager.cc:1918] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.747963 12726 log.cc:1196] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/12971f852ea943b78d967f7672680cad
I20260811 06:17:12.748327 12726 ts_tablet_manager.cc:1939] T 12971f852ea943b78d967f7672680cad P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:12.749326 12726 tablet_replica.cc:330] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:12.749413 11361 tablet_bootstrap.cc:654] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:12.749565 12726 raft_consensus.cc:2229] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.741907 13701 tablet_replica.cc:330] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:12.749976 13701 raft_consensus.cc:2229] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.750190 13701 raft_consensus.cc:2258] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.751417 13701 ts_tablet_manager.cc:1905] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.754439 14108 raft_consensus.cc:482] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.754652 14108 raft_consensus.cc:504] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.755826 14108 leader_election.cc:288] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.755945 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.756641 10555 leader_election.cc:341] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.757516 13701 ts_tablet_manager.cc:1918] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.758800 14100 raft_consensus.cc:482] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.773077 14100 raft_consensus.cc:504] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.773777 14100 leader_election.cc:288] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.774117 13701 log.cc:1196] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:12.774667 13701 ts_tablet_manager.cc:1939] T 035eee1d37c94471a7cd697fb0fbb951 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:12.777321 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8741294bc33e454a9c4ef1717ccef80f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.778752 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 035eee1d37c94471a7cd697fb0fbb951 (table default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]) successfully deleted
W20260811 06:17:12.779806 11047 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.780344 11361 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:12.780490 11361 ts_tablet_manager.cc:1397] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.003s
I20260811 06:17:12.781786 11361 raft_consensus.cc:348] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.782009 11361 raft_consensus.cc:374] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:12.782073 11361 raft_consensus.cc:729] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:12.782291 11361 consensus_queue.cc:260] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.782991 11361 ts_tablet_manager.cc:1428] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260811 06:17:12.783105 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3de77019fc074a55ab741db336a9fc60 consensus state has no leader
I20260811 06:17:12.784264 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1882451cbcfe432aa9188327086bf0e3" } new_table_name: "default.Table_1df9e024defd44ceadab0755bf9eb4f1" modify_external_catalogs: true
I20260811 06:17:12.787844 11361 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:12.796720 11361 tablet_bootstrap.cc:654] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:12.798967 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f040a4545164a75a1cfe2a203a867d6 consensus state has no leader
I20260811 06:17:12.799963 11655 master_service.cc:946] ReplaceTablet: received request to replace tablet 8c997501cefd4e6b9e5824e5403dd39b from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:12.801352 12726 raft_consensus.cc:2258] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.801666 14108 raft_consensus.cc:2684] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Received pre-election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260811 06:17:12.803913 12726 ts_tablet_manager.cc:1905] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.809774 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 4f8456bc7fbd461c85ed2f5e7b42193d
I20260811 06:17:12.810631 11653 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_befcafaab1e245148bebd1c621529067" } new_table_name: "default.Table_7bdf522454af4d4884e71798bffb78d4" modify_external_catalogs: true
I20260811 06:17:12.812321 13948 raft_consensus.cc:686] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:12.812583 13948 consensus_queue.cc:237] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.814939 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.816941 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:12.817370 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
W20260811 06:17:12.822188 11653 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7e350aaabbe42968eb8afb509bd8f4e consensus state has no leader
I20260811 06:17:12.822896 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_33b9f31254094f76a6490edc033c7d2c" } modify_external_catalogs: true
I20260811 06:17:12.823400 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_33b9f31254094f76a6490edc033c7d2c" } modify_external_catalogs: true
W20260811 06:17:12.727626 11676 rpcz_store.cc:269] 0811 06:17:11.435146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.471874 (+ 36728us) service_pool.cc:227] Handling call
0811 06:17:12.721574 (+1249700us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.680043 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.680157 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.680162 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:11.680165 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:11.680264 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.680277 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.680281 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.680354 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:11.680356 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.680390 (+ 34us) write_op.cc:270] Start()
0811 06:17:11.680418 (+ 28us) write_op.cc:276] Timestamp: P: 1786429031680341 usec, L: 0
0811 06:17:11.680422 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.680584 (+ 162us) log.cc:842] Serialized 530 byte log entry
0811 06:17:11.693175 (+ 12591us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.693446 (+ 271us) write_op.cc:301] APPLY: starting
0811 06:17:11.693462 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.693494 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.693533 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.693585 (+ 52us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.693617 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.693623 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:11.693734 (+ 111us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.693803 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.693821 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:11.693827 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.693883 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.693887 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:11.706246 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.706622 (+ 376us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.706629 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:11.706631 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.706759 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.706771 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.706776 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:11.706856 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:11.706858 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:11.706898 (+ 40us) write_op.cc:270] Start()
0811 06:17:11.706933 (+ 35us) write_op.cc:276] Timestamp: P: 1786429031706845 usec, L: 0
0811 06:17:11.706938 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.707176 (+ 238us) log.cc:842] Serialized 356 byte log entry
0811 06:17:11.710612 (+ 3436us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.710709 (+ 97us) write_op.cc:301] APPLY: starting
0811 06:17:11.710726 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.710766 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.710961 (+ 195us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.711026 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.711061 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:11.711068 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:11.711165 (+ 97us) log.cc:842] Serialized 23 byte log entry
0811 06:17:11.711237 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.711257 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:11.711264 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:11.711321 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.711324 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.063472 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.063567 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.063573 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:12.063576 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.063682 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.063692 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.063698 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.063753 (+ 55us) tablet.cc:699] Row locks acquired
0811 06:17:12.063756 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:12.063786 (+ 30us) write_op.cc:270] Start()
0811 06:17:12.063813 (+ 27us) write_op.cc:276] Timestamp: P: 1786429032063757 usec, L: 0
0811 06:17:12.063817 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.063963 (+ 146us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.138377 (+ 74414us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.138541 (+ 164us) write_op.cc:301] APPLY: starting
0811 06:17:12.138557 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.138593 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.138631 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.138679 (+ 48us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.138710 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.138716 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.138802 (+ 86us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.138863 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.138879 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:12.138885 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.138937 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.138940 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.149041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.149145 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.149151 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:12.149153 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:12.149250 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.149260 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.149264 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.149322 (+ 58us) tablet.cc:699] Row locks acquired
0811 06:17:12.149324 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.149360 (+ 36us) write_op.cc:270] Start()
0811 06:17:12.149391 (+ 31us) write_op.cc:276] Timestamp: P: 1786429032149322 usec, L: 0
0811 06:17:12.149395 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.163855 (+ 14460us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.164088 (+ 233us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:12.218359 (+ 54271us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.220457 (+ 2098us) write_op.cc:301] APPLY: starting
0811 06:17:12.220474 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.220518 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.220520 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.220577 (+ 57us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.220612 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.220618 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.220699 (+ 81us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.220961 (+ 262us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.220978 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:12.220985 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.221099 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.221103 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.660680 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.660820 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.660827 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:12.660830 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.660962 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.660980 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.660986 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.661066 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:12.661069 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:12.661121 (+ 52us) write_op.cc:270] Start()
0811 06:17:12.661165 (+ 44us) write_op.cc:276] Timestamp: P: 1786429032661078 usec, L: 0
0811 06:17:12.661169 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.661431 (+ 262us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.665686 (+ 4255us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.665863 (+ 177us) write_op.cc:301] APPLY: starting
0811 06:17:12.665896 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.665942 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.665970 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.666033 (+ 63us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.666088 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.666094 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.666222 (+ 128us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.666290 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.666312 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:12.666328 (+ 16us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.666389 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.666392 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.668119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.668230 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.668235 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.668237 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:12.668362 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.668377 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.668382 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.668449 (+ 67us) tablet.cc:699] Row locks acquired
0811 06:17:12.668451 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.668486 (+ 35us) write_op.cc:270] Start()
0811 06:17:12.668516 (+ 30us) write_op.cc:276] Timestamp: P: 1786429032668448 usec, L: 0
0811 06:17:12.668520 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.668694 (+ 174us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.679414 (+ 10720us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.679550 (+ 136us) write_op.cc:301] APPLY: starting
0811 06:17:12.679578 (+ 28us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.679622 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.679672 (+ 50us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.679732 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.679768 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.679774 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.679859 (+ 85us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.679933 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.679955 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:12.679962 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.680020 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.680024 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.681198 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.681303 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.681308 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.681311 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.681422 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.681435 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.681440 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.681506 (+ 66us) tablet.cc:699] Row locks acquired
0811 06:17:12.681508 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.681544 (+ 36us) write_op.cc:270] Start()
0811 06:17:12.681577 (+ 33us) write_op.cc:276] Timestamp: P: 1786429032681504 usec, L: 0
0811 06:17:12.681581 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.681779 (+ 198us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.698336 (+ 16557us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.698465 (+ 129us) write_op.cc:301] APPLY: starting
0811 06:17:12.698498 (+ 33us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.698541 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.698571 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.698630 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.698665 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.698671 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.698759 (+ 88us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.698830 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.698852 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:12.698872 (+ 20us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.698932 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.698936 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.700519 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.700739 (+ 220us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.700744 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.700747 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.700851 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.700865 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.700869 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.700957 (+ 88us) tablet.cc:699] Row locks acquired
0811 06:17:12.700959 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.700996 (+ 37us) write_op.cc:270] Start()
0811 06:17:12.701028 (+ 32us) write_op.cc:276] Timestamp: P: 1786429032700953 usec, L: 0
0811 06:17:12.701032 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.701204 (+ 172us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.707170 (+ 5966us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.707296 (+ 126us) write_op.cc:301] APPLY: starting
0811 06:17:12.707334 (+ 38us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.707377 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.707430 (+ 53us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.707485 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.707519 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.707525 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.707603 (+ 78us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.707675 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.707694 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:12.707700 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.707755 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.707758 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.711880 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.711989 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.711994 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.711997 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.712098 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.712112 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.712117 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.712180 (+ 63us) tablet.cc:699] Row locks acquired
0811 06:17:12.712182 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.712215 (+ 33us) write_op.cc:270] Start()
0811 06:17:12.712246 (+ 31us) write_op.cc:276] Timestamp: P: 1786429032712172 usec, L: 0
0811 06:17:12.712250 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.712425 (+ 175us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.716260 (+ 3835us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.716405 (+ 145us) write_op.cc:301] APPLY: starting
0811 06:17:12.716436 (+ 31us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.716481 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.716551 (+ 70us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.716678 (+ 127us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.716715 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.716722 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:12.716816 (+ 94us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.716927 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.716948 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:12.716955 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.717014 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.717018 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":506,"apply.run_wall_time_us":496,"num_ops":1,"prepare.queue_time_us":40,"prepare.run_cpu_time_us":641,"prepare.run_wall_time_us":938,"raft.queue_time_us":58,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":207,"replication_time_us":12729}],["op",{"apply.queue_time_us":32,"apply.run_cpu_time_us":667,"apply.run_wall_time_us":666,"num_ops":1,"prepare.queue_time_us":10547,"prepare.run_cpu_time_us":837,"prepare.run_wall_time_us":1040,"raft.queue_time_us":587,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"replication_time_us":3644}],["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":449,"num_ops":1,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":581,"prepare.run_wall_time_us":581,"replication_time_us":74534}],["op",{"apply.queue_time_us":2032,"apply.run_cpu_time_us":459,"apply.run_wall_time_us":702,"num_ops":1,"prepare.queue_time_us":6741,"prepare.run_cpu_time_us":996,"prepare.run_wall_time_us":15095,"replication_time_us":68942,"spinlock_wait_cycles":32745856}],["op",{"apply.queue_time_us":120,"apply.run_cpu_time_us":584,"apply.run_wall_time_us":584,"num_ops":1,"prepare.queue_time_us":3587,"prepare.run_cpu_time_us":897,"prepare.run_wall_time_us":898,"raft.queue_time_us":494,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":584,"replication_time_us":4491}],["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":529,"apply.run_wall_time_us":528,"num_ops":1,"prepare.queue_time_us":526,"prepare.run_cpu_time_us":649,"prepare.run_wall_time_us":648,"replication_time_us":10866}],["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":525,"apply.run_wall_time_us":523,"num_ops":1,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":670,"prepare.run_wall_time_us":671,"replication_time_us":16726}],["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":510,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":761,"prepare.run_wall_time_us":761,"replication_time_us":6114}],["op",{"apply.queue_time_us":91,"apply.run_cpu_time_us":667,"apply.run_wall_time_us":666,"num_ops":1,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":660,"raft.queue_time_us":58,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":250,"replication_time_us":3983}]]}
I20260811 06:17:12.830958 14025 catalog_manager.cc:1259] Loaded cluster ID: b7b6bba1dd204df3b957398d4953c620
I20260811 06:17:12.830974 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:12.831818 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
W20260811 06:17:12.832849 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
I20260811 06:17:12.862469 14025 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: loading cluster ID for follower catalog manager: success
I20260811 06:17:12.880925 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 9b4eb7864cc742929ac1756949b6bec5
I20260811 06:17:12.882974 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_038e2d68e4224ea094b8e2b117fc8550"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.883870 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_038e2d68e4224ea094b8e2b117fc8550 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.886309 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:12.886583 13701 tablet_replica.cc:330] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:12.886636 12944 raft_consensus.cc:482] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.886816 13701 raft_consensus.cc:2229] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:12.886782 12944 raft_consensus.cc:504] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.887120 13701 raft_consensus.cc:2258] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.887404 12944 leader_election.cc:288] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:12.887715 13701 ts_tablet_manager.cc:1905] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.888060 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:12.888341 10658 raft_consensus.cc:2379] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:12.889528 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:12.889817 13983 tablet_replica.cc:330] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:12.890034 13983 raft_consensus.cc:2229] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:12.889894 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fb45a26ce7e4d8c8bf75940a6070752" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.890210 13983 raft_consensus.cc:2258] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:12.890753 13983 ts_tablet_manager.cc:1905] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:12.892710 10813 leader_election.cc:302] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.893275 12944 raft_consensus.cc:3037] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.895709 13701 ts_tablet_manager.cc:1918] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260811 06:17:12.895888 13701 log.cc:1196] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/9b4eb7864cc742929ac1756949b6bec5
I20260811 06:17:12.895967 12944 raft_consensus.cc:2726] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.896375 13701 ts_tablet_manager.cc:1939] T 9b4eb7864cc742929ac1756949b6bec5 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:12.896963 13983 ts_tablet_manager.cc:1918] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260811 06:17:12.899009 13983 log.cc:1196] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/9b4eb7864cc742929ac1756949b6bec5
I20260811 06:17:12.899173 14099 raft_consensus.cc:482] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.899626 13983 ts_tablet_manager.cc:1939] T 9b4eb7864cc742929ac1756949b6bec5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:12.899299 14099 raft_consensus.cc:504] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.900076 14099 leader_election.cc:288] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.900876 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
I20260811 06:17:12.900838 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:12.901055 10923 raft_consensus.cc:2454] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:12.902078 11047 leader_election.cc:302] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:12.902755 14099 raft_consensus.cc:2781] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:12.902891 14099 raft_consensus.cc:482] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:12.903004 14099 raft_consensus.cc:3037] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.903512 14158 tablet.cc:1722] T cd53ac72e2e3450a9f777316742653bc P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:12.905961 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
I20260811 06:17:12.906555 14099 raft_consensus.cc:504] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.907805 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:12.907997 10923 raft_consensus.cc:3037] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:12.911190 10923 raft_consensus.cc:2454] T 67e2683156f8466b8d63b298c9da15c1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:12.911715 11047 leader_election.cc:302] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:12.912000 14100 raft_consensus.cc:2781] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:12.912107 14100 raft_consensus.cc:686] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:12.912318 14100 consensus_queue.cc:237] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.914427 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_7fd40157e59345cf9eae5fb39ae8fbb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.915434 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fd40157e59345cf9eae5fb39ae8fbb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.920691 14099 leader_election.cc:288] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.931775 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_78d16895fbab45cfbb34cd82051d9090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.932780 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78d16895fbab45cfbb34cd82051d9090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.945212 14135 raft_consensus.cc:482] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.945593 14135 raft_consensus.cc:504] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.946957 14135 leader_election.cc:288] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.947582 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.948303 10555 leader_election.cc:341] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.950525 13948 raft_consensus.cc:482] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.952747 13948 raft_consensus.cc:504] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.955147 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b257fa815c634965884deb91f100ff84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.955849 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b257fa815c634965884deb91f100ff84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.955785 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_4aadcfb3f8bd44738eda0c27da5d114f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.956458 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aadcfb3f8bd44738eda0c27da5d114f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.951494 14137 raft_consensus.cc:482] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:12.957535 14137 raft_consensus.cc:504] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:12.958139 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516e3c37321f4c7b9f3373164682a0ff" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.958930 14142 log.cc:924] Time spent T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
W20260811 06:17:12.959506 10555 leader_election.cc:341] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.959937 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:12.960512 10555 leader_election.cc:341] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.963781 13948 leader_election.cc:288] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.964341 14137 leader_election.cc:288] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:12.964848 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_b7174c3119b448089d2fc9657ffe99fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:12.965698 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7174c3119b448089d2fc9657ffe99fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:12.972934 14157 tablet.cc:1722] T cd53ac72e2e3450a9f777316742653bc P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:12.973192 14025 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: acquiring CA information for follower catalog manager: success
I20260811 06:17:12.979034 12726 ts_tablet_manager.cc:1918] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:12.979173 12726 log.cc:1196] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e329d808c59c4f66bbc515d751255e96
W20260811 06:17:12.979272 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 241339us
W20260811 06:17:12.979975 10564 leader_election.cc:341] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:12.980201 10564 leader_election.cc:302] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:12.981843 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516e3c37321f4c7b9f3373164682a0ff" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.981920 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.982080 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:12.982285 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.982241 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.982200 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.982583 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:12.982969 11046 leader_election.cc:341] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:12.983157 11046 leader_election.cc:302] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:12.983654 14100 raft_consensus.cc:2726] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.985427 14162 tablet.cc:1722] T cd53ac72e2e3450a9f777316742653bc P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:12.986945 14137 raft_consensus.cc:2726] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:12.987269 12726 ts_tablet_manager.cc:1939] T e329d808c59c4f66bbc515d751255e96 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:12.989892 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.990363 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 217f60a1ca044af38f9ee9093e021c27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:51 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.990590 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.991143 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.991742 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.985344 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 12971f852ea943b78d967f7672680cad (table default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]) successfully deleted
I20260811 06:17:12.993777 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_374b114001174636a31945bc3948e65d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:13.001291 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.001618 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.006184 11361 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.006356 11361 ts_tablet_manager.cc:1397] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.219s user 0.004s sys 0.021s
I20260811 06:17:13.006539 14100 consensus_queue.cc:1035] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.007202 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.007169 11361 raft_consensus.cc:348] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.007362 11361 raft_consensus.cc:374] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.007412 11361 raft_consensus.cc:729] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.007608 11361 consensus_queue.cc:260] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.008131 11361 ts_tablet_manager.cc:1428] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:13.009598 11362 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.009872 11362 ts_tablet_manager.cc:1397] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.310s user 0.015s sys 0.030s
I20260811 06:17:13.010828 11362 raft_consensus.cc:348] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.011099 11362 raft_consensus.cc:374] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.011343 11362 raft_consensus.cc:729] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.011655 11362 consensus_queue.cc:260] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.012262 11362 ts_tablet_manager.cc:1428] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260811 06:17:13.012600 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_374b114001174636a31945bc3948e65d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:13.015626 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.019385 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.020427 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 4179b777f9dc4169b807aa68521c26ca (DEFAULT_TABLE table=default.Table_48b56fe9266b43b2b4f5ba274f3f8370 [id=f28736fd543b404db0f37a7aed6e8564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.020857 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4179b777f9dc4169b807aa68521c26ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.021394 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.021678 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.022028 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.022763 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.023123 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.023924 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.024528 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:12.995433 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d4f24173958a4a08928d69879e511b4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:13.029152 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4f24173958a4a08928d69879e511b4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:13.029953 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.036037 12726 tablet_replica.cc:330] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.036285 12726 raft_consensus.cc:2229] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.036477 12726 raft_consensus.cc:2258] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.036962 11361 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:13.014866 11656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 94) took 2983 ms (client timeout 1000 ms). Trace:
I20260811 06:17:13.018863 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:13.042168 11684 catalog_manager.cc:5495] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:13.042975 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:13.043380 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.043762 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_d4486408cf04456dab448807e8c08e90 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 2 got 0
I20260811 06:17:13.044377 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:13.044461 14163 consensus_queue.cc:1035] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.044616 11684 catalog_manager.cc:5495] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:13.045077 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:13.047839 11684 catalog_manager.cc:5495] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:13.048158 11362 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.048859 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:13.049832 11362 tablet_bootstrap.cc:654] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.052237 14099 consensus_queue.cc:1035] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:13.052703 11656 rpcz_store.cc:269] 0811 06:17:10.031060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:10.259858 (+228798us) service_pool.cc:227] Handling call
0811 06:17:13.014695 (+2754837us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12531,"reported_tablets":191}
I20260811 06:17:13.053527 12726 ts_tablet_manager.cc:1905] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.054919 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 4179b777f9dc4169b807aa68521c26ca (DEFAULT_TABLE table=default.Table_48b56fe9266b43b2b4f5ba274f3f8370 [id=f28736fd543b404db0f37a7aed6e8564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.055330 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4179b777f9dc4169b807aa68521c26ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.066044 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_f343e73772b34724840390189eba1076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:13.067135 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f343e73772b34724840390189eba1076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:13.072062 10864 tablet_service.cc:1467] Processing CreateTablet for tablet b16734e67bd5446e86239743c4619515 (DEFAULT_TABLE table=default.Table_448d0fedf54f4ddead773973ba6320d9 [id=645fab4f366645e3922ffcf602e83862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.072218 11655 master_service.cc:946] ReplaceTablet: received request to replace tablet 8e721083b8b2428bbea6b9e87a4a6e14 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:13.072569 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b16734e67bd5446e86239743c4619515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.073916 11361 tablet_bootstrap.cc:654] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.075330 14135 raft_consensus.cc:482] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.075482 14135 raft_consensus.cc:504] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.076109 14135 leader_election.cc:288] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.076817 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04766ede03342efb594aaf081e112af" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:13.077382 10555 leader_election.cc:341] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.077435 11119 tablet_service.cc:1467] Processing CreateTablet for tablet b16734e67bd5446e86239743c4619515 (DEFAULT_TABLE table=default.Table_448d0fedf54f4ddead773973ba6320d9 [id=645fab4f366645e3922ffcf602e83862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.077935 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b16734e67bd5446e86239743c4619515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.082141 14025 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 06:17:13.083912 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_1a21661604a846fbb20a20cb4a76a4f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:13.084529 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.086501 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.086895 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.087500 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.087596 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 4179b777f9dc4169b807aa68521c26ca (DEFAULT_TABLE table=default.Table_48b56fe9266b43b2b4f5ba274f3f8370 [id=f28736fd543b404db0f37a7aed6e8564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.088025 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4179b777f9dc4169b807aa68521c26ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.090463 14135 raft_consensus.cc:482] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.090600 14135 raft_consensus.cc:504] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.091173 14135 leader_election.cc:288] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.092185 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.094736 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:13.094930 10658 raft_consensus.cc:2454] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:13.096107 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e2683156f8466b8d63b298c9da15c1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:13.096321 10658 raft_consensus.cc:3037] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:13.097730 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a21661604a846fbb20a20cb4a76a4f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:13.101567 12726 ts_tablet_manager.cc:1918] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:13.103509 11096 tablet_service.cc:1467] Processing CreateTablet for tablet ade4737d603a4db18ceb9d1de896b3bb (DEFAULT_TABLE table=default.Table_d1fe3a300abc4684b30275587b5bad38 [id=763419e2e7b840b8beb066bf56c0fc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.103967 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade4737d603a4db18ceb9d1de896b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.106788 13571 raft_consensus.cc:482] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.107061 13571 raft_consensus.cc:504] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.108003 13571 leader_election.cc:288] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:13.108078 12726 log.cc:1196] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/516e3c37321f4c7b9f3373164682a0ff
W20260811 06:17:13.109143 10810 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:13.109663 12726 ts_tablet_manager.cc:1939] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:13.109931 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:13.112181 10555 leader_election.cc:341] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:13.113276 10813 leader_election.cc:341] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:13.113462 10813 leader_election.cc:302] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.113765 13571 raft_consensus.cc:2726] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:13.118966 12726 tablet_replica.cc:330] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.118901 11653 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d2138c3da06245bcbed00c854667b9ac" } modify_external_catalogs: true
I20260811 06:17:13.119190 12726 raft_consensus.cc:2229] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.119213 11653 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d2138c3da06245bcbed00c854667b9ac" } modify_external_catalogs: true
I20260811 06:17:13.119352 12726 raft_consensus.cc:2258] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.119953 12726 ts_tablet_manager.cc:1905] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.132107 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e329d808c59c4f66bbc515d751255e96 (table default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]) successfully deleted
W20260811 06:17:13.132740 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because the tablet was not found. No further retry: Not found: Tablet not found: dc4a4e8bfe3b43aeb0c1617dcb29e685
W20260811 06:17:13.133499 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2fcf7c7a470144c0a084aebc2032d896 because the tablet was not found. No further retry: Not found: Tablet not found: 2fcf7c7a470144c0a084aebc2032d896
W20260811 06:17:13.135098 11046 leader_election.cc:341] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
I20260811 06:17:13.135231 11046 leader_election.cc:302] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:13.135584 11046 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:13.135681 11046 leader_election.cc:302] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:13.136480 10564 leader_election.cc:341] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.136530 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04766ede03342efb594aaf081e112af" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.136595 10564 leader_election.cc:302] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.101807 10658 raft_consensus.cc:2454] T 67e2683156f8466b8d63b298c9da15c1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:13.136929 14135 raft_consensus.cc:2726] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:13.136950 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.137286 14099 raft_consensus.cc:2726] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.137297 10564 leader_election.cc:341] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.137382 10564 leader_election.cc:302] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.137428 14099 raft_consensus.cc:2726] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.137527 10564 raft_consensus.cc:2670] T 516e3c37321f4c7b9f3373164682a0ff P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260811 06:17:13.137549 14099 consensus_queue.cc:1035] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:13.138109 10564 leader_election.cc:341] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.138202 10564 leader_election.cc:302] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.142870 12726 ts_tablet_manager.cc:1918] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:13.142946 11361 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.143064 11361 ts_tablet_manager.cc:1397] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.106s user 0.001s sys 0.004s
I20260811 06:17:13.143076 12726 log.cc:1196] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a04766ede03342efb594aaf081e112af
I20260811 06:17:13.143544 12726 ts_tablet_manager.cc:1939] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:13.144006 11361 raft_consensus.cc:348] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.144272 11361 raft_consensus.cc:374] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.144333 11361 raft_consensus.cc:729] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.144510 12726 tablet_replica.cc:330] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.144556 11361 consensus_queue.cc:260] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.144752 12726 raft_consensus.cc:2229] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.145174 11361 ts_tablet_manager.cc:1428] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:13.145450 11361 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.148229 11361 tablet_bootstrap.cc:654] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.149825 13282 raft_consensus.cc:482] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.149955 13282 raft_consensus.cc:504] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:13.150540 13282 leader_election.cc:288] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:13.153870 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:13.162189 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:13.162654 11584 catalog_manager.cc:4914] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): alter failed for tablet 61114d1bcdb94af7b6c55b0331accee5 (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]),no further retry: Not found: Tablet not found: 61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:13.164546 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 516e3c37321f4c7b9f3373164682a0ff (table default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]) successfully deleted
W20260811 06:17:13.164896 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:13.172577 14099 consensus_queue.cc:1035] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.173746 14099 consensus_queue.cc:1035] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.174631 11361 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.174764 11361 ts_tablet_manager.cc:1397] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.012s
I20260811 06:17:13.175226 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet e00a72f178f74ca59cc073fe78c99373 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:13.175539 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:13.176249 11361 raft_consensus.cc:348] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.176559 11361 raft_consensus.cc:374] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.176620 11361 raft_consensus.cc:729] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.176802 11361 consensus_queue.cc:260] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:13.176270 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:13.180128 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because the tablet was not found. No further retry: Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
W20260811 06:17:13.180516 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:13.180940 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:13.186002 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:13.186779 11655 catalog_manager.cc:6565] ReplaceTablet: tablet 8e721083b8b2428bbea6b9e87a4a6e14 deleted and replaced by tablet 2707979dce35428aa7145e9b34959989
I20260811 06:17:13.188735 11655 master_service.cc:946] ReplaceTablet: received request to replace tablet e4171d257dd6453a9159c59ae713b2e0 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:13.189121 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_03a56dbcc387459a9a6ae4fdfb454c6a" } new_table_name: "default.Table_06207def0d7646999e471424624de3fd" modify_external_catalogs: true
W20260811 06:17:13.195631 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 217f60a1ca044af38f9ee9093e021c27 because the tablet was not found. No further retry: Not found: Tablet not found: 217f60a1ca044af38f9ee9093e021c27
W20260811 06:17:13.196201 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:13.196530 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
W20260811 06:17:13.196871 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because the tablet was not found. No further retry: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
W20260811 06:17:13.197228 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
W20260811 06:17:13.197609 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:13.198072 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because the tablet was not found. No further retry: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:13.204715 11361 ts_tablet_manager.cc:1428] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.030s user 0.011s sys 0.000s
I20260811 06:17:13.206038 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:13.206881 11655 catalog_manager.cc:6565] ReplaceTablet: tablet e4171d257dd6453a9159c59ae713b2e0 deleted and replaced by tablet a815299e01bb4e3dabe0627edb86c3a6
I20260811 06:17:13.207350 11655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c8f687b8d15f43d2a993c347c59f46cb" } modify_external_catalogs: true
I20260811 06:17:13.207719 11655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c8f687b8d15f43d2a993c347c59f46cb" } modify_external_catalogs: true
I20260811 06:17:13.208214 11361 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.211299 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 with delete_type TABLET_DATA_DELETED (replaced by tablet 2707979dce35428aa7145e9b34959989) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:13.211548 13701 tablet_replica.cc:330] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:13.211740 13701 raft_consensus.cc:2229] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:13.211903 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:13.212033 13701 raft_consensus.cc:2258] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.212729 13701 ts_tablet_manager.cc:1905] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.217602 11361 tablet_bootstrap.cc:654] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.217927 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet e4171d257dd6453a9159c59ae713b2e0 with delete_type TABLET_DATA_DELETED (replaced by tablet a815299e01bb4e3dabe0627edb86c3a6) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:13.220705 13701 ts_tablet_manager.cc:1918] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:13.220881 13701 log.cc:1196] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:13.221271 13701 ts_tablet_manager.cc:1939] T 8e721083b8b2428bbea6b9e87a4a6e14 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:13.222218 13701 tablet_replica.cc:330] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:13.223889 13701 raft_consensus.cc:2229] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:13.224761 13701 raft_consensus.cc:2258] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.226038 13701 ts_tablet_manager.cc:1905] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.227124 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]) successfully deleted
I20260811 06:17:13.229465 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:13.230162 11676 catalog_manager.cc:6565] ReplaceTablet: tablet e00a72f178f74ca59cc073fe78c99373 deleted and replaced by tablet 604cba8a4978479cbb15307aeb45a634
I20260811 06:17:13.232811 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:13.233276 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet e8dfa9eb84334e9e86434aa2d9593efd from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:13.233958 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:13.234368 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:13.234661 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:13.235020 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:13.235524 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:13.235867 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:13.236944 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:13.237416 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:13.238368 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:13.239132 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:13.239598 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:13.240008 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:13.240865 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:13.241524 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:13.241921 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:13.242411 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:13.243145 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:13.244103 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 60c3a381b6744b8d989d644f2b643958 (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]). Expected version 2 got 0
I20260811 06:17:13.244556 13701 ts_tablet_manager.cc:1918] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:13.244814 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:13.245276 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:13.246807 11361 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.247277 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:13.247627 11119 tablet_service.cc:1467] Processing CreateTablet for tablet f1778e67efdb46d6b6fca5e283e31e67 (DEFAULT_TABLE table=default.Table_03ea575165d8494da39475cc368ffb4b [id=6ca6cdf406a84531b3f12e40053a5994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.251153 11361 ts_tablet_manager.cc:1397] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.045s user 0.011s sys 0.001s
I20260811 06:17:13.251494 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1778e67efdb46d6b6fca5e283e31e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.251838 11361 raft_consensus.cc:348] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:13.252034 11361 raft_consensus.cc:374] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.252082 11361 raft_consensus.cc:729] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.252274 11361 consensus_queue.cc:260] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:13.252799 11361 ts_tablet_manager.cc:1428] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:13.253225 11361 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.253389 14135 raft_consensus.cc:2726] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.253705 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 115593us
I20260811 06:17:13.253906 12726 raft_consensus.cc:2258] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.254716 12726 ts_tablet_manager.cc:1905] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.254734 11361 tablet_bootstrap.cc:654] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.255897 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 811e63e51151415bb994921facf8db73 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.256295 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e63e51151415bb994921facf8db73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.254021 14135 raft_consensus.cc:482] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.257894 14135 raft_consensus.cc:504] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.258517 14135 leader_election.cc:288] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.266163 12726 ts_tablet_manager.cc:1918] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:13.266377 12726 log.cc:1196] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/5e990aa374204f2b95c08b04121176bc
I20260811 06:17:13.266809 12726 ts_tablet_manager.cc:1939] T 5e990aa374204f2b95c08b04121176bc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:13.267284 13701 log.cc:1196] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:13.268004 13701 ts_tablet_manager.cc:1939] T e4171d257dd6453a9159c59ae713b2e0 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:13.268270 12726 tablet_replica.cc:330] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.268529 12726 raft_consensus.cc:2229] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.268729 12726 raft_consensus.cc:2258] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.269297 12726 ts_tablet_manager.cc:1905] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.271188 13282 raft_consensus.cc:482] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.271324 13282 raft_consensus.cc:504] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.271917 13282 leader_election.cc:288] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.272760 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet e4171d257dd6453a9159c59ae713b2e0 (table default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]) successfully deleted
W20260811 06:17:13.275349 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00a72f178f74ca59cc073fe78c99373 already in progress: creating tablet
W20260811 06:17:13.275764 10564 leader_election.cc:341] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.275897 10564 leader_election.cc:302] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.276141 14135 raft_consensus.cc:2726] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.276664 10564 leader_election.cc:341] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.276784 10564 leader_election.cc:302] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:13.276944 10564 raft_consensus.cc:2670] T a04766ede03342efb594aaf081e112af P 24d29113b2454d9c93e23db3e3dac801: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260811 06:17:13.277576 10564 leader_election.cc:341] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.277684 10564 leader_election.cc:302] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.278555 11119 tablet_service.cc:1467] Processing CreateTablet for tablet c3baecfe602c4e09989cb00cdc4d30c8 (DEFAULT_TABLE table=default.Table_2cdccd111a2c4d3a8ca5d261d5dda356 [id=537f579f8a2f482ab88c6426ac7433c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.279017 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 89c445f0f145454dbfb1600643db77ad (DEFAULT_TABLE table=default.Table_502e2afdd41247c0b5d88a6826b41e02 [id=3f549c60694946bba8af1d6e0d977ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.279805 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3baecfe602c4e09989cb00cdc4d30c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.280697 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89c445f0f145454dbfb1600643db77ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:13.289676 11365 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.697s user 0.020s sys 0.029s
W20260811 06:17:13.289806 11365 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.697s user 0.020s sys 0.029s
I20260811 06:17:13.289881 11361 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.290023 11361 ts_tablet_manager.cc:1397] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.010s
I20260811 06:17:13.290736 11365 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:13.290879 11365 ts_tablet_manager.cc:1397] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.701s user 0.022s sys 0.029s
I20260811 06:17:13.290793 11361 raft_consensus.cc:348] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.291011 11361 raft_consensus.cc:374] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.291066 11361 raft_consensus.cc:729] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.291257 11361 consensus_queue.cc:260] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.291774 11361 ts_tablet_manager.cc:1428] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:13.292040 11361 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.293437 11361 tablet_bootstrap.cc:654] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.302404 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 18b082ed126e41afbac160ebba87e769 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.302826 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b082ed126e41afbac160ebba87e769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.306147 11121 tablet_service.cc:1467] Processing CreateTablet for tablet c72370f089da4d56a335daa2e80ee90a (DEFAULT_TABLE table=default.Table_443a5cc509444e14a1cc048dca1e2e44 [id=1ee3e9fa37694c228aac8164914f9d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.306718 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72370f089da4d56a335daa2e80ee90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.308696 14135 raft_consensus.cc:2726] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:13.311829 13732 consensus_queue.cc:1035] T 4ef97b47809940f4bfee89cc0515edcf P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.318049 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 14c6dd325c344ebbbf787ea33fb5b8b7 (DEFAULT_TABLE table=default.Table_bf06a85d85b9455682bba38518caf4b0 [id=85fa2d6c7c2d4235ae958e30d33d1127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.318527 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14c6dd325c344ebbbf787ea33fb5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.319598 11365 raft_consensus.cc:348] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.320447 11365 raft_consensus.cc:374] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.320672 11365 raft_consensus.cc:729] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.321028 11119 tablet_service.cc:1467] Processing CreateTablet for tablet d391c0c5b9f04ec5b19d119ffd93ec80 (DEFAULT_TABLE table=default.Table_d6cfa0edc19a4324b197f2f3ef57746d [id=290f70618a7b4bc28bca954fa520ea42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.321492 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391c0c5b9f04ec5b19d119ffd93ec80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.321053 11365 consensus_queue.cc:260] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:13.322341 11047 consensus_peers.cc:487] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5c3e243e72f4cffb3318246ab428bd6. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:13.326432 11365 ts_tablet_manager.cc:1428] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.035s user 0.000s sys 0.003s
I20260811 06:17:13.328025 11365 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:13.329437 10864 tablet_service.cc:1467] Processing CreateTablet for tablet ade4737d603a4db18ceb9d1de896b3bb (DEFAULT_TABLE table=default.Table_d1fe3a300abc4684b30275587b5bad38 [id=763419e2e7b840b8beb066bf56c0fc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.332505 10879 tablet_service.cc:1467] Processing CreateTablet for tablet f1778e67efdb46d6b6fca5e283e31e67 (DEFAULT_TABLE table=default.Table_03ea575165d8494da39475cc368ffb4b [id=6ca6cdf406a84531b3f12e40053a5994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.337335 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade4737d603a4db18ceb9d1de896b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.337639 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1778e67efdb46d6b6fca5e283e31e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.339104 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:13.339599 10860 tablet_service.cc:1467] Processing CreateTablet for tablet d391c0c5b9f04ec5b19d119ffd93ec80 (DEFAULT_TABLE table=default.Table_d6cfa0edc19a4324b197f2f3ef57746d [id=290f70618a7b4bc28bca954fa520ea42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.340022 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391c0c5b9f04ec5b19d119ffd93ec80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.340277 10880 tablet_service.cc:1467] Processing CreateTablet for tablet 14c6dd325c344ebbbf787ea33fb5b8b7 (DEFAULT_TABLE table=default.Table_bf06a85d85b9455682bba38518caf4b0 [id=85fa2d6c7c2d4235ae958e30d33d1127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.340344 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 811e63e51151415bb994921facf8db73 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.340634 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14c6dd325c344ebbbf787ea33fb5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.340737 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 89c445f0f145454dbfb1600643db77ad (DEFAULT_TABLE table=default.Table_502e2afdd41247c0b5d88a6826b41e02 [id=3f549c60694946bba8af1d6e0d977ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.341106 10858 tablet_service.cc:1467] Processing CreateTablet for tablet c3baecfe602c4e09989cb00cdc4d30c8 (DEFAULT_TABLE table=default.Table_2cdccd111a2c4d3a8ca5d261d5dda356 [id=537f579f8a2f482ab88c6426ac7433c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.341593 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 18b082ed126e41afbac160ebba87e769 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.341953 10884 tablet_service.cc:1467] Processing CreateTablet for tablet c72370f089da4d56a335daa2e80ee90a (DEFAULT_TABLE table=default.Table_443a5cc509444e14a1cc048dca1e2e44 [id=1ee3e9fa37694c228aac8164914f9d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.342361 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 9f44d4df9df7407890790c80fc71f8cb (DEFAULT_TABLE table=default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.313391 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.342566 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet e4171d257dd6453a9159c59ae713b2e0 with delete_type TABLET_DATA_DELETED (replaced by tablet a815299e01bb4e3dabe0627edb86c3a6) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:13.342706 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89c445f0f145454dbfb1600643db77ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.342772 13983 tablet_replica.cc:330] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:13.342960 13983 raft_consensus.cc:2229] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.342999 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 with delete_type TABLET_DATA_DELETED (replaced by tablet 2707979dce35428aa7145e9b34959989) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:13.343120 13983 raft_consensus.cc:2258] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.343663 13983 ts_tablet_manager.cc:1905] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.343953 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:13.344211 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05867781f7954fb280cc83b2a13d0d61" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.344682 13282 raft_consensus.cc:482] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.344830 13282 raft_consensus.cc:504] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.345432 13282 leader_election.cc:288] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:13.345613 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00a72f178f74ca59cc073fe78c99373 already in progress: creating tablet
I20260811 06:17:13.346156 11361 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.346288 11361 ts_tablet_manager.cc:1397] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.006s
I20260811 06:17:13.347318 11361 raft_consensus.cc:348] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.347600 11361 raft_consensus.cc:374] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.347656 11362 tablet_bootstrap.cc:492] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.347671 11361 raft_consensus.cc:729] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.347783 11362 ts_tablet_manager.cc:1397] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.300s user 0.033s sys 0.032s
I20260811 06:17:13.347853 11361 consensus_queue.cc:260] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.348366 11361 ts_tablet_manager.cc:1428] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:13.348753 11361 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.349938 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3baecfe602c4e09989cb00cdc4d30c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.356215 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b082ed126e41afbac160ebba87e769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.357626 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f44d4df9df7407890790c80fc71f8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.358054 11361 tablet_bootstrap.cc:654] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:13.360088 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 50409.3us
I20260811 06:17:13.362142 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72370f089da4d56a335daa2e80ee90a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:13.363240 11588 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 369a031402a24a6a91f0c7ba8a5f288a consensus state has no leader
I20260811 06:17:13.368736 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e63e51151415bb994921facf8db73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.369269 11361 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.369419 11361 ts_tablet_manager.cc:1397] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.004s
I20260811 06:17:13.370182 11361 raft_consensus.cc:348] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:13.370421 11361 raft_consensus.cc:374] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.370472 11361 raft_consensus.cc:729] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.370644 11361 consensus_queue.cc:260] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:13.371166 11361 ts_tablet_manager.cc:1428] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:13.372211 11362 raft_consensus.cc:348] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.372426 11362 raft_consensus.cc:374] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.372484 11362 raft_consensus.cc:729] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.372658 11362 consensus_queue.cc:260] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.373186 11362 ts_tablet_manager.cc:1428] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260811 06:17:13.374330 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:13.374997 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:13.375131 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.375613 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:13.376924 11361 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.383972 11361 tablet_bootstrap.cc:654] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:13.395514 11047 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
W20260811 06:17:13.395936 11047 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:13.397534 10813 consensus_peers.cc:487] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e721083b8b2428bbea6b9e87a4a6e14. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:13.403371 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 77f7f527d81948ffa5513c88ca78ba28 (DEFAULT_TABLE table=default.Table_f0b55e2b448349c5b236feb929d9cf6c [id=26ecfc3813364f37a7d2f9776ab1f5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.403777 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:13.404570 11157 raft_consensus.cc:3037] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.415983 13983 ts_tablet_manager.cc:1918] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:13.416268 13983 log.cc:1196] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:13.416791 13983 ts_tablet_manager.cc:1939] T e4171d257dd6453a9159c59ae713b2e0 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:13.421985 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:13.423938 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 9f44d4df9df7407890790c80fc71f8cb (DEFAULT_TABLE table=default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.424412 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f44d4df9df7407890790c80fc71f8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.428131 11362 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.432418 11361 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.432608 11361 ts_tablet_manager.cc:1397] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.005s
I20260811 06:17:13.434165 11361 raft_consensus.cc:348] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.434399 11361 raft_consensus.cc:374] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.434463 11361 raft_consensus.cc:729] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.434645 11361 consensus_queue.cc:260] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.435376 11361 ts_tablet_manager.cc:1428] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:13.438423 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 77f7f527d81948ffa5513c88ca78ba28 (DEFAULT_TABLE table=default.Table_f0b55e2b448349c5b236feb929d9cf6c [id=26ecfc3813364f37a7d2f9776ab1f5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.438894 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f7f527d81948ffa5513c88ca78ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.439452 11361 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.442690 11361 tablet_bootstrap.cc:654] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.445425 14108 raft_consensus.cc:482] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.445605 14108 raft_consensus.cc:504] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.445801 12944 raft_consensus.cc:482] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.450459 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:13.450970 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:13.451486 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:13.452090 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:13.452716 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:13.457765 14119 raft_consensus.cc:482] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.462772 14108 leader_election.cc:288] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.445941 12944 raft_consensus.cc:504] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.465677 12944 leader_election.cc:288] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:13.465951 11361 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.466106 11361 ts_tablet_manager.cc:1397] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.009s
I20260811 06:17:13.467410 11361 raft_consensus.cc:348] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.467752 11361 raft_consensus.cc:374] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.467814 11361 raft_consensus.cc:729] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.457932 14119 raft_consensus.cc:504] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.467993 11361 consensus_queue.cc:260] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.468462 14119 leader_election.cc:288] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:13.468530 11361 ts_tablet_manager.cc:1428] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:13.469209 11361 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.470695 11362 tablet_bootstrap.cc:654] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.471664 13282 raft_consensus.cc:482] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.471789 13282 raft_consensus.cc:504] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.472400 13282 leader_election.cc:288] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.483407 13983 tablet_replica.cc:330] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:13.483632 13983 raft_consensus.cc:2229] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:13.483950 13983 raft_consensus.cc:2258] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.484571 13983 ts_tablet_manager.cc:1905] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.484601 11362 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.484741 11362 ts_tablet_manager.cc:1397] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.057s user 0.000s sys 0.004s
I20260811 06:17:13.485335 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f7f527d81948ffa5513c88ca78ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.485999 11362 raft_consensus.cc:348] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.486181 11362 raft_consensus.cc:374] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.486223 11362 raft_consensus.cc:729] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.486388 11362 consensus_queue.cc:260] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.486953 11362 ts_tablet_manager.cc:1428] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:13.489214 11362 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.491624 11362 tablet_bootstrap.cc:654] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.491634 11361 tablet_bootstrap.cc:654] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.501165 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:13.504777 13983 ts_tablet_manager.cc:1918] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:13.504962 13983 log.cc:1196] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:13.505363 13983 ts_tablet_manager.cc:1939] T 8e721083b8b2428bbea6b9e87a4a6e14 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:13.509739 11361 tablet_bootstrap.cc:492] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.509999 11361 ts_tablet_manager.cc:1397] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.005s
I20260811 06:17:13.511605 11361 raft_consensus.cc:348] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.511933 11361 raft_consensus.cc:374] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.512044 11361 raft_consensus.cc:729] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.512331 11361 consensus_queue.cc:260] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.516320 11361 ts_tablet_manager.cc:1428] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:13.518018 11361 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.525936 11361 tablet_bootstrap.cc:654] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.533938 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b5bb21784e34ad7addf144e0b10a444" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.536213 11361 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.536377 11361 ts_tablet_manager.cc:1397] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.005s
I20260811 06:17:13.537492 11361 raft_consensus.cc:348] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.537755 11361 raft_consensus.cc:374] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.537832 11361 raft_consensus.cc:729] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.538084 11361 consensus_queue.cc:260] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.539908 13282 raft_consensus.cc:482] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.540032 13282 raft_consensus.cc:504] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.540637 13282 leader_election.cc:288] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.540964 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.541193 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05867781f7954fb280cc83b2a13d0d61" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.541352 11158 raft_consensus.cc:2454] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:13.541934 11361 ts_tablet_manager.cc:1428] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 06:17:13.542241 11361 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.493099 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet e4171d257dd6453a9159c59ae713b2e0 (table default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]) successfully deleted
W20260811 06:17:13.550369 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 57241.6us
I20260811 06:17:13.550865 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]) successfully deleted
I20260811 06:17:13.551666 11361 tablet_bootstrap.cc:654] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.554024 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.551725 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:13.555892 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 with delete_type TABLET_DATA_DELETED (replaced by tablet 2707979dce35428aa7145e9b34959989) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:13.556659 10813 leader_election.cc:341] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.557273 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:13.557703 10813 leader_election.cc:302] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.559875 13571 raft_consensus.cc:2781] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:13.560060 13571 raft_consensus.cc:482] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:13.560209 13571 raft_consensus.cc:3037] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.556078 10623 tablet_service.cc:1467] Processing CreateTablet for tablet ade4737d603a4db18ceb9d1de896b3bb (DEFAULT_TABLE table=default.Table_d1fe3a300abc4684b30275587b5bad38 [id=763419e2e7b840b8beb066bf56c0fc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.561230 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ade4737d603a4db18ceb9d1de896b3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.563475 12726 ts_tablet_manager.cc:1918] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260811 06:17:13.563598 12726 log.cc:1196] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/9b4eb7864cc742929ac1756949b6bec5
I20260811 06:17:13.563984 12726 ts_tablet_manager.cc:1939] T 9b4eb7864cc742929ac1756949b6bec5 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:13.565066 10608 tablet_service.cc:1467] Processing CreateTablet for tablet b16734e67bd5446e86239743c4619515 (DEFAULT_TABLE table=default.Table_448d0fedf54f4ddead773973ba6320d9 [id=645fab4f366645e3922ffcf602e83862]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.566105 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet e4171d257dd6453a9159c59ae713b2e0 with delete_type TABLET_DATA_DELETED (replaced by tablet a815299e01bb4e3dabe0627edb86c3a6) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:13.561484 11047 leader_election.cc:341] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.567042 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:13.571755 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b16734e67bd5446e86239743c4619515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.572221 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet cd53ac72e2e3450a9f777316742653bc (table default.Table_d4486408cf04456dab448807e8c08e90 [id=5c3567ca43b14ae78bd7df4dc89d4733]). Expected version 2 got 0
I20260811 06:17:13.572676 11683 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:13.590026 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.591323 11365 tablet_bootstrap.cc:654] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:13.593434 11047 leader_election.cc:341] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.595685 10632 tablet_service.cc:1467] Processing CreateTablet for tablet f1778e67efdb46d6b6fca5e283e31e67 (DEFAULT_TABLE table=default.Table_03ea575165d8494da39475cc368ffb4b [id=6ca6cdf406a84531b3f12e40053a5994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.596567 10610 tablet_service.cc:1467] Processing CreateTablet for tablet 811e63e51151415bb994921facf8db73 (DEFAULT_TABLE table=default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.597012 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e63e51151415bb994921facf8db73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.596949 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 89c445f0f145454dbfb1600643db77ad (DEFAULT_TABLE table=default.Table_502e2afdd41247c0b5d88a6826b41e02 [id=3f549c60694946bba8af1d6e0d977ce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.597385 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89c445f0f145454dbfb1600643db77ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.597883 10626 tablet_service.cc:1467] Processing CreateTablet for tablet c3baecfe602c4e09989cb00cdc4d30c8 (DEFAULT_TABLE table=default.Table_2cdccd111a2c4d3a8ca5d261d5dda356 [id=537f579f8a2f482ab88c6426ac7433c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.598001 10629 tablet_service.cc:1467] Processing CreateTablet for tablet c72370f089da4d56a335daa2e80ee90a (DEFAULT_TABLE table=default.Table_443a5cc509444e14a1cc048dca1e2e44 [id=1ee3e9fa37694c228aac8164914f9d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.598194 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3baecfe602c4e09989cb00cdc4d30c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.598332 10629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72370f089da4d56a335daa2e80ee90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.598788 10606 tablet_service.cc:1467] Processing CreateTablet for tablet d391c0c5b9f04ec5b19d119ffd93ec80 (DEFAULT_TABLE table=default.Table_d6cfa0edc19a4324b197f2f3ef57746d [id=290f70618a7b4bc28bca954fa520ea42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.599344 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391c0c5b9f04ec5b19d119ffd93ec80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.602154 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1778e67efdb46d6b6fca5e283e31e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.602092 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 14c6dd325c344ebbbf787ea33fb5b8b7 (DEFAULT_TABLE table=default.Table_bf06a85d85b9455682bba38518caf4b0 [id=85fa2d6c7c2d4235ae958e30d33d1127]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.602531 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14c6dd325c344ebbbf787ea33fb5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.606055 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 18b082ed126e41afbac160ebba87e769 (DEFAULT_TABLE table=default.Table_2ff0844e55e44d41a704db6541346e95 [id=7c7244b238754a909d1b79c295e83de3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.606626 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 9f44d4df9df7407890790c80fc71f8cb (DEFAULT_TABLE table=default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.608898 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:13.609117 10663 raft_consensus.cc:2454] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:13.611121 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b082ed126e41afbac160ebba87e769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.611743 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f44d4df9df7407890790c80fc71f8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:13.641976 14172 raft_consensus.cc:482] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.642150 14172 raft_consensus.cc:504] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.642899 14172 leader_election.cc:288] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.646400 13571 raft_consensus.cc:504] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.647585 13571 leader_election.cc:288] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:13.650193 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.650678 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]) successfully deleted
I20260811 06:17:13.650949 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:13.654645 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.652091 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 77f7f527d81948ffa5513c88ca78ba28 (DEFAULT_TABLE table=default.Table_f0b55e2b448349c5b236feb929d9cf6c [id=26ecfc3813364f37a7d2f9776ab1f5b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:13.655225 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f7f527d81948ffa5513c88ca78ba28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:13.655611 10810 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
W20260811 06:17:13.655953 10810 consensus_peers.cc:487] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:13.656152 10810 leader_election.cc:302] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.657019 14163 raft_consensus.cc:2781] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:13.657099 14163 raft_consensus.cc:482] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:13.657157 14163 raft_consensus.cc:3037] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:13.663260 10555 leader_election.cc:341] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.663856 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05867781f7954fb280cc83b2a13d0d61" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:13.664045 11158 raft_consensus.cc:3037] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.664583 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12971f852ea943b78d967f7672680cad" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.664785 10921 raft_consensus.cc:2454] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:13.667042 11047 leader_election.cc:302] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.667315 13282 raft_consensus.cc:2781] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:13.667352 11158 raft_consensus.cc:2454] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:13.667389 13282 raft_consensus.cc:482] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:13.667446 13282 raft_consensus.cc:3037] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:13.667521 10813 consensus_peers.cc:487] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:13.668148 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
I20260811 06:17:13.668483 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 5e990aa374204f2b95c08b04121176bc (table default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]) successfully deleted
I20260811 06:17:13.670028 13282 raft_consensus.cc:504] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:13.670604 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:13.670739 13282 leader_election.cc:288] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:13.670905 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 916b91088d7d4024a02214c958c0825b because the tablet was not found. No further retry: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
I20260811 06:17:13.671119 11365 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:13.671183 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because the tablet was not found. No further retry: Not found: Tablet not found: 2b0ae9a1d3b74c3985637439819b63ef
I20260811 06:17:13.671252 11365 ts_tablet_manager.cc:1397] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.343s user 0.003s sys 0.007s
W20260811 06:17:13.671398 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because the tablet was not found. No further retry: Not found: Tablet not found: 6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:13.671702 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 9b4eb7864cc742929ac1756949b6bec5 (table default.Table_33b9f31254094f76a6490edc033c7d2c [id=8444a45079b34969a38481a4b00c1352]) successfully deleted
W20260811 06:17:13.672047 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because the tablet was not found. No further retry: Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
W20260811 06:17:13.672581 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 14a36a644dc4491dad838ce4e19793ab because the tablet was not found. No further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
I20260811 06:17:13.673815 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet a25398c10a134356ac21b8a356eba46c
I20260811 06:17:13.674459 11663 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 142) took 1401 ms. Trace:
I20260811 06:17:13.674690 11663 rpcz_store.cc:276] 0811 06:17:12.272990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:12.358656 (+ 85666us) service_pool.cc:227] Handling call
0811 06:17:12.359184 (+ 528us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:12.359332 (+ 148us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:12.359424 (+ 92us) catalog_manager.cc:2761] Locking tablets
0811 06:17:12.947854 (+588430us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:12.957364 (+ 9510us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:12.957465 (+ 101us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:13.658100 (+700635us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:13.674311 (+ 16211us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:12.952143 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.952258 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.952263 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.952265 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:12.952374 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.952386 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.952390 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:12.952496 (+ 106us) tablet.cc:699] Row locks acquired
0811 06:17:12.952498 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.952532 (+ 34us) write_op.cc:270] Start()
0811 06:17:12.952561 (+ 29us) write_op.cc:276] Timestamp: P: 1786429032952513 usec, L: 0
0811 06:17:12.952565 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.952722 (+ 157us) log.cc:842] Serialized 728 byte log entry
0811 06:17:12.956706 (+ 3984us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.956830 (+ 124us) write_op.cc:301] APPLY: starting
0811 06:17:12.956844 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.956885 (+ 41us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.956916 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.956984 (+ 68us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.957016 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:12.957022 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.957096 (+ 74us) log.cc:842] Serialized 29 byte log entry
0811 06:17:12.957162 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.957183 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:12.957189 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.957243 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.957246 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":470,"apply.run_wall_time_us":469,"num_ops":2,"prepare.queue_time_us":3556,"prepare.run_cpu_time_us":689,"prepare.run_wall_time_us":2450,"raft.queue_time_us":34,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"replication_time_us":4120}]]}
I20260811 06:17:13.677109 10813 leader_election.cc:302] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.677446 12944 raft_consensus.cc:2781] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:13.677564 12944 raft_consensus.cc:686] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:13.677829 12944 consensus_queue.cc:237] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.680415 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:13.681226 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:13.682765 10555 leader_election.cc:341] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.687553 12726 tablet_replica.cc:330] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.687765 12726 raft_consensus.cc:2229] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.687934 12726 raft_consensus.cc:2258] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.688494 12726 ts_tablet_manager.cc:1905] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.692260 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12971f852ea943b78d967f7672680cad" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:13.692502 10923 raft_consensus.cc:3037] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.694778 14163 raft_consensus.cc:504] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.697860 14163 leader_election.cc:288] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:13.698369 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:13.700260 10813 leader_election.cc:341] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.706562 11362 tablet_bootstrap.cc:492] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.706725 11362 ts_tablet_manager.cc:1397] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.218s user 0.046s sys 0.076s
I20260811 06:17:13.707571 10923 raft_consensus.cc:2454] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:13.712977 11047 leader_election.cc:302] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.713773 13282 raft_consensus.cc:2781] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:13.707988 11362 raft_consensus.cc:348] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.714520 11362 raft_consensus.cc:374] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.714623 11362 raft_consensus.cc:729] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.714454 13282 raft_consensus.cc:686] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:13.714864 11362 consensus_queue.cc:260] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.715114 13282 consensus_queue.cc:237] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.715651 11362 ts_tablet_manager.cc:1428] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:17:13.715952 11362 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.719257 11362 tablet_bootstrap.cc:654] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.732318 11362 tablet_bootstrap.cc:492] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.732492 11362 ts_tablet_manager.cc:1397] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s
I20260811 06:17:13.734612 14220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a36d6d06a0cb4489b5014178b9973219)
I20260811 06:17:13.735524 11361 tablet_bootstrap.cc:492] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.735669 11361 ts_tablet_manager.cc:1397] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.193s user 0.000s sys 0.006s
I20260811 06:17:13.736013 14220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:13.736858 11361 raft_consensus.cc:348] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.737152 11361 raft_consensus.cc:374] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.737218 11361 raft_consensus.cc:729] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.737398 11361 consensus_queue.cc:260] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.738214 11361 ts_tablet_manager.cc:1428] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:13.738513 11361 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:13.739224 14220 leader_election.cc:288] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9ff4bfd7a38d4d999137c09f50fe4c57 (127.9.203.126:33303), a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327)
I20260811 06:17:13.740343 10114 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 5 candidate_status { last_received { term: 4 index: 760 } } ignore_live_leader: false dest_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" is_pre_election: true
I20260811 06:17:13.742805 11362 raft_consensus.cc:348] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.743062 11362 raft_consensus.cc:374] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.743119 11362 raft_consensus.cc:729] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.743427 11361 tablet_bootstrap.cc:654] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.743341 11362 consensus_queue.cc:260] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.744001 11362 ts_tablet_manager.cc:1428] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260811 06:17:13.746810 11362 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:13.747787 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:13.748127 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 66034.4us
W20260811 06:17:13.748468 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:13.748603 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 67112.4us
I20260811 06:17:13.756636 14221 tablet.cc:1722] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:13.758050 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29fb239be50c4171bdbc75e064555197" candidate_term: 5 candidate_status { last_received { term: 4 index: 760 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:17:13.749739 11362 tablet_bootstrap.cc:654] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.756150 14218 tablet.cc:1722] T 55b38127e97f400f879afc94c0672906 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:13.775833 12749 leader_election.cc:302] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29fb239be50c4171bdbc75e064555197; no voters: 9ff4bfd7a38d4d999137c09f50fe4c57, a36d6d06a0cb4489b5014178b9973219
I20260811 06:17:13.776332 14220 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 29fb239be50c4171bdbc75e064555197 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260811 06:17:13.785704 11365 raft_consensus.cc:348] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.785996 11365 raft_consensus.cc:374] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.786057 11365 raft_consensus.cc:729] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.786253 11365 consensus_queue.cc:260] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.786883 11365 ts_tablet_manager.cc:1428] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.116s user 0.003s sys 0.000s
I20260811 06:17:13.787174 11365 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:13.787425 11362 tablet_bootstrap.cc:492] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.787923 11362 ts_tablet_manager.cc:1397] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.003s
I20260811 06:17:13.790033 11362 raft_consensus.cc:348] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.791046 11362 raft_consensus.cc:374] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.791308 11362 raft_consensus.cc:729] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.791668 11362 consensus_queue.cc:260] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.792735 11362 ts_tablet_manager.cc:1428] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:13.793848 11362 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.796520 14108 consensus_queue.cc:1035] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:13.816294 10810 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 160140us
I20260811 06:17:13.820915 14218 tablet.cc:1722] T da30a4db5b334cf88b01648c336a7ade P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:13.822345 11361 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:13.822494 11361 ts_tablet_manager.cc:1397] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.005s
I20260811 06:17:13.823639 11361 raft_consensus.cc:348] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.823910 11361 raft_consensus.cc:374] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.824041 11361 raft_consensus.cc:729] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.824277 11361 consensus_queue.cc:260] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.824855 11361 ts_tablet_manager.cc:1428] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:13.825120 11361 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:13.828786 10810 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:13.839500 14221 tablet.cc:1722] T da30a4db5b334cf88b01648c336a7ade P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:13.866963 11362 tablet_bootstrap.cc:654] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.884527 12726 ts_tablet_manager.cc:1918] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:13.884635 10029 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu pid 12363
I20260811 06:17:13.884689 12726 log.cc:1196] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:13.885394 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:13.885617 10661 raft_consensus.cc:3037] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.888695 12726 ts_tablet_manager.cc:1939] T 8e721083b8b2428bbea6b9e87a4a6e14 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:13.888717 13282 consensus_queue.cc:1035] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:13.890965 12726 tablet_replica.cc:330] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:13.893961 13282 raft_consensus.cc:482] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.894117 13282 raft_consensus.cc:504] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.894745 13282 leader_election.cc:288] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.896557 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a183d0915a5a48c2a26994d47f6fe266" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:13.897207 11047 leader_election.cc:341] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.891438 10662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b38127e97f400f879afc94c0672906" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:13.896072 11365 tablet_bootstrap.cc:654] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.899092 12726 raft_consensus.cc:2229] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:13.902252 10651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:13.906095 10651 raft_consensus.cc:2454] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:13.906554 12726 raft_consensus.cc:2258] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:13.907636 12726 ts_tablet_manager.cc:1905] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:13.919340 11361 tablet_bootstrap.cc:654] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:13.938189 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet e8dfa9eb84334e9e86434aa2d9593efd
I20260811 06:17:13.938882 11676 catalog_manager.cc:6565] ReplaceTablet: tablet e8dfa9eb84334e9e86434aa2d9593efd deleted and replaced by tablet 167599e794e5436898df2a78c7438d54
I20260811 06:17:13.939100 11676 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 164) took 1010 ms. Trace:
I20260811 06:17:13.939294 11676 rpcz_store.cc:276] 0811 06:17:12.928928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.230347 (+301419us) service_pool.cc:227] Handling call
0811 06:17:13.938994 (+708647us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:13.769337 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:13.769464 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:13.769471 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:13.769473 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:13.769600 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:13.769612 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:13.769618 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:13.769702 (+ 84us) tablet.cc:699] Row locks acquired
0811 06:17:13.769705 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:13.769761 (+ 56us) write_op.cc:270] Start()
0811 06:17:13.769797 (+ 36us) write_op.cc:276] Timestamp: P: 1786429033769714 usec, L: 0
0811 06:17:13.769801 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:13.770158 (+ 357us) log.cc:842] Serialized 625 byte log entry
0811 06:17:13.903358 (+133200us) op_driver.cc:444] REPLICATION: finished
0811 06:17:13.903795 (+ 437us) write_op.cc:301] APPLY: starting
0811 06:17:13.903809 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:13.903867 (+ 58us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:13.903891 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:13.904133 (+ 242us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:13.904275 (+ 142us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:13.904301 (+ 26us) write_op.cc:312] APPLY: finished
0811 06:17:13.904389 (+ 88us) log.cc:842] Serialized 29 byte log entry
0811 06:17:13.904694 (+ 305us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.904733 (+ 39us) write_op.cc:454] Released schema lock
0811 06:17:13.904739 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:13.905207 (+ 468us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.905213 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":808,"apply.run_wall_time_us":1516,"num_ops":2,"prepare.queue_time_us":13663,"prepare.run_cpu_time_us":865,"prepare.run_wall_time_us":902,"replication_time_us":133536}]]}
I20260811 06:17:13.945961 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:13.946841 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
I20260811 06:17:13.947588 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:13.948101 13282 raft_consensus.cc:482] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.948307 13282 raft_consensus.cc:504] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.948984 13282 leader_election.cc:288] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:13.949505 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
I20260811 06:17:13.951232 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1118c96cff4ea387f3d0ee94bef79b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:13.951517 10921 raft_consensus.cc:2454] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:13.951980 11047 leader_election.cc:302] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.952235 13282 raft_consensus.cc:2781] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:13.952307 13282 raft_consensus.cc:482] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:13.952363 13282 raft_consensus.cc:3037] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.955304 13282 raft_consensus.cc:504] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.956204 13282 leader_election.cc:288] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.956982 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1118c96cff4ea387f3d0ee94bef79b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:13.957177 10918 raft_consensus.cc:3037] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.960538 11362 tablet_bootstrap.cc:492] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:13.960723 11362 ts_tablet_manager.cc:1397] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.167s user 0.008s sys 0.003s
I20260811 06:17:13.962577 11362 raft_consensus.cc:348] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.962837 11362 raft_consensus.cc:374] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:13.962901 11362 raft_consensus.cc:729] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:13.963163 10918 raft_consensus.cc:2454] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:13.963106 11362 consensus_queue.cc:260] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.963552 11047 leader_election.cc:302] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:13.964150 11362 ts_tablet_manager.cc:1428] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:13.964419 11362 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:13.964666 13740 raft_consensus.cc:2781] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:13.964779 13740 raft_consensus.cc:686] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:13.965076 13740 consensus_queue.cc:237] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.968875 10661 raft_consensus.cc:2454] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:17:13.972441 11046 leader_election.cc:341] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
I20260811 06:17:13.972574 11046 leader_election.cc:302] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:13.972791 13282 raft_consensus.cc:2726] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.973249 11046 consensus_peers.cc:487] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5c3e243e72f4cffb3318246ab428bd6. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:13.974578 11046 leader_election.cc:341] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:13.974689 11046 leader_election.cc:302] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:13.975088 14100 raft_consensus.cc:2726] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:13.975620 11046 leader_election.cc:302] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:13.976048 14100 raft_consensus.cc:2726] T 55b38127e97f400f879afc94c0672906 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:13.977310 11046 leader_election.cc:341] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
I20260811 06:17:13.981590 13740 consensus_queue.cc:1035] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:13.981603 11046 leader_election.cc:341] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:13.982321 11046 leader_election.cc:302] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:13.983808 11046 leader_election.cc:302] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:13.984122 14100 raft_consensus.cc:2726] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:13.985360 14172 raft_consensus.cc:2781] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:13.985443 14172 raft_consensus.cc:482] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:13.985505 14172 raft_consensus.cc:3037] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:13.987723 14135 raft_consensus.cc:482] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:13.987874 14135 raft_consensus.cc:504] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.988495 14135 leader_election.cc:288] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:13.988693 14172 raft_consensus.cc:504] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.989255 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:13.989475 10564 leader_election.cc:341] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.989509 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:13.981024 10810 leader_election.cc:302] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:13.990593 12944 raft_consensus.cc:2781] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:13.990793 12944 raft_consensus.cc:686] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:13.991091 12944 consensus_queue.cc:237] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:13.996624 11362 tablet_bootstrap.cc:654] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:13.989913 10555 leader_election.cc:341] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:13.989575 10564 leader_election.cc:302] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.000099 14135 raft_consensus.cc:2726] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:14.001106 10564 leader_election.cc:341] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.001319 10564 leader_election.cc:302] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.001581 14135 raft_consensus.cc:2726] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.001853 14172 leader_election.cc:288] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:14.002173 11046 leader_election.cc:341] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
I20260811 06:17:14.002470 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.003032 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:14.003077 11047 leader_election.cc:341] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:14.003569 11046 leader_election.cc:341] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:14.003772 11046 leader_election.cc:302] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.004449 14100 raft_consensus.cc:2726] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.004729 14100 raft_consensus.cc:482] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.004846 14100 raft_consensus.cc:504] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.005358 14100 leader_election.cc:288] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:14.006101 11046 leader_election.cc:341] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
W20260811 06:17:14.006851 11046 leader_election.cc:341] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:14.009856 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.011250 11047 leader_election.cc:341] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.011772 11361 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.011917 11361 ts_tablet_manager.cc:1397] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.187s user 0.000s sys 0.006s
I20260811 06:17:14.028355 11361 raft_consensus.cc:348] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.028620 11361 raft_consensus.cc:374] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.029469 11362 tablet_bootstrap.cc:492] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.029623 11362 ts_tablet_manager.cc:1397] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.005s
I20260811 06:17:14.030674 11362 raft_consensus.cc:348] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.030961 11362 raft_consensus.cc:374] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.031034 11362 raft_consensus.cc:729] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.031291 11362 consensus_queue.cc:260] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.033939 11362 ts_tablet_manager.cc:1428] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 06:17:14.034251 11362 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:14.035041 10564 leader_election.cc:341] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.035180 10564 leader_election.cc:302] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.035519 14135 raft_consensus.cc:2726] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.035718 13732 raft_consensus.cc:482] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.035852 13732 raft_consensus.cc:504] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.036468 13732 leader_election.cc:288] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.028680 11361 raft_consensus.cc:729] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.036811 11361 consensus_queue.cc:260] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.037392 11361 ts_tablet_manager.cc:1428] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.025s user 0.000s sys 0.002s
I20260811 06:17:14.037658 11361 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.037855 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.037914 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.038215 11158 raft_consensus.cc:2379] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:14.038197 10661 raft_consensus.cc:2454] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:14.038921 10810 leader_election.cc:302] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.039327 13732 raft_consensus.cc:2781] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.039404 13732 raft_consensus.cc:482] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.039460 13732 raft_consensus.cc:3037] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.042606 13732 raft_consensus.cc:504] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.043848 13732 leader_election.cc:288] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.043960 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:14.044209 11158 raft_consensus.cc:2379] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:14.044993 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.045281 10661 raft_consensus.cc:3037] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.048720 10661 raft_consensus.cc:2454] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:14.049456 10810 leader_election.cc:302] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters: f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.050360 13732 raft_consensus.cc:2781] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.050560 13732 raft_consensus.cc:686] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:14.050845 13732 consensus_queue.cc:237] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.052078 13282 raft_consensus.cc:482] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.052227 13282 raft_consensus.cc:504] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.052829 13282 leader_election.cc:288] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.053527 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.054029 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "370d971f8ef14131afc5b54dbdbaae98" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:14.054162 11047 leader_election.cc:341] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.054425 10663 raft_consensus.cc:2379] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:14.055627 12726 ts_tablet_manager.cc:1918] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:14.055759 12726 log.cc:1196] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:14.056172 12726 ts_tablet_manager.cc:1939] T e4171d257dd6453a9159c59ae713b2e0 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:14.058687 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.059082 10649 raft_consensus.cc:2454] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.064567 14266 raft_consensus.cc:482] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.065994 14266 raft_consensus.cc:504] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.065565 11361 tablet_bootstrap.cc:654] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.071341 14266 leader_election.cc:288] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.071758 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.072942 11047 leader_election.cc:341] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.075405 11046 leader_election.cc:302] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.076550 11046 leader_election.cc:302] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.076838 14100 raft_consensus.cc:2726] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.077057 14100 raft_consensus.cc:2781] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.077207 14100 raft_consensus.cc:482] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.077343 14100 raft_consensus.cc:3037] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:14.077629 11584 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.126:33303, user_credentials={real_user=slave}} blocked reactor thread for 197124us
I20260811 06:17:14.083940 11365 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.084102 11365 ts_tablet_manager.cc:1397] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.297s user 0.007s sys 0.006s
I20260811 06:17:14.084668 14100 raft_consensus.cc:504] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.085285 13282 raft_consensus.cc:482] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.085299 11365 raft_consensus.cc:348] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.085397 13282 raft_consensus.cc:504] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.085506 11365 raft_consensus.cc:374] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.085554 11365 raft_consensus.cc:729] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.085776 14100 leader_election.cc:288] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.085947 13282 leader_election.cc:288] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.085799 11365 consensus_queue.cc:260] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.086476 11365 ts_tablet_manager.cc:1428] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:14.086926 11365 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.087052 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc4a4e8bfe3b43aeb0c1617dcb29e685" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.087672 11047 leader_election.cc:341] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.088752 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:14.089392 11047 leader_election.cc:341] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.094867 11361 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.095022 11361 ts_tablet_manager.cc:1397] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.002s
I20260811 06:17:14.096273 11361 raft_consensus.cc:348] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.096554 11361 raft_consensus.cc:374] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.096614 11361 raft_consensus.cc:729] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.096817 11361 consensus_queue.cc:260] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.097354 11361 ts_tablet_manager.cc:1428] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.097770 11361 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.100705 11361 tablet_bootstrap.cc:654] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:14.103195 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:14.103715 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because the tablet was not found. No further retry: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
W20260811 06:17:14.104113 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:14.104496 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because the tablet was not found. No further retry: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
W20260811 06:17:14.104817 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because the tablet was not found. No further retry: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:14.105299 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 8e721083b8b2428bbea6b9e87a4a6e14 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]) successfully deleted
I20260811 06:17:14.105607 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e4171d257dd6453a9159c59ae713b2e0 (table default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]) successfully deleted
I20260811 06:17:14.116024 14100 raft_consensus.cc:482] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.116189 14100 raft_consensus.cc:504] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.116995 14100 leader_election.cc:288] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.118132 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.118428 10910 raft_consensus.cc:2454] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.118983 11047 leader_election.cc:302] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:14.119336 14100 raft_consensus.cc:2781] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.119417 14100 raft_consensus.cc:482] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.119541 14100 raft_consensus.cc:3037] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.122968 13052 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 06:17:14.123291 14100 raft_consensus.cc:504] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.124058 14100 leader_election.cc:288] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.124970 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.113488 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.126487 10654 raft_consensus.cc:2454] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.126576 11361 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.126693 11361 ts_tablet_manager.cc:1397] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260811 06:17:14.127842 11361 raft_consensus.cc:348] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.127961 10910 raft_consensus.cc:3037] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.128048 11361 raft_consensus.cc:374] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.128103 11361 raft_consensus.cc:729] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.128298 11361 consensus_queue.cc:260] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.128850 11361 ts_tablet_manager.cc:1428] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.131640 10910 raft_consensus.cc:2454] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:14.137810 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00a72f178f74ca59cc073fe78c99373 already in progress: creating tablet
I20260811 06:17:14.137871 11047 leader_election.cc:302] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:14.138170 14100 raft_consensus.cc:2781] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.138310 14100 raft_consensus.cc:686] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.138643 14100 consensus_queue.cc:237] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.139469 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.139734 10654 raft_consensus.cc:2454] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.145879 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.146144 10649 raft_consensus.cc:3037] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.150300 10649 raft_consensus.cc:2454] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.151008 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:14.153805 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 56c04c4bc2374360bf0dc9d3a6972025 (DEFAULT_TABLE table=default.Table_d4f24173958a4a08928d69879e511b4f [id=39d4520647f5413493f36b86c4408436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.154254 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c04c4bc2374360bf0dc9d3a6972025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.157070 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 78a22685fb924840b9f28908f565e5a6 (DEFAULT_TABLE table=default.Table_b257fa815c634965884deb91f100ff84 [id=aa0b2f727f0f410892e1661b48484305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.157445 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a22685fb924840b9f28908f565e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.160408 10872 tablet_service.cc:1467] Processing CreateTablet for tablet c1083fbcb9e64ec28b4221da3cd6d870 (DEFAULT_TABLE table=default.Table_038e2d68e4224ea094b8e2b117fc8550 [id=bd4b17f86080484091209861594a4900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.160738 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1083fbcb9e64ec28b4221da3cd6d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.162416 11362 tablet_bootstrap.cc:654] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.164069 11365 tablet_bootstrap.cc:654] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.165269 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 1136550fcc8940959c4704bb887618e6 (DEFAULT_TABLE table=default.Table_78d16895fbab45cfbb34cd82051d9090 [id=2ca87db0e90b4819a4102d30bdf7c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.165621 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1136550fcc8940959c4704bb887618e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.168467 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.168706 10654 raft_consensus.cc:2454] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.169114 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369a031402a24a6a91f0c7ba8a5f288a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.169275 10654 raft_consensus.cc:3037] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.170495 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 56c04c4bc2374360bf0dc9d3a6972025 (DEFAULT_TABLE table=default.Table_d4f24173958a4a08928d69879e511b4f [id=39d4520647f5413493f36b86c4408436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.170825 13282 raft_consensus.cc:482] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.170913 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c04c4bc2374360bf0dc9d3a6972025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.170954 13282 raft_consensus.cc:504] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.171698 13282 leader_election.cc:288] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.171819 13282 raft_consensus.cc:482] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.171895 10654 raft_consensus.cc:2454] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.171912 13282 raft_consensus.cc:504] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.172452 13282 leader_election.cc:288] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:14.172453 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
I20260811 06:17:14.173030 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:14.173470 11362 tablet_bootstrap.cc:492] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.173512 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 56c04c4bc2374360bf0dc9d3a6972025 (DEFAULT_TABLE table=default.Table_d4f24173958a4a08928d69879e511b4f [id=39d4520647f5413493f36b86c4408436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.173595 11362 ts_tablet_manager.cc:1397] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.139s user 0.005s sys 0.000s
I20260811 06:17:14.173930 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c04c4bc2374360bf0dc9d3a6972025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.173981 11121 tablet_service.cc:1467] Processing CreateTablet for tablet c1083fbcb9e64ec28b4221da3cd6d870 (DEFAULT_TABLE table=default.Table_038e2d68e4224ea094b8e2b117fc8550 [id=bd4b17f86080484091209861594a4900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.174309 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1083fbcb9e64ec28b4221da3cd6d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.174396 11362 raft_consensus.cc:348] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.174600 11362 raft_consensus.cc:374] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.174645 11362 raft_consensus.cc:729] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.174815 11362 consensus_queue.cc:260] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.177985 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 1136550fcc8940959c4704bb887618e6 (DEFAULT_TABLE table=default.Table_78d16895fbab45cfbb34cd82051d9090 [id=2ca87db0e90b4819a4102d30bdf7c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.178032 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 78a22685fb924840b9f28908f565e5a6 (DEFAULT_TABLE table=default.Table_b257fa815c634965884deb91f100ff84 [id=aa0b2f727f0f410892e1661b48484305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.178296 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1136550fcc8940959c4704bb887618e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.178381 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a22685fb924840b9f28908f565e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.182107 10609 tablet_service.cc:1467] Processing CreateTablet for tablet c1083fbcb9e64ec28b4221da3cd6d870 (DEFAULT_TABLE table=default.Table_038e2d68e4224ea094b8e2b117fc8550 [id=bd4b17f86080484091209861594a4900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.182476 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1083fbcb9e64ec28b4221da3cd6d870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.167704 14271 tablet.cc:1722] T da30a4db5b334cf88b01648c336a7ade P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:14.170513 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 78a22685fb924840b9f28908f565e5a6 (DEFAULT_TABLE table=default.Table_b257fa815c634965884deb91f100ff84 [id=aa0b2f727f0f410892e1661b48484305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.186136 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78a22685fb924840b9f28908f565e5a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:14.186307 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
I20260811 06:17:14.190723 11362 ts_tablet_manager.cc:1428] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260811 06:17:14.191056 11362 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.192688 11362 tablet_bootstrap.cc:654] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.194605 11046 leader_election.cc:302] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.195122 11046 leader_election.cc:302] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:14.195420 11046 leader_election.cc:341] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: dc4a4e8bfe3b43aeb0c1617dcb29e685
I20260811 06:17:14.195501 11046 leader_election.cc:302] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.196231 13740 raft_consensus.cc:2781] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.196323 13740 raft_consensus.cc:482] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.196374 13740 raft_consensus.cc:3037] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.199270 13740 raft_consensus.cc:504] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.199865 13740 leader_election.cc:288] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.200151 13740 raft_consensus.cc:2781] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.200224 13740 raft_consensus.cc:482] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.200309 13740 raft_consensus.cc:3037] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.201366 14172 raft_consensus.cc:2726] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.202816 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.202963 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.203001 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.205396 11047 leader_election.cc:341] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:14.205605 11047 leader_election.cc:341] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:14.205830 11047 leader_election.cc:341] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.207055 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:14.207620 11676 catalog_manager.cc:5495] T 67e2683156f8466b8d63b298c9da15c1 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:14.209254 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:14.211490 14100 raft_consensus.cc:482] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.211665 14100 raft_consensus.cc:504] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.212301 14100 leader_election.cc:288] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.213550 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516e3c37321f4c7b9f3373164682a0ff" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.214110 11361 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.216044 11361 tablet_bootstrap.cc:654] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.211162 11365 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.218429 11365 ts_tablet_manager.cc:1397] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.132s user 0.005s sys 0.005s
I20260811 06:17:14.218439 13732 raft_consensus.cc:482] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.218595 13732 raft_consensus.cc:504] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.219393 13732 leader_election.cc:288] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:14.220078 11047 leader_election.cc:341] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.220757 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a183d0915a5a48c2a26994d47f6fe266" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.220957 11158 raft_consensus.cc:2454] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:14.223310 14271 tablet.cc:1722] T 55b38127e97f400f879afc94c0672906 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:14.223824 10813 leader_election.cc:302] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:14.224175 14204 raft_consensus.cc:2781] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.224252 14204 raft_consensus.cc:482] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.224313 14204 raft_consensus.cc:3037] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.226397 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 273a08232aba4b6a956ac53d8c102295 (DEFAULT_TABLE table=default.Table_7fd40157e59345cf9eae5fb39ae8fbb6 [id=1f0e50983f4547fea5fc9d7a2b43e872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.226827 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273a08232aba4b6a956ac53d8c102295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.227046 14204 raft_consensus.cc:504] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.227700 14204 leader_election.cc:288] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.228858 11365 raft_consensus.cc:348] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.229071 11365 raft_consensus.cc:374] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.229117 11365 raft_consensus.cc:729] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.229287 11365 consensus_queue.cc:260] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:14.231410 10810 leader_election.cc:341] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
W20260811 06:17:14.231788 10810 leader_election.cc:341] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:14.232359 11365 ts_tablet_manager.cc:1428] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260811 06:17:14.232638 11365 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.232750 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 42a2fd57eb04475da57300e05168a591 (DEFAULT_TABLE table=default.Table_1a21661604a846fbb20a20cb4a76a4f8 [id=d9c6bfe9dc534d5d8dd077f4f6166251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.233120 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a2fd57eb04475da57300e05168a591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.243131 11365 tablet_bootstrap.cc:654] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.244359 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 273a08232aba4b6a956ac53d8c102295 (DEFAULT_TABLE table=default.Table_7fd40157e59345cf9eae5fb39ae8fbb6 [id=1f0e50983f4547fea5fc9d7a2b43e872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.244468 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a183d0915a5a48c2a26994d47f6fe266" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:14.244675 11157 raft_consensus.cc:3037] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.244802 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273a08232aba4b6a956ac53d8c102295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.247956 11157 raft_consensus.cc:2454] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:14.248849 10813 leader_election.cc:302] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:14.249347 14204 raft_consensus.cc:2781] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.249475 14204 raft_consensus.cc:686] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:14.249678 14204 consensus_queue.cc:237] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:14.251482 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 56060.1us
I20260811 06:17:14.251724 11046 leader_election.cc:302] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.252604 11361 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.252728 11361 ts_tablet_manager.cc:1397] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.124s user 0.001s sys 0.002s
I20260811 06:17:14.253472 13282 raft_consensus.cc:2781] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.253607 13282 raft_consensus.cc:686] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.253860 13282 consensus_queue.cc:237] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.254217 11361 raft_consensus.cc:348] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.254411 11361 raft_consensus.cc:374] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.254462 11361 raft_consensus.cc:729] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.267115 11365 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.267280 11365 ts_tablet_manager.cc:1397] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.003s
I20260811 06:17:14.268165 11365 raft_consensus.cc:348] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.268381 11365 raft_consensus.cc:374] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.268437 11365 raft_consensus.cc:729] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.268704 11365 consensus_queue.cc:260] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.254618 11361 consensus_queue.cc:260] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.269294 11365 ts_tablet_manager.cc:1428] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.269565 11365 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.269816 14100 raft_consensus.cc:482] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.269948 14100 raft_consensus.cc:504] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.270438 11361 ts_tablet_manager.cc:1428] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260811 06:17:14.270702 11361 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.270851 14100 leader_election.cc:288] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.271358 11365 tablet_bootstrap.cc:654] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.274647 11361 tablet_bootstrap.cc:654] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.275590 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.287045 11365 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.287218 11365 ts_tablet_manager.cc:1397] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260811 06:17:14.288131 11365 raft_consensus.cc:348] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.288460 11365 raft_consensus.cc:374] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.288538 11365 raft_consensus.cc:729] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.288733 11365 consensus_queue.cc:260] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.289364 11365 ts_tablet_manager.cc:1428] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.289652 11365 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.293970 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 42a2fd57eb04475da57300e05168a591 (DEFAULT_TABLE table=default.Table_1a21661604a846fbb20a20cb4a76a4f8 [id=d9c6bfe9dc534d5d8dd077f4f6166251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.294413 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a2fd57eb04475da57300e05168a591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.294382 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:14.294893 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:14.295213 11365 tablet_bootstrap.cc:654] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.295320 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:14.295859 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:14.296178 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet da30a4db5b334cf88b01648c336a7ade (table default.Table_06207def0d7646999e471424624de3fd [id=32c58f06cf094acdac22d9ca6fe36811]). Expected version 1 got 0
I20260811 06:17:14.296531 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:14.296967 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:14.298074 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb0a4318e44fcf99279adefa99f10c (DEFAULT_TABLE table=default.Table_4aadcfb3f8bd44738eda0c27da5d114f [id=5e0dfc05f4b44fb8aa9a7428982080d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.298580 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb0a4318e44fcf99279adefa99f10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.302033 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 83858f37e3ea4d9486cf711d41754318 (DEFAULT_TABLE table=default.Table_b7174c3119b448089d2fc9657ffe99fd [id=23a7e540c6c54a059dea571d32ae329b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.302501 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83858f37e3ea4d9486cf711d41754318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.304998 13740 raft_consensus.cc:504] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.308861 10879 tablet_service.cc:1467] Processing CreateTablet for tablet 2707979dce35428aa7145e9b34959989 (DEFAULT_TABLE table=default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.309335 10879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2707979dce35428aa7145e9b34959989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.309772 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 83858f37e3ea4d9486cf711d41754318 (DEFAULT_TABLE table=default.Table_b7174c3119b448089d2fc9657ffe99fd [id=23a7e540c6c54a059dea571d32ae329b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.310453 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb0a4318e44fcf99279adefa99f10c (DEFAULT_TABLE table=default.Table_4aadcfb3f8bd44738eda0c27da5d114f [id=5e0dfc05f4b44fb8aa9a7428982080d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.312311 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83858f37e3ea4d9486cf711d41754318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.317854 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb0a4318e44fcf99279adefa99f10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.323036 10867 tablet_service.cc:1467] Processing CreateTablet for tablet a815299e01bb4e3dabe0627edb86c3a6 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.326834 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a815299e01bb4e3dabe0627edb86c3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.329569 11119 tablet_service.cc:1467] Processing CreateTablet for tablet a815299e01bb4e3dabe0627edb86c3a6 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.330080 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a815299e01bb4e3dabe0627edb86c3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.306001 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 2707979dce35428aa7145e9b34959989 (DEFAULT_TABLE table=default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.323156 11361 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.330358 11361 ts_tablet_manager.cc:1397] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.011s
I20260811 06:17:14.330762 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2707979dce35428aa7145e9b34959989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.331331 11361 raft_consensus.cc:348] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.331524 11361 raft_consensus.cc:374] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.331565 11361 raft_consensus.cc:729] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.331734 11361 consensus_queue.cc:260] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.332420 11361 ts_tablet_manager.cc:1428] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:14.332679 11361 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.333405 13740 leader_election.cc:288] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.333990 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:14.333951 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.334234 11676 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
W20260811 06:17:14.334558 11047 leader_election.cc:341] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.335355 11361 tablet_bootstrap.cc:654] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.336910 10866 tablet_service.cc:1467] Processing CreateTablet for tablet 604cba8a4978479cbb15307aeb45a634 (DEFAULT_TABLE table=default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.337299 10866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604cba8a4978479cbb15307aeb45a634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.350119 11119 tablet_service.cc:1467] Processing CreateTablet for tablet 604cba8a4978479cbb15307aeb45a634 (DEFAULT_TABLE table=default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.350680 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604cba8a4978479cbb15307aeb45a634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.351843 10884 tablet_service.cc:1467] Processing CreateTablet for tablet ad7e0f439de5426fbb6b5223d824ca88 (DEFAULT_TABLE table=default.Table_f343e73772b34724840390189eba1076 [id=d8a67483fb1e46b48fb08dd7da427554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.352444 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7e0f439de5426fbb6b5223d824ca88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.361950 11361 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.362107 11361 ts_tablet_manager.cc:1397] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.003s
I20260811 06:17:14.362823 11361 raft_consensus.cc:348] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.363138 11361 raft_consensus.cc:374] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.363194 11361 raft_consensus.cc:729] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.363381 11361 consensus_queue.cc:260] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.363873 11361 ts_tablet_manager.cc:1428] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.364125 11361 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:14.365531 11600 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 02bb2819d9cc4880803ef959c131b9ac consensus state has no leader
I20260811 06:17:14.370090 10634 tablet_service.cc:1467] Processing CreateTablet for tablet 1136550fcc8940959c4704bb887618e6 (DEFAULT_TABLE table=default.Table_78d16895fbab45cfbb34cd82051d9090 [id=2ca87db0e90b4819a4102d30bdf7c59b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.370975 10634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1136550fcc8940959c4704bb887618e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.373621 11361 tablet_bootstrap.cc:654] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.379251 11096 tablet_service.cc:1467] Processing CreateTablet for tablet ad7e0f439de5426fbb6b5223d824ca88 (DEFAULT_TABLE table=default.Table_f343e73772b34724840390189eba1076 [id=d8a67483fb1e46b48fb08dd7da427554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.379666 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7e0f439de5426fbb6b5223d824ca88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.379876 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 273a08232aba4b6a956ac53d8c102295 (DEFAULT_TABLE table=default.Table_7fd40157e59345cf9eae5fb39ae8fbb6 [id=1f0e50983f4547fea5fc9d7a2b43e872]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.380494 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 273a08232aba4b6a956ac53d8c102295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.386951 11361 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.387089 11361 ts_tablet_manager.cc:1397] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.001s
I20260811 06:17:14.387742 11361 raft_consensus.cc:348] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.387939 11361 raft_consensus.cc:374] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.387991 11361 raft_consensus.cc:729] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.388168 11361 consensus_queue.cc:260] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.388672 11361 ts_tablet_manager.cc:1428] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.388947 11361 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.390365 11361 tablet_bootstrap.cc:654] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.390693 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 42a2fd57eb04475da57300e05168a591 (DEFAULT_TABLE table=default.Table_1a21661604a846fbb20a20cb4a76a4f8 [id=d9c6bfe9dc534d5d8dd077f4f6166251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.391080 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a2fd57eb04475da57300e05168a591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.398134 10609 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb0a4318e44fcf99279adefa99f10c (DEFAULT_TABLE table=default.Table_4aadcfb3f8bd44738eda0c27da5d114f [id=5e0dfc05f4b44fb8aa9a7428982080d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.398609 10609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb0a4318e44fcf99279adefa99f10c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.401818 13740 raft_consensus.cc:482] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.402043 13740 raft_consensus.cc:504] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.403877 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c997501cefd4e6b9e5824e5403dd39b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.403955 13740 leader_election.cc:288] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.404443 12944 raft_consensus.cc:482] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.404569 12944 raft_consensus.cc:504] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.405085 12944 leader_election.cc:288] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:14.406025 10810 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
W20260811 06:17:14.406293 11047 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.407099 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8741294bc33e454a9c4ef1717ccef80f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.407348 11157 raft_consensus.cc:2454] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:14.407732 10813 leader_election.cc:302] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:14.408103 12944 raft_consensus.cc:2781] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.408176 12944 raft_consensus.cc:482] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.408232 12944 raft_consensus.cc:3037] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.411648 12944 raft_consensus.cc:504] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:14.412910 10810 leader_election.cc:341] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:14.413147 12944 leader_election.cc:288] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.413621 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8741294bc33e454a9c4ef1717ccef80f" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:14.413820 11158 raft_consensus.cc:3037] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.416555 11158 raft_consensus.cc:2454] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:14.417084 10813 leader_election.cc:302] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:14.417630 12944 raft_consensus.cc:2781] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.417760 12944 raft_consensus.cc:686] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:14.417990 12944 consensus_queue.cc:237] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.433498 10858 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe4156c0184bfd9ff4a51e3e91bd35 (DEFAULT_TABLE table=default.Table_374b114001174636a31945bc3948e65d [id=652162fed10c478faab8ad078bec1aff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.434026 10858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe4156c0184bfd9ff4a51e3e91bd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.434103 11096 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe4156c0184bfd9ff4a51e3e91bd35 (DEFAULT_TABLE table=default.Table_374b114001174636a31945bc3948e65d [id=652162fed10c478faab8ad078bec1aff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.434478 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe4156c0184bfd9ff4a51e3e91bd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.442505 13740 raft_consensus.cc:482] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.442826 13740 raft_consensus.cc:504] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.450631 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 83858f37e3ea4d9486cf711d41754318 (DEFAULT_TABLE table=default.Table_b7174c3119b448089d2fc9657ffe99fd [id=23a7e540c6c54a059dea571d32ae329b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.451126 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83858f37e3ea4d9486cf711d41754318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.460037 10632 tablet_service.cc:1467] Processing CreateTablet for tablet 2707979dce35428aa7145e9b34959989 (DEFAULT_TABLE table=default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.460886 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2707979dce35428aa7145e9b34959989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.470898 14108 raft_consensus.cc:482] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.471062 14108 raft_consensus.cc:504] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.471658 14108 leader_election.cc:288] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.472275 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.472870 10555 leader_election.cc:341] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.495029 10608 tablet_service.cc:1467] Processing CreateTablet for tablet a815299e01bb4e3dabe0627edb86c3a6 (DEFAULT_TABLE table=default.Table_e6afac09d27f4629896daa31c8399313 [id=5f044882ab7a4cf9be8fea6e898f9770]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.495540 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a815299e01bb4e3dabe0627edb86c3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.495710 14100 raft_consensus.cc:482] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.495855 14100 raft_consensus.cc:504] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.496038 14108 consensus_queue.cc:1035] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:14.496382 14100 leader_election.cc:288] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.496982 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.497641 11047 leader_election.cc:341] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.497991 10615 tablet_service.cc:1467] Processing CreateTablet for tablet ad7e0f439de5426fbb6b5223d824ca88 (DEFAULT_TABLE table=default.Table_f343e73772b34724840390189eba1076 [id=d8a67483fb1e46b48fb08dd7da427554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.498063 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.498292 10659 raft_consensus.cc:2454] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.498342 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7e0f439de5426fbb6b5223d824ca88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.495116 10623 tablet_service.cc:1467] Processing CreateTablet for tablet 604cba8a4978479cbb15307aeb45a634 (DEFAULT_TABLE table=default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.501997 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604cba8a4978479cbb15307aeb45a634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.502544 13740 leader_election.cc:288] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:14.502971 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 60934.1us
I20260811 06:17:14.503152 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.503230 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 59044.1us
W20260811 06:17:14.503760 11047 leader_election.cc:341] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.536700 14100 raft_consensus.cc:482] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.536870 14100 raft_consensus.cc:504] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.537663 14100 leader_election.cc:288] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.545885 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.546752 11047 leader_election.cc:341] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.548288 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.548561 10659 raft_consensus.cc:2454] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.550534 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.550730 10654 raft_consensus.cc:3037] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.554101 10654 raft_consensus.cc:2454] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.555423 11362 tablet_bootstrap.cc:492] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.555583 11362 ts_tablet_manager.cc:1397] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.365s user 0.023s sys 0.045s
I20260811 06:17:14.556317 11362 raft_consensus.cc:348] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.556546 11362 raft_consensus.cc:374] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.556602 11362 raft_consensus.cc:729] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.556457 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:14.556842 11362 consensus_queue.cc:260] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.557168 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:14.557405 11362 ts_tablet_manager.cc:1428] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:14.557613 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:14.557890 11362 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.559279 11362 tablet_bootstrap.cc:654] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.565361 11365 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.565517 11365 ts_tablet_manager.cc:1397] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.276s user 0.025s sys 0.039s
I20260811 06:17:14.566474 11365 raft_consensus.cc:348] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.566681 11365 raft_consensus.cc:374] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.566723 11365 raft_consensus.cc:729] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.566890 11365 consensus_queue.cc:260] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.567369 11365 ts_tablet_manager.cc:1428] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:17:14.567612 11365 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.568217 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:14.578558 11362 tablet_bootstrap.cc:492] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.578722 11362 ts_tablet_manager.cc:1397] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.001s
I20260811 06:17:14.579502 11362 raft_consensus.cc:348] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.579733 11362 raft_consensus.cc:374] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.579792 11362 raft_consensus.cc:729] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.579973 11362 consensus_queue.cc:260] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.580502 11362 ts_tablet_manager.cc:1428] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.581115 11362 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.582476 11362 tablet_bootstrap.cc:654] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.586191 11365 tablet_bootstrap.cc:654] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.595682 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:14.598438 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c91236a8304bf2a03e85a5864aa669" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.598840 10654 raft_consensus.cc:2379] T 00c91236a8304bf2a03e85a5864aa669 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:14.601666 11362 tablet_bootstrap.cc:492] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.601850 11362 ts_tablet_manager.cc:1397] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260811 06:17:14.602425 11361 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.602582 11361 ts_tablet_manager.cc:1397] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.214s user 0.037s sys 0.038s
I20260811 06:17:14.602856 11362 raft_consensus.cc:348] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.603142 11362 raft_consensus.cc:374] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.603207 11362 raft_consensus.cc:729] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.603399 11362 consensus_queue.cc:260] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.603417 11361 raft_consensus.cc:348] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.603703 11361 raft_consensus.cc:374] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.603775 11361 raft_consensus.cc:729] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.603979 11361 consensus_queue.cc:260] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.604430 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.604641 11361 ts_tablet_manager.cc:1428] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 06:17:14.604923 11361 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.605963 11362 ts_tablet_manager.cc:1428] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:14.606217 11362 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.607612 11362 tablet_bootstrap.cc:654] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.607712 11361 tablet_bootstrap.cc:654] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.604696 10654 raft_consensus.cc:3037] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.623937 11365 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.624118 11365 ts_tablet_manager.cc:1397] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.004s
I20260811 06:17:14.624464 13282 raft_consensus.cc:482] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.624670 13282 raft_consensus.cc:504] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.625551 11365 raft_consensus.cc:348] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.625790 11365 raft_consensus.cc:374] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.625665 13282 leader_election.cc:288] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.625855 11365 raft_consensus.cc:729] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.626055 11365 consensus_queue.cc:260] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.626214 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.626602 11365 ts_tablet_manager.cc:1428] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 06:17:14.626814 11047 leader_election.cc:341] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.627009 11365 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.629798 11365 tablet_bootstrap.cc:654] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.631245 11361 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.631392 11361 ts_tablet_manager.cc:1397] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.005s
I20260811 06:17:14.632242 11361 raft_consensus.cc:348] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.632460 11361 raft_consensus.cc:374] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.632524 11361 raft_consensus.cc:729] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.632745 11361 consensus_queue.cc:260] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.637837 10654 raft_consensus.cc:2454] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.639531 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.639750 10659 raft_consensus.cc:2454] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.640496 11361 ts_tablet_manager.cc:1428] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:17:14.641140 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.641323 10659 raft_consensus.cc:2454] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.641974 11361 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.642087 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:14.642376 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.642537 10659 raft_consensus.cc:2454] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.644519 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:14.644784 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.644968 10659 raft_consensus.cc:2454] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:14.645294 11361 tablet_bootstrap.cc:654] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.648123 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.648761 11365 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.648902 11365 ts_tablet_manager.cc:1397] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.005s
I20260811 06:17:14.651479 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:14.651955 11046 leader_election.cc:302] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.652568 13282 raft_consensus.cc:2781] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.652732 13282 raft_consensus.cc:482] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.652899 13282 raft_consensus.cc:3037] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.652945 11362 tablet_bootstrap.cc:492] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.653093 11362 ts_tablet_manager.cc:1397] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.003s
I20260811 06:17:14.655839 11362 raft_consensus.cc:348] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.656080 11362 raft_consensus.cc:374] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.656132 11362 raft_consensus.cc:729] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.657189 11046 leader_election.cc:302] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.657855 13740 raft_consensus.cc:2781] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.657979 13740 raft_consensus.cc:482] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.658120 13740 raft_consensus.cc:3037] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.658232 11362 consensus_queue.cc:260] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.661387 11362 ts_tablet_manager.cc:1428] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260811 06:17:14.661844 13740 raft_consensus.cc:504] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.661692 11362 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.664374 11362 tablet_bootstrap.cc:654] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.670447 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:14.674530 11365 raft_consensus.cc:348] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.674794 11365 raft_consensus.cc:374] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.674846 11365 raft_consensus.cc:729] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.675032 11365 consensus_queue.cc:260] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.675238 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.675431 10910 raft_consensus.cc:3037] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.675729 11365 ts_tablet_manager.cc:1428] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260811 06:17:14.676054 11365 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.679580 10910 raft_consensus.cc:2454] T 5753a44d13f943c695497573b56eec6c P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.680166 11047 leader_election.cc:302] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:14.680662 14100 raft_consensus.cc:2781] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.680810 14100 raft_consensus.cc:686] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.681033 14100 consensus_queue.cc:237] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.681684 11361 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.681819 11361 ts_tablet_manager.cc:1397] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.006s
I20260811 06:17:14.682035 11362 tablet_bootstrap.cc:492] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.682163 11362 ts_tablet_manager.cc:1397] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
I20260811 06:17:14.682399 11361 raft_consensus.cc:348] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.682581 11361 raft_consensus.cc:374] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.682627 11361 raft_consensus.cc:729] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.682772 11361 consensus_queue.cc:260] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.683357 11362 raft_consensus.cc:348] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.683573 11362 raft_consensus.cc:374] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.683621 11362 raft_consensus.cc:729] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.683830 11362 consensus_queue.cc:260] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.684015 11361 ts_tablet_manager.cc:1428] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:14.684280 11361 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.684495 11362 ts_tablet_manager.cc:1428] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:14.684772 11362 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.686632 11362 tablet_bootstrap.cc:654] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.687561 13740 leader_election.cc:288] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.687839 14108 raft_consensus.cc:482] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.687995 14108 raft_consensus.cc:504] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.688602 14108 leader_election.cc:288] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.690897 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.690256 11046 leader_election.cc:302] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.691545 14289 raft_consensus.cc:2781] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.691655 14289 raft_consensus.cc:686] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.691861 14289 consensus_queue.cc:237] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.694842 11361 tablet_bootstrap.cc:654] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:14.696384 10555 leader_election.cc:341] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:14.700837 10810 consensus_peers.cc:487] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:14.707406 11046 leader_election.cc:341] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 516e3c37321f4c7b9f3373164682a0ff
I20260811 06:17:14.707567 11046 leader_election.cc:302] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.708094 13740 raft_consensus.cc:2726] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.708606 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:14.709365 11046 leader_election.cc:302] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.709995 13740 raft_consensus.cc:3037] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.716776 11365 tablet_bootstrap.cc:654] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.726763 11365 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.726927 11365 ts_tablet_manager.cc:1397] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260811 06:17:14.727604 11365 raft_consensus.cc:348] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.727823 11365 raft_consensus.cc:374] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.727871 11365 raft_consensus.cc:729] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.728065 11365 consensus_queue.cc:260] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.728627 11365 ts_tablet_manager.cc:1428] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.729168 11365 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.730808 11365 tablet_bootstrap.cc:654] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.742337 11365 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.742507 11365 ts_tablet_manager.cc:1397] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.002s
I20260811 06:17:14.743299 11365 raft_consensus.cc:348] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.743629 11365 raft_consensus.cc:374] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.743691 11365 raft_consensus.cc:729] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.743881 11365 consensus_queue.cc:260] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.744463 11365 ts_tablet_manager.cc:1428] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.744752 11365 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.746408 11365 tablet_bootstrap.cc:654] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.748615 10029 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu with pid 12363
I20260811 06:17:14.757789 11046 leader_election.cc:302] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.758250 14266 raft_consensus.cc:2781] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.765029 14266 raft_consensus.cc:686] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.765439 14266 consensus_queue.cc:237] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:14.770548 11046 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:14.770678 11046 leader_election.cc:302] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.770895 14343 raft_consensus.cc:2726] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.771353 11365 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.771509 11365 ts_tablet_manager.cc:1397] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.010s
I20260811 06:17:14.772221 11365 raft_consensus.cc:348] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.772457 11365 raft_consensus.cc:374] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.772516 11365 raft_consensus.cc:729] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.772682 11365 consensus_queue.cc:260] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.773216 11365 ts_tablet_manager.cc:1428] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.773491 11365 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.775094 11365 tablet_bootstrap.cc:654] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.775674 14108 raft_consensus.cc:482] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.775794 14108 raft_consensus.cc:504] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.776469 14108 leader_election.cc:288] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.777169 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10211a4e95464e9e9e2b2e70d23086a5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.777830 10555 leader_election.cc:341] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.779785 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:14.784994 10623 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe4156c0184bfd9ff4a51e3e91bd35 (DEFAULT_TABLE table=default.Table_374b114001174636a31945bc3948e65d [id=652162fed10c478faab8ad078bec1aff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:14.785454 10623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe4156c0184bfd9ff4a51e3e91bd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:14.790226 11365 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.790475 11365 ts_tablet_manager.cc:1397] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260811 06:17:14.791239 11365 raft_consensus.cc:348] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.791522 11365 raft_consensus.cc:374] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.791617 11365 raft_consensus.cc:729] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.791857 11365 consensus_queue.cc:260] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.792568 11365 ts_tablet_manager.cc:1428] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:14.792855 11365 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.672894 13282 raft_consensus.cc:504] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.794516 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.794709 10910 raft_consensus.cc:3037] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.794750 11365 tablet_bootstrap.cc:654] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.797351 10910 raft_consensus.cc:2454] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.797917 11047 leader_election.cc:302] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:14.798660 13282 leader_election.cc:288] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.798817 14352 raft_consensus.cc:2781] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.798949 14352 raft_consensus.cc:686] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.799182 14352 consensus_queue.cc:237] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.804324 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.805215 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10211a4e95464e9e9e2b2e70d23086a5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.807871 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5753a44d13f943c695497573b56eec6c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.808068 10659 raft_consensus.cc:3037] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.810868 10659 raft_consensus.cc:2454] T 5753a44d13f943c695497573b56eec6c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.813441 11365 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.813583 11365 ts_tablet_manager.cc:1397] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.016s
I20260811 06:17:14.814517 11365 raft_consensus.cc:348] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.814739 11365 raft_consensus.cc:374] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.814785 11365 raft_consensus.cc:729] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.814760 12944 consensus_queue.cc:1035] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:14.814965 11365 consensus_queue.cc:260] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.815644 11365 ts_tablet_manager.cc:1428] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:14.815922 11365 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.817660 11365 tablet_bootstrap.cc:654] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.829007 11365 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.829159 11365 ts_tablet_manager.cc:1397] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.001s
I20260811 06:17:14.829917 11365 raft_consensus.cc:348] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.830252 11365 raft_consensus.cc:374] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.830322 11365 raft_consensus.cc:729] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.830547 11365 consensus_queue.cc:260] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.831072 11365 ts_tablet_manager.cc:1428] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 06:17:14.831282 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 59833us
I20260811 06:17:14.831526 11365 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.833865 11365 tablet_bootstrap.cc:654] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.835541 11046 leader_election.cc:302] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.836248 14352 raft_consensus.cc:2781] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.836316 14352 raft_consensus.cc:482] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.836366 14352 raft_consensus.cc:3037] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.839241 14352 raft_consensus.cc:504] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.839529 14108 raft_consensus.cc:482] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.839666 14108 raft_consensus.cc:504] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.840281 14108 leader_election.cc:288] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.841665 11365 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.841807 11365 ts_tablet_manager.cc:1397] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260811 06:17:14.842061 14352 leader_election.cc:288] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.842362 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:14.842558 11365 raft_consensus.cc:348] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.842747 11365 raft_consensus.cc:374] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.842801 11365 raft_consensus.cc:729] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.842960 11365 consensus_queue.cc:260] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:14.843080 11047 leader_election.cc:341] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.843453 11365 ts_tablet_manager.cc:1428] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.843704 11365 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.844341 11046 leader_election.cc:302] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:14.847946 14367 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:17:14.835435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.203.124:45045 (local address 127.9.203.66:57313)
0811 06:17:14.847637 (+ 12202us) negotiation.cc:107] Waiting for socket to connect
0811 06:17:14.847748 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":12076,"threads_started":1}
I20260811 06:17:14.851836 11365 tablet_bootstrap.cc:654] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.852488 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:14.853289 14358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 06:17:14.822013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.203.124:45045 (local address 127.9.203.65:41599)
0811 06:17:14.852669 (+ 30656us) negotiation.cc:107] Waiting for socket to connect
0811 06:17:14.852768 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":29614,"thread_start_us":29737,"threads_started":1}
W20260811 06:17:14.854408 10555 leader_election.cc:341] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:14.857945 11588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.203.124:45045 (error 108) [suppressed 11 similar messages]
I20260811 06:17:14.859532 14108 raft_consensus.cc:482] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.859661 14108 raft_consensus.cc:504] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.860399 14108 leader_election.cc:288] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.860903 11365 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.861027 11365 ts_tablet_manager.cc:1397] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
I20260811 06:17:14.861761 11365 raft_consensus.cc:348] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.861948 11365 raft_consensus.cc:374] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.861999 11365 raft_consensus.cc:729] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.861882 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.862154 11365 consensus_queue.cc:260] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.862674 11365 ts_tablet_manager.cc:1428] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:14.863085 11365 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.864550 11365 tablet_bootstrap.cc:654] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:14.864936 10555 leader_election.cc:341] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.866112 14373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a36d6d06a0cb4489b5014178b9973219)
I20260811 06:17:14.866338 14373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
I20260811 06:17:14.867213 14373 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:17:14.867712 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 5 candidate_status { last_received { term: 4 index: 765 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
I20260811 06:17:14.873807 11365 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.873960 11365 ts_tablet_manager.cc:1397] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260811 06:17:14.874796 11365 raft_consensus.cc:348] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.874992 11365 raft_consensus.cc:374] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.875029 11365 raft_consensus.cc:729] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.875181 11365 consensus_queue.cc:260] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.875595 11365 ts_tablet_manager.cc:1428] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.875969 11365 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.876505 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:14.876972 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:14.877265 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:14.877578 11365 tablet_bootstrap.cc:654] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.877813 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:14.878257 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:14.878397 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:14.878691 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:14.880142 14108 raft_consensus.cc:482] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.880280 14108 raft_consensus.cc:504] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.880759 14108 leader_election.cc:288] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.881486 11365 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.881610 11365 ts_tablet_manager.cc:1397] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 06:17:14.882372 11365 raft_consensus.cc:348] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.882561 11365 raft_consensus.cc:374] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.882477 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:14.882608 11365 raft_consensus.cc:729] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.882761 11365 consensus_queue.cc:260] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.883251 11365 ts_tablet_manager.cc:1428] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:17:14.883500 11365 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.884837 14348 raft_consensus.cc:2781] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.884914 14348 raft_consensus.cc:482] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.884941 11365 tablet_bootstrap.cc:654] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.884987 14348 raft_consensus.cc:3037] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:14.886351 10555 leader_election.cc:341] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.884634 11046 leader_election.cc:302] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.894991 11046 leader_election.cc:302] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.895238 14289 raft_consensus.cc:2781] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.896344 14289 raft_consensus.cc:482] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.896528 11365 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.896638 14289 raft_consensus.cc:3037] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.896670 11365 ts_tablet_manager.cc:1397] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260811 06:17:14.897405 11365 raft_consensus.cc:348] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.897637 11365 raft_consensus.cc:374] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.897703 11365 raft_consensus.cc:729] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.897946 11365 consensus_queue.cc:260] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.900918 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a25b6d0d733c44398a233b595caad8a0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.901113 10659 raft_consensus.cc:3037] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.902734 11365 ts_tablet_manager.cc:1428] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260811 06:17:14.903832 10659 raft_consensus.cc:2454] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.905684 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.905895 10659 raft_consensus.cc:3037] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.908308 10659 raft_consensus.cc:2454] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:14.908798 10564 leader_election.cc:341] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.909530 10564 leader_election.cc:302] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.913470 14348 raft_consensus.cc:504] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.919888 11362 tablet_bootstrap.cc:492] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.920082 11362 ts_tablet_manager.cc:1397] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.235s user 0.027s sys 0.060s
I20260811 06:17:14.920852 11362 raft_consensus.cc:348] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.921095 11362 raft_consensus.cc:374] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.921171 11362 raft_consensus.cc:729] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.921419 11362 consensus_queue.cc:260] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.921989 11362 ts_tablet_manager.cc:1428] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:14.923166 11362 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.924707 11362 tablet_bootstrap.cc:654] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:14.925643 11588 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.124:45045, user_credentials={real_user=slave}} blocked reactor thread for 104804us
I20260811 06:17:14.927176 11362 tablet_bootstrap.cc:492] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.927363 11362 ts_tablet_manager.cc:1397] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:14.928121 11362 raft_consensus.cc:348] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.928359 11362 raft_consensus.cc:374] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.928418 11362 raft_consensus.cc:729] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.928659 11362 consensus_queue.cc:260] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.929195 11362 ts_tablet_manager.cc:1428] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:14.929482 11362 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.934588 11362 tablet_bootstrap.cc:654] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.935022 14204 raft_consensus.cc:482] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.935159 14204 raft_consensus.cc:504] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.935668 14204 leader_election.cc:288] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:14.937110 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:14.937420 10654 raft_consensus.cc:2379] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:14.938107 14108 raft_consensus.cc:2726] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:14.938943 10564 leader_election.cc:341] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.939121 10564 leader_election.cc:302] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.939355 14108 raft_consensus.cc:2726] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:14.939723 10564 leader_election.cc:341] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.939874 10564 leader_election.cc:302] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.942309 11365 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.944077 11365 tablet_bootstrap.cc:654] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.945658 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:14.951359 11362 tablet_bootstrap.cc:492] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:14.951505 11362 ts_tablet_manager.cc:1397] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.007s
I20260811 06:17:14.952183 11362 raft_consensus.cc:348] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.952402 11362 raft_consensus.cc:374] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.952477 11362 raft_consensus.cc:729] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.953151 14108 raft_consensus.cc:2726] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.954281 11362 consensus_queue.cc:260] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:14.954933 10072 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:17:14.955955 11365 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.956103 11365 ts_tablet_manager.cc:1397] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s
I20260811 06:17:14.956895 11365 raft_consensus.cc:348] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.957124 11365 raft_consensus.cc:374] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.957190 11365 raft_consensus.cc:729] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.957381 11365 consensus_queue.cc:260] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:14.957938 11365 ts_tablet_manager.cc:1428] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:14.958200 11365 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.959841 11365 tablet_bootstrap.cc:654] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.883987 13740 raft_consensus.cc:2726] T 00c91236a8304bf2a03e85a5864aa669 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.964013 11365 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.964568 11365 ts_tablet_manager.cc:1397] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 06:17:14.965494 11365 raft_consensus.cc:348] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.960112 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:14.965832 11365 raft_consensus.cc:374] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.966073 11365 raft_consensus.cc:729] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.966346 11156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:14.966601 10072 leader_election.cc:334] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:17:14.966738 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
I20260811 06:17:14.966781 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:14.967042 14373 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 06:17:14.963388 11588 consensus_peers.cc:487] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 -> Peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Couldn't send request to peer 29fb239be50c4171bdbc75e064555197. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:14.931216 14352 raft_consensus.cc:2781] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:14.967450 11365 consensus_queue.cc:260] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.967607 14352 raft_consensus.cc:482] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:14.967697 14352 raft_consensus.cc:3037] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.967962 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:14.968032 11365 ts_tablet_manager.cc:1428] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:14.968160 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:14.968271 11365 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:14.968454 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:14.968734 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet da30a4db5b334cf88b01648c336a7ade (table default.Table_06207def0d7646999e471424624de3fd [id=32c58f06cf094acdac22d9ca6fe36811]). Expected version 1 got 0
I20260811 06:17:14.968948 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:14.969300 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:14.969775 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:14.969916 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:14.969959 11365 tablet_bootstrap.cc:654] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.970063 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:14.970314 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:14.970293 14352 raft_consensus.cc:504] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.970602 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:14.970829 14352 leader_election.cc:288] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.971047 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:14.971282 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:14.971524 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:14.971747 11656 catalog_manager.cc:5495] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:14.972209 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:14.972436 11656 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:14.944867 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc0ec3b040cd4a54a7919a15f8eb5da7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.950752 14343 consensus_queue.cc:1035] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:14.954375 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:14.973670 11046 consensus_peers.cc:487] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:14.956359 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.973955 11046 leader_election.cc:302] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:14.974324 14343 raft_consensus.cc:2781] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:14.974448 14343 raft_consensus.cc:686] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:14.974640 14343 consensus_queue.cc:237] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.978088 11362 ts_tablet_manager.cc:1428] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260811 06:17:14.978410 11362 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:14.980549 14108 raft_consensus.cc:482] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.980670 14108 raft_consensus.cc:504] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.980984 11361 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.981133 11361 ts_tablet_manager.cc:1397] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.297s user 0.042s sys 0.055s
I20260811 06:17:14.981158 14108 leader_election.cc:288] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.981434 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.981602 10645 raft_consensus.cc:3037] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.981927 11361 raft_consensus.cc:348] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.982136 11361 raft_consensus.cc:374] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.982182 11361 raft_consensus.cc:729] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.982350 11361 consensus_queue.cc:260] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.982884 11361 ts_tablet_manager.cc:1428] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:14.983322 11361 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.983219 14204 consensus_queue.cc:1035] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:14.984153 10645 raft_consensus.cc:2454] T 1271c4ab028d4d45acfee370f13a02d3 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.984916 11361 tablet_bootstrap.cc:654] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.984972 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:14.985158 10645 raft_consensus.cc:3037] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:14.987082 11361 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:14.987100 11365 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:14.987203 11365 ts_tablet_manager.cc:1397] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.010s
I20260811 06:17:14.987203 11361 ts_tablet_manager.cc:1397] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260811 06:17:14.987577 10645 raft_consensus.cc:2454] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:14.987913 11361 raft_consensus.cc:348] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.988111 11361 raft_consensus.cc:374] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.988163 11361 raft_consensus.cc:729] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:14.988194 11365 raft_consensus.cc:348] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.988385 11365 raft_consensus.cc:374] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:14.988320 11361 consensus_queue.cc:260] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.988466 11365 raft_consensus.cc:729] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:17:14.988381 10564 leader_election.cc:341] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:14.988648 10564 leader_election.cc:302] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:14.988817 11361 ts_tablet_manager.cc:1428] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:14.988655 11365 consensus_queue.cc:260] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.989064 11361 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:14.989845 14108 raft_consensus.cc:482] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.989971 14108 raft_consensus.cc:504] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.990445 14108 leader_election.cc:288] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:14.990581 14108 raft_consensus.cc:2726] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:14.990702 11361 tablet_bootstrap.cc:654] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:14.991279 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45fc206d95a244e395d19328ae289485" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:14.994957 14108 raft_consensus.cc:482] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:14.995080 14108 raft_consensus.cc:504] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.995558 14108 leader_election.cc:288] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.007257 13740 raft_consensus.cc:482] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.007575 13740 raft_consensus.cc:504] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.008261 13740 leader_election.cc:288] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.010294 11046 leader_election.cc:302] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.010294 14100 consensus_queue.cc:1035] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.013965 11046 leader_election.cc:302] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.014050 14100 raft_consensus.cc:2781] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.014160 14100 raft_consensus.cc:686] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.014318 14352 raft_consensus.cc:2781] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.014400 14352 raft_consensus.cc:686] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.014364 14100 consensus_queue.cc:237] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.014564 14352 consensus_queue.cc:237] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:14.957171 14289 raft_consensus.cc:504] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.018877 14289 leader_election.cc:288] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.022138 14348 leader_election.cc:288] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.027177 14204 consensus_queue.cc:1035] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.027585 10813 leader_election.cc:302] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.030259 12944 raft_consensus.cc:3037] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.031864 14204 raft_consensus.cc:482] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.032001 14204 raft_consensus.cc:504] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.035369 14204 leader_election.cc:288] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.033932 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4124f64656614c91b7d9115c2efbecd1" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.037619 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e990aa374204f2b95c08b04121176bc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.040284 10810 leader_election.cc:341] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:15.040625 11362 tablet_bootstrap.cc:654] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.046887 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.047044 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.047116 10910 raft_consensus.cc:3037] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.047884 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45fc206d95a244e395d19328ae289485" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.049166 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.048808 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fa71e5477644e0a0d7c40ecc55928b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.050065 10555 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.050302 10555 leader_election.cc:341] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.050453 10555 leader_election.cc:341] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.050763 11047 leader_election.cc:341] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.051110 11047 leader_election.cc:341] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.051290 11047 leader_election.cc:341] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.051543 10910 raft_consensus.cc:2454] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.052352 12944 raft_consensus.cc:2726] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.052511 13740 consensus_queue.cc:1035] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.053386 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b5bb21784e34ad7addf144e0b10a444" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.053613 11157 raft_consensus.cc:2454] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.055934 11047 leader_election.cc:302] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.057036 12944 consensus_queue.cc:1035] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.059605 14108 raft_consensus.cc:482] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.059760 14108 raft_consensus.cc:504] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.060319 14108 leader_election.cc:288] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.067682 14348 consensus_queue.cc:1035] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.068300 14348 raft_consensus.cc:2781] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.068493 14348 raft_consensus.cc:686] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.068774 14348 consensus_queue.cc:237] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.083961 11362 tablet_bootstrap.cc:492] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.084111 11362 ts_tablet_manager.cc:1397] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.008s
I20260811 06:17:15.084838 11362 raft_consensus.cc:348] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.085054 11362 raft_consensus.cc:374] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.085115 11362 raft_consensus.cc:729] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.085341 11361 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.085477 11361 ts_tablet_manager.cc:1397] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.096s user 0.026s sys 0.063s
I20260811 06:17:15.086211 11361 raft_consensus.cc:348] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.086437 11361 raft_consensus.cc:374] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.086499 11361 raft_consensus.cc:729] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.086695 11361 consensus_queue.cc:260] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.087251 11361 ts_tablet_manager.cc:1428] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:15.087512 11361 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.089174 11361 tablet_bootstrap.cc:654] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.090759 11362 consensus_queue.cc:260] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.091323 11362 ts_tablet_manager.cc:1428] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260811 06:17:15.091598 11362 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.093029 10813 leader_election.cc:302] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:15.093250 12944 raft_consensus.cc:2781] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.093314 12944 raft_consensus.cc:482] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.093384 12944 raft_consensus.cc:3037] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.096156 12944 raft_consensus.cc:504] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.096844 12944 leader_election.cc:288] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:15.097472 10810 leader_election.cc:341] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:15.106391 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b5bb21784e34ad7addf144e0b10a444" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:15.106667 11163 raft_consensus.cc:3037] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.107579 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.111025 11163 raft_consensus.cc:2454] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.122378 11362 tablet_bootstrap.cc:654] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:15.124567 10555 leader_election.cc:341] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.129104 10813 leader_election.cc:302] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:15.129623 14402 raft_consensus.cc:2781] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.130038 14427 consensus_queue.cc:1035] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.132390 14402 raft_consensus.cc:686] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:15.132737 14402 consensus_queue.cc:237] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.155076 11361 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.155226 11361 ts_tablet_manager.cc:1397] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.068s user 0.018s sys 0.012s
I20260811 06:17:15.156363 11361 raft_consensus.cc:348] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.156577 11361 raft_consensus.cc:374] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.156625 11361 raft_consensus.cc:729] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.156831 11361 consensus_queue.cc:260] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.157367 11361 ts_tablet_manager.cc:1428] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:15.157624 11361 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:15.158427 10564 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 170037us
W20260811 06:17:15.158996 10564 leader_election.cc:341] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.159121 10564 leader_election.cc:302] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.159296 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:15.159449 11361 tablet_bootstrap.cc:654] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.159720 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:15.160104 14108 raft_consensus.cc:2726] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:15.160938 10564 leader_election.cc:341] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.161250 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:15.161432 10564 leader_election.cc:302] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:15.161834 10564 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.162283 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:15.164497 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:15.164727 10564 leader_election.cc:302] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.165234 11362 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.165380 11362 ts_tablet_manager.cc:1397] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.002s
I20260811 06:17:15.164428 11365 ts_tablet_manager.cc:1428] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.177s user 0.014s sys 0.039s
I20260811 06:17:15.165686 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fa71e5477644e0a0d7c40ecc55928b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.165890 11365 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.166047 11157 raft_consensus.cc:2454] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
I20260811 06:17:15.166132 14408 raft_consensus.cc:2726] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.162060 14406 raft_consensus.cc:2726] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.168955 11362 raft_consensus.cc:348] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.171047 11362 raft_consensus.cc:374] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.171358 11362 raft_consensus.cc:729] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.171767 11362 consensus_queue.cc:260] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.173058 11362 ts_tablet_manager.cc:1428] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260811 06:17:15.174175 11362 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.182577 11361 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.182783 11361 ts_tablet_manager.cc:1397] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.009s
I20260811 06:17:15.183545 11361 raft_consensus.cc:348] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.183820 11361 raft_consensus.cc:374] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.183919 11361 raft_consensus.cc:729] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.184154 11361 consensus_queue.cc:260] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.184734 11361 ts_tablet_manager.cc:1428] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:15.185038 11361 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.186635 11361 tablet_bootstrap.cc:654] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.190356 11365 tablet_bootstrap.cc:654] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.191954 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.192215 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:15.192431 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:15.192605 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.193022 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 55b38127e97f400f879afc94c0672906 (table default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87]). Expected version 2 got 0
I20260811 06:17:15.193550 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:15.193892 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:15.194238 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:15.194427 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:15.194927 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:15.195233 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:15.195933 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:15.196152 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:15.196434 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:15.196620 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:15.196861 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:15.197168 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:15.197327 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:15.197543 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:15.207265 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54249325b2fa462bbc476ea609ec5389" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.207541 10659 raft_consensus.cc:3037] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:15.213440 11046 leader_election.cc:341] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 5e990aa374204f2b95c08b04121176bc
I20260811 06:17:15.213594 11046 leader_election.cc:302] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.213956 10659 raft_consensus.cc:2454] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.214125 14343 raft_consensus.cc:2726] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.214687 11365 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:15.215180 11046 consensus_peers.cc:487] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:15.215974 11365 ts_tablet_manager.cc:1397] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20260811 06:17:15.216032 12944 consensus_queue.cc:1035] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.219380 14348 consensus_queue.cc:1035] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:15.219553 10810 consensus_peers.cc:487] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:15.219730 11362 tablet_bootstrap.cc:654] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.221766 10564 leader_election.cc:302] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.225901 11365 raft_consensus.cc:348] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.226208 11365 raft_consensus.cc:374] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.226259 11365 raft_consensus.cc:729] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.226733 14408 raft_consensus.cc:2781] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.226876 14408 raft_consensus.cc:482] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.226999 14408 raft_consensus.cc:3037] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.235932 14408 raft_consensus.cc:504] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.236713 14408 leader_election.cc:288] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.237782 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fa71e5477644e0a0d7c40ecc55928b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:15.239279 10555 leader_election.cc:341] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.239630 14406 raft_consensus.cc:482] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.239995 14406 raft_consensus.cc:504] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.240661 14406 leader_election.cc:288] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.241155 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.241707 10555 leader_election.cc:341] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.242695 10564 leader_election.cc:341] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.242806 10564 leader_election.cc:302] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.243080 11365 consensus_queue.cc:260] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:15.248594 10564 leader_election.cc:341] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.248719 10564 leader_election.cc:302] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.250175 11362 tablet_bootstrap.cc:492] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.250316 11362 ts_tablet_manager.cc:1397] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.076s user 0.001s sys 0.002s
I20260811 06:17:15.250896 11362 raft_consensus.cc:348] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.251056 11362 raft_consensus.cc:374] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.251089 11362 raft_consensus.cc:729] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.251236 11362 consensus_queue.cc:260] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.251353 14108 raft_consensus.cc:2726] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.251510 14108 raft_consensus.cc:2726] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.252305 11365 ts_tablet_manager.cc:1428] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260811 06:17:15.252591 11365 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.254416 11365 tablet_bootstrap.cc:654] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.255465 11362 ts_tablet_manager.cc:1428] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260811 06:17:15.256763 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:15.257378 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:15.257993 11362 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.257977 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:15.259765 11362 tablet_bootstrap.cc:654] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.261353 11361 tablet_bootstrap.cc:492] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.261490 11361 ts_tablet_manager.cc:1397] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.077s user 0.010s sys 0.026s
I20260811 06:17:15.262204 11361 raft_consensus.cc:348] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.262420 11361 raft_consensus.cc:374] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.262496 11361 raft_consensus.cc:729] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.262681 11361 consensus_queue.cc:260] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.263172 11361 ts_tablet_manager.cc:1428] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:15.263412 11361 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.266028 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:15.266431 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:15.266732 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:15.267097 11361 tablet_bootstrap.cc:654] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.267268 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:15.267647 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:15.268057 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet da30a4db5b334cf88b01648c336a7ade (table default.Table_06207def0d7646999e471424624de3fd [id=32c58f06cf094acdac22d9ca6fe36811]). Expected version 1 got 0
I20260811 06:17:15.268541 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:15.269088 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:15.281174 11361 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.281328 11361 ts_tablet_manager.cc:1397] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s
I20260811 06:17:15.282176 11361 raft_consensus.cc:348] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.282407 11361 raft_consensus.cc:374] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.282464 11361 raft_consensus.cc:729] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.282727 11365 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.283383 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.283964 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fa71e5477644e0a0d7c40ecc55928b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:15.284183 11163 raft_consensus.cc:3037] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.287269 11163 raft_consensus.cc:2454] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:15.288008 14406 raft_consensus.cc:482] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.288184 14406 raft_consensus.cc:504] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.288758 14406 leader_election.cc:288] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.291308 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.291556 10564 leader_election.cc:341] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.291666 10564 leader_election.cc:302] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.292004 10564 leader_election.cc:302] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:15.292232 10555 leader_election.cc:341] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.282640 11361 consensus_queue.cc:260] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.292399 14408 raft_consensus.cc:2726] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.292569 14408 raft_consensus.cc:2781] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.292663 14408 raft_consensus.cc:686] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:15.292826 11361 ts_tablet_manager.cc:1428] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260811 06:17:15.292861 14408 consensus_queue.cc:237] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.293114 11361 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.294894 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.292896 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:15.296494 11663 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
W20260811 06:17:15.297020 10564 leader_election.cc:341] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.297147 10564 leader_election.cc:302] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.297531 14108 raft_consensus.cc:2726] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.297696 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 152f7db9fc6241c8abfdafd3adc30d47
I20260811 06:17:15.298238 11653 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 159) took 2781 ms. Trace:
I20260811 06:17:15.298373 11653 rpcz_store.cc:276] 0811 06:17:12.516886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.094269 (+577383us) service_pool.cc:227] Handling call
0811 06:17:13.118595 (+ 24326us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:13.119399 (+ 804us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:13.119528 (+ 129us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:13.119595 (+ 67us) catalog_manager.cc:2761] Locking tablets
0811 06:17:13.751645 (+632050us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:13.903639 (+151994us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:13.937948 (+ 34309us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:15.297612 (+1359664us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:15.298188 (+ 576us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:13.767133 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:13.767287 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:13.767295 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:13.767298 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:13.767514 (+ 216us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:13.767532 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:13.767538 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:13.767759 (+ 221us) tablet.cc:699] Row locks acquired
0811 06:17:13.767762 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:13.767806 (+ 44us) write_op.cc:270] Start()
0811 06:17:13.767866 (+ 60us) write_op.cc:276] Timestamp: P: 1786429033767757 usec, L: 0
0811 06:17:13.767871 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:13.768226 (+ 355us) log.cc:842] Serialized 762 byte log entry
0811 06:17:13.854755 (+ 86529us) op_driver.cc:444] REPLICATION: finished
0811 06:17:13.902792 (+ 48037us) write_op.cc:301] APPLY: starting
0811 06:17:13.902816 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:13.902869 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:13.902917 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:13.903186 (+ 269us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:13.903229 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:13.903235 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:13.903356 (+ 121us) log.cc:842] Serialized 29 byte log entry
0811 06:17:13.903455 (+ 99us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.903478 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:13.903486 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:13.903546 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.903550 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":52937600,"child_traces":[["op",{"apply.queue_time_us":47943,"apply.run_cpu_time_us":692,"apply.run_wall_time_us":834,"num_ops":2,"prepare.queue_time_us":13881,"prepare.run_cpu_time_us":1180,"prepare.run_wall_time_us":2178,"raft.queue_time_us":73,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":581,"replication_time_us":86849,"thread_start_us":62887,"threads_started":2}]]}
I20260811 06:17:15.302377 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.303622 11365 ts_tablet_manager.cc:1397] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260811 06:17:15.304284 11365 raft_consensus.cc:348] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.304479 11365 raft_consensus.cc:374] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.304531 11365 raft_consensus.cc:729] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.304533 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.304725 11365 consensus_queue.cc:260] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.305301 11365 ts_tablet_manager.cc:1428] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:15.309441 11365 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.311480 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.313162 14348 consensus_queue.cc:1035] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.318636 14450 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a36d6d06a0cb4489b5014178b9973219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } } }
I20260811 06:17:15.319008 14450 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 [sys.catalog]: This master's current role is: LEADER
I20260811 06:17:15.322273 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.322353 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.322520 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.322686 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.322836 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.322973 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.323041 11365 tablet_bootstrap.cc:654] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.323846 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.324086 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.324260 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.324410 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.324564 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327067 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327282 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b0ae9a1d3b74c3985637439819b63ef with delete_type TABLET_DATA_DELETED (replaced by tablet 30cffba93ad74e84812e5879b851119f) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327535 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327651 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327716 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327747 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327859 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.327991 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 916b91088d7d4024a02214c958c0825b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.328126 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.328222 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.328287 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.328436 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.337839 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.338056 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.338905 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.340655 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.341063 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.341588 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.342502 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.344254 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.344473 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.344648 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.345415 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.348460 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.348667 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.348826 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.348994 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.349123 12944 raft_consensus.cc:482] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.349251 12944 raft_consensus.cc:504] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.349992 12944 leader_election.cc:288] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.350173 14408 raft_consensus.cc:482] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.350314 14408 raft_consensus.cc:504] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.350574 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.350907 14408 leader_election.cc:288] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.351058 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.351171 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.352201 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485e465a43c14fc8ad3a70c6e3ee7628" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.352337 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.352492 10645 raft_consensus.cc:2379] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
W20260811 06:17:15.352870 10555 leader_election.cc:341] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.353160 10810 leader_election.cc:302] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.353529 12944 raft_consensus.cc:3037] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.353998 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.354212 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.354810 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.355494 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.355700 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:53 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.355796 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.355839 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.356305 12944 raft_consensus.cc:2726] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.357793 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.358537 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.359400 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.360852 14455 raft_consensus.cc:482] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.360989 14455 raft_consensus.cc:504] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.361486 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 60c3a381b6744b8d989d644f2b643958
I20260811 06:17:15.362046 11655 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 163) took 2505 ms. Trace:
I20260811 06:17:15.362155 11655 rpcz_store.cc:276] 0811 06:17:12.856226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.207073 (+350847us) service_pool.cc:227] Handling call
0811 06:17:13.207911 (+ 838us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:13.208050 (+ 139us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:13.208123 (+ 73us) catalog_manager.cc:2761] Locking tablets
0811 06:17:13.753616 (+545493us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:13.906439 (+152823us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:13.942086 (+ 35647us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:15.361401 (+1419315us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:15.361977 (+ 576us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:13.770328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:13.770428 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:13.770434 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:13.770437 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:13.770539 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:13.770549 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:13.770554 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:13.770650 (+ 96us) tablet.cc:699] Row locks acquired
0811 06:17:13.770652 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:13.770682 (+ 30us) write_op.cc:270] Start()
0811 06:17:13.770709 (+ 27us) write_op.cc:276] Timestamp: P: 1786429033770637 usec, L: 0
0811 06:17:13.770713 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:13.770937 (+ 224us) log.cc:842] Serialized 759 byte log entry
0811 06:17:13.905439 (+134502us) op_driver.cc:444] REPLICATION: finished
0811 06:17:13.905558 (+ 119us) write_op.cc:301] APPLY: starting
0811 06:17:13.905570 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:13.905633 (+ 63us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:13.905761 (+ 128us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:13.905844 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:13.905898 (+ 54us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:13.905905 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:13.906027 (+ 122us) log.cc:842] Serialized 29 byte log entry
0811 06:17:13.906303 (+ 276us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.906324 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:13.906331 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:13.906483 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.906486 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":28,"apply.run_cpu_time_us":573,"apply.run_wall_time_us":1006,"num_ops":2,"prepare.queue_time_us":14328,"prepare.run_cpu_time_us":666,"prepare.run_wall_time_us":666,"replication_time_us":134703}]]}
W20260811 06:17:15.362862 10810 leader_election.cc:341] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
I20260811 06:17:15.361577 14455 leader_election.cc:288] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.363692 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.365514 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e329d808c59c4f66bbc515d751255e96" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.365852 11163 raft_consensus.cc:2454] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.367194 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.367393 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.367573 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.367740 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.367892 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.367985 10813 leader_election.cc:302] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:15.368040 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.368350 14455 raft_consensus.cc:2781] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.368422 14455 raft_consensus.cc:482] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.368489 14455 raft_consensus.cc:3037] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.368618 14484 tablet_replica.cc:330] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.368839 14484 raft_consensus.cc:2229] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.369160 14484 raft_consensus.cc:2258] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.369815 14484 ts_tablet_manager.cc:1905] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.372529 11361 tablet_bootstrap.cc:654] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.372457 14455 raft_consensus.cc:504] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.373463 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:15.373986 10810 leader_election.cc:341] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
I20260811 06:17:15.374864 14455 leader_election.cc:288] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:15.375643 11684 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 90) took 2692 ms (client timeout 1000 ms). Trace:
I20260811 06:17:15.375684 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e329d808c59c4f66bbc515d751255e96" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:15.375905 11158 raft_consensus.cc:3037] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:15.376137 11684 rpcz_store.cc:269] 0811 06:17:12.683336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:12.769553 (+ 86217us) service_pool.cc:227] Handling call
0811 06:17:15.375595 (+2606042us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:13.099854 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:13.099973 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:13.099979 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:13.099982 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:13.100311 (+ 329us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:13.100326 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:13.100330 (+ 4us) tablet.cc:683] Acquiring locks for 3 operations
0811 06:17:13.100487 (+ 157us) tablet.cc:699] Row locks acquired
0811 06:17:13.100490 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:13.100531 (+ 41us) write_op.cc:270] Start()
0811 06:17:13.100564 (+ 33us) write_op.cc:276] Timestamp: P: 1786429033100497 usec, L: 0
0811 06:17:13.100568 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:13.100797 (+ 229us) log.cc:842] Serialized 1284 byte log entry
0811 06:17:13.123096 (+ 22299us) op_driver.cc:444] REPLICATION: finished
0811 06:17:13.123264 (+ 168us) write_op.cc:301] APPLY: starting
0811 06:17:13.123284 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:13.123434 (+ 150us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:13.123466 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:13.123554 (+ 88us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:13.123596 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0811 06:17:13.123603 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:13.123746 (+ 143us) log.cc:842] Serialized 35 byte log entry
0811 06:17:13.123821 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.123848 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:13.123856 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:13.123928 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:13.123932 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9355,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":726,"apply.run_wall_time_us":725,"num_ops":3,"prepare.queue_time_us":48815,"prepare.run_cpu_time_us":1144,"prepare.run_wall_time_us":31026,"raft.queue_time_us":1295,"raft.run_cpu_time_us":822,"raft.run_wall_time_us":824,"replication_time_us":22502}]]}
I20260811 06:17:15.378594 11158 raft_consensus.cc:2454] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.385161 10813 leader_election.cc:302] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:15.385810 12944 raft_consensus.cc:2781] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.385958 12944 raft_consensus.cc:686] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:15.386189 12944 consensus_queue.cc:237] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.390369 11362 tablet_bootstrap.cc:492] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.390516 11362 ts_tablet_manager.cc:1397] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.133s user 0.005s sys 0.010s
I20260811 06:17:15.391278 11362 raft_consensus.cc:348] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.391532 11362 raft_consensus.cc:374] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.391593 11362 raft_consensus.cc:729] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.398276 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.398793 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.399178 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.399924 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.400589 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.400974 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.401379 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.391755 11362 consensus_queue.cc:260] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.403522 11362 ts_tablet_manager.cc:1428] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260811 06:17:15.403839 11362 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.405444 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:15.405591 14484 ts_tablet_manager.cc:1918] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.406184 14484 log.cc:1196] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/152f7db9fc6241c8abfdafd3adc30d47
W20260811 06:17:15.406746 10810 consensus_peers.cc:487] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:15.406940 14484 ts_tablet_manager.cc:1939] T 152f7db9fc6241c8abfdafd3adc30d47 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.407449 14483 tablet_replica.cc:330] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.407979 14483 raft_consensus.cc:2229] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.408310 14483 raft_consensus.cc:2258] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.408289 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 152f7db9fc6241c8abfdafd3adc30d47 (table default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]) successfully deleted
I20260811 06:17:15.408473 14484 tablet_replica.cc:330] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:15.409035 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
W20260811 06:17:15.409278 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because the tablet was not found. No further retry: Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:15.409287 14483 ts_tablet_manager.cc:1905] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.409703 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 96) took 3297 ms (client timeout 1000 ms). Trace:
I20260811 06:17:15.408748 14348 raft_consensus.cc:482] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.410095 14484 raft_consensus.cc:2229] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.410017 14348 raft_consensus.cc:504] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.410257 14484 raft_consensus.cc:2258] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.410669 14348 leader_election.cc:288] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.410780 14484 ts_tablet_manager.cc:1905] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.412235 11672 rpcz_store.cc:269] 0811 06:17:12.111831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:12.127641 (+ 15810us) service_pool.cc:227] Handling call
0811 06:17:12.151263 (+ 23622us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:12.787148 (+635885us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.787154 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:15.409654 (+2622500us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:12.758952 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.759084 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.759091 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:12.759094 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.759230 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.759245 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.759249 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:12.759377 (+ 128us) tablet.cc:699] Row locks acquired
0811 06:17:12.759379 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.759473 (+ 94us) write_op.cc:270] Start()
0811 06:17:12.759510 (+ 37us) write_op.cc:276] Timestamp: P: 1786429032759421 usec, L: 0
0811 06:17:12.759514 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.759713 (+ 199us) log.cc:842] Serialized 907 byte log entry
0811 06:17:12.762811 (+ 3098us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.763267 (+ 456us) write_op.cc:301] APPLY: starting
0811 06:17:12.763285 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.763337 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.763377 (+ 40us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.763455 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.763493 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:12.763500 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:12.763581 (+ 81us) log.cc:842] Serialized 29 byte log entry
0811 06:17:12.763656 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.763680 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:12.763687 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":421,"reported_tablets":203,"spinlock_wait_cycles":26839936,"child_traces":[["op",{"apply.queue_time_us":395,"apply.run_cpu_time_us":484,"apply.run_wall_time_us":484,"num_ops":2,"prepare.queue_time_us":77,"prepare.run_cpu_time_us":871,"prepare.run_wall_time_us":902,"raft.queue_time_us":69,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":247,"replication_time_us":3271}]]}
I20260811 06:17:15.413393 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04766ede03342efb594aaf081e112af" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.414093 11047 leader_election.cc:341] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.414422 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.414903 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.415354 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.415709 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.415786 14480 tablet_replica.cc:330] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.416034 14480 raft_consensus.cc:2229] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.416316 14480 raft_consensus.cc:2258] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.417002 14480 ts_tablet_manager.cc:1905] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.419368 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet eede55349694488b9899ec56a80c8d5b consensus state has no leader
I20260811 06:17:15.421265 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.421764 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.425274 14408 raft_consensus.cc:482] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.425551 11362 tablet_bootstrap.cc:654] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.425420 14408 raft_consensus.cc:504] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.426067 14408 leader_election.cc:288] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.426625 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.427211 10555 leader_election.cc:341] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.427549 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:15.430425 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:15.431963 11684 catalog_manager.cc:5495] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:15.435289 11365 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:15.435442 11670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 95) took 4440 ms (client timeout 1000 ms). Trace:
I20260811 06:17:15.435907 11365 ts_tablet_manager.cc:1397] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.127s user 0.018s sys 0.030s
W20260811 06:17:15.436024 11670 rpcz_store.cc:269] 0811 06:17:10.995401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.010856 (+ 15455us) service_pool.cc:227] Handling call
0811 06:17:11.612972 (+602116us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.612979 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:15.435403 (+3822424us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:11.584869 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:11.584979 (+ 110us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:11.584985 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:11.584987 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:11.585165 (+ 178us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:11.585179 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:11.585184 (+ 5us) tablet.cc:683] Acquiring locks for 3 operations
0811 06:17:11.585272 (+ 88us) tablet.cc:699] Row locks acquired
0811 06:17:11.585275 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:11.585316 (+ 41us) write_op.cc:270] Start()
0811 06:17:11.585351 (+ 35us) write_op.cc:276] Timestamp: P: 1786429031585274 usec, L: 0
0811 06:17:11.585356 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:11.585562 (+ 206us) log.cc:842] Serialized 1284 byte log entry
0811 06:17:11.590951 (+ 5389us) op_driver.cc:444] REPLICATION: finished
0811 06:17:11.591056 (+ 105us) write_op.cc:301] APPLY: starting
0811 06:17:11.591072 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:11.591263 (+ 191us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:11.591336 (+ 73us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:11.591426 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:11.591463 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0811 06:17:11.591471 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:11.591568 (+ 97us) log.cc:842] Serialized 35 byte log entry
0811 06:17:11.591638 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:11.591663 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:11.591670 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0811 06:17:12.133577 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.133650 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.133654 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:12.133656 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:12.133747 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.133755 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.133758 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.133803 (+ 45us) tablet.cc:699] Row locks acquired
0811 06:17:12.133805 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.133831 (+ 26us) write_op.cc:270] Start()
0811 06:17:12.133854 (+ 23us) write_op.cc:276] Timestamp: P: 1786429032133797 usec, L: 0
0811 06:17:12.133857 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.136985 (+ 3128us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.195499 (+ 58514us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.199458 (+ 3959us) write_op.cc:301] APPLY: starting
0811 06:17:12.199474 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.199508 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.199598 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.199657 (+ 59us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.199687 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.199693 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:12.199769 (+ 76us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.199839 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.199856 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:12.199862 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.199915 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.199918 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":198,"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":655,"apply.run_wall_time_us":674,"num_ops":3,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":805,"prepare.run_wall_time_us":805,"raft.queue_time_us":464,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":407,"replication_time_us":5571}],["op",{"apply.queue_time_us":3921,"apply.run_cpu_time_us":508,"apply.run_wall_time_us":508,"num_ops":1,"prepare.queue_time_us":1207,"prepare.run_cpu_time_us":497,"prepare.run_wall_time_us":3478,"replication_time_us":61626}]]}
I20260811 06:17:15.436774 11365 raft_consensus.cc:348] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.436985 11365 raft_consensus.cc:374] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.437041 11365 raft_consensus.cc:729] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.437083 14483 ts_tablet_manager.cc:1918] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.437171 14483 log.cc:1196] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/152f7db9fc6241c8abfdafd3adc30d47
I20260811 06:17:15.437242 11365 consensus_queue.cc:260] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.437898 11365 ts_tablet_manager.cc:1428] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:15.441660 14480 ts_tablet_manager.cc:1918] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.445806 14483 ts_tablet_manager.cc:1939] T 152f7db9fc6241c8abfdafd3adc30d47 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:15.445899 14480 log.cc:1196] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/152f7db9fc6241c8abfdafd3adc30d47
I20260811 06:17:15.446421 14480 ts_tablet_manager.cc:1939] T 152f7db9fc6241c8abfdafd3adc30d47 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.446980 14483 tablet_replica.cc:330] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.447295 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.447242 14483 raft_consensus.cc:2229] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.447588 14480 tablet_replica.cc:330] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.447664 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.447875 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448076 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448129 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 6703e639ab2042e78fadc63bd18c7602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448258 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448336 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448405 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 14a36a644dc4491dad838ce4e19793ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448562 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448616 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448576 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448783 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448917 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.448946 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.449079 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 61114d1bcdb94af7b6c55b0331accee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.449172 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.449376 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.447666 14483 pending_rounds.cc:62] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Trying to abort 1 pending ops.
I20260811 06:17:15.449515 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.449610 14483 pending_rounds.cc:68] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213328562143232 op_type: NO_OP noop_request { }
I20260811 06:17:15.449929 14483 raft_consensus.cc:2866] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:15.450103 14483 raft_consensus.cc:2258] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.450387 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.447960 14480 raft_consensus.cc:2229] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.450925 14480 raft_consensus.cc:2258] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:15.451407 10564 leader_election.cc:341] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.451524 10564 leader_election.cc:302] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:15.451625 11046 leader_election.cc:341] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: a04766ede03342efb594aaf081e112af
I20260811 06:17:15.451732 11046 leader_election.cc:302] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.451797 14480 ts_tablet_manager.cc:1905] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.452389 13740 raft_consensus.cc:2726] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.452581 14408 raft_consensus.cc:2726] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.453184 14484 ts_tablet_manager.cc:1918] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.453857 14484 log.cc:1196] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/1349b0ea48b848398d4bdda528358c30
I20260811 06:17:15.454368 14484 ts_tablet_manager.cc:1939] T 1349b0ea48b848398d4bdda528358c30 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.455566 14484 tablet_replica.cc:330] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.455462 12944 consensus_queue.cc:1035] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.455679 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 1349b0ea48b848398d4bdda528358c30 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]) successfully deleted
I20260811 06:17:15.456260 11670 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_aae70e5ddc0c49fea99f4f77e876a4fd" } new_table_name: "default.Table_b35fe6d74f034773b642d52843e43bd3" modify_external_catalogs: true
W20260811 06:17:15.446954 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 96) took 3963 ms (client timeout 1000 ms). Trace:
I20260811 06:17:15.435712 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:15.449666 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 152f7db9fc6241c8abfdafd3adc30d47 (table default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]) successfully deleted
I20260811 06:17:15.452385 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 152f7db9fc6241c8abfdafd3adc30d47 (table default.Table_d2138c3da06245bcbed00c854667b9ac [id=12d7f2e30d8346bc803ce2aad0cc036d]) successfully deleted
I20260811 06:17:15.458673 11362 tablet_bootstrap.cc:492] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.432566 11672 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_5e1e1b6ea74a4d34bf88b32e8d533b38" } new_table_name: "default.Table_e8aa31ae81824fd699449a5bfe4ba023" modify_external_catalogs: true
I20260811 06:17:15.458803 11362 ts_tablet_manager.cc:1397] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260811 06:17:15.459527 11362 raft_consensus.cc:348] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.459749 11362 raft_consensus.cc:374] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.459820 11362 raft_consensus.cc:729] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.458622 11684 catalog_manager.cc:5495] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:15.460004 11362 consensus_queue.cc:260] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.460420 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:15.460520 11362 ts_tablet_manager.cc:1428] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:15.460831 11684 catalog_manager.cc:5495] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:15.462126 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:15.462445 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:15.462764 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:15.463500 11684 catalog_manager.cc:5495] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:15.464331 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
W20260811 06:17:15.467638 10564 leader_election.cc:341] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.468102 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:15.468197 11362 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.468312 10564 leader_election.cc:302] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.469151 14408 raft_consensus.cc:2726] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:15.464510 11679 rpcz_store.cc:269] 0811 06:17:11.483942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:11.485799 (+ 1857us) service_pool.cc:227] Handling call
0811 06:17:15.446894 (+3961095us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:12.065824 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.065932 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.065937 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:12.065939 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:12.066036 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.066097 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.066109 (+ 12us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.066172 (+ 63us) tablet.cc:699] Row locks acquired
0811 06:17:12.066175 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:12.066205 (+ 30us) write_op.cc:270] Start()
0811 06:17:12.066240 (+ 35us) write_op.cc:276] Timestamp: P: 1786429032066177 usec, L: 0
0811 06:17:12.066244 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.066391 (+ 147us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.150992 (+ 84601us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.151243 (+ 251us) write_op.cc:301] APPLY: starting
0811 06:17:12.151258 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.151295 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.151375 (+ 80us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.151430 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.151462 (+ 32us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.151469 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:12.151551 (+ 82us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.151612 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.151628 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:12.151634 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.151690 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.151693 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:12.164162 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:12.164306 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:12.164313 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:12.164316 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:12.164415 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:12.164454 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:12.164459 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:12.164523 (+ 64us) tablet.cc:699] Row locks acquired
0811 06:17:12.164525 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:12.164565 (+ 40us) write_op.cc:270] Start()
0811 06:17:12.164604 (+ 39us) write_op.cc:276] Timestamp: P: 1786429032164524 usec, L: 0
0811 06:17:12.164609 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:12.164830 (+ 221us) log.cc:842] Serialized 356 byte log entry
0811 06:17:12.218470 (+ 53640us) op_driver.cc:444] REPLICATION: finished
0811 06:17:12.221185 (+ 2715us) write_op.cc:301] APPLY: starting
0811 06:17:12.221197 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:12.221226 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:12.221250 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:12.221294 (+ 44us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:12.221334 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:12.221341 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:12.221406 (+ 65us) log.cc:842] Serialized 23 byte log entry
0811 06:17:12.221615 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.221629 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:12.221635 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:12.221681 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:12.221684 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":190,"child_traces":[["op",{"apply.queue_time_us":196,"apply.run_cpu_time_us":500,"apply.run_wall_time_us":499,"num_ops":1,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":652,"prepare.run_wall_time_us":652,"replication_time_us":84720}],["op",{"apply.queue_time_us":2665,"apply.run_cpu_time_us":425,"apply.run_wall_time_us":878,"num_ops":1,"prepare.queue_time_us":2461,"prepare.run_cpu_time_us":724,"prepare.run_wall_time_us":723,"replication_time_us":53846}]]}
I20260811 06:17:15.470239 11362 tablet_bootstrap.cc:654] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.470937 14480 ts_tablet_manager.cc:1918] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.471055 14480 log.cc:1196] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:15.471469 14480 ts_tablet_manager.cc:1939] T ae1118c96cff4ea387f3d0ee94bef79b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.471722 11679 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_c27690eca2084b0cbcb99426b13ff8ee" } new_table_name: "default.Table_7fdf20d774f64959bc896c7805f6844f" modify_external_catalogs: true
I20260811 06:17:15.472105 14408 raft_consensus.cc:482] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.472224 14408 raft_consensus.cc:504] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.472494 11361 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.472622 11361 ts_tablet_manager.cc:1397] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.180s user 0.010s sys 0.006s
I20260811 06:17:15.472826 14408 leader_election.cc:288] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.473362 11361 raft_consensus.cc:348] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.473587 11361 raft_consensus.cc:374] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.473552 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.473637 11361 raft_consensus.cc:729] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.473893 11361 consensus_queue.cc:260] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:15.474295 10555 leader_election.cc:341] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.474467 14480 tablet_replica.cc:330] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.474565 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet ae1118c96cff4ea387f3d0ee94bef79b (table default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]) successfully deleted
I20260811 06:17:15.468781 11684 catalog_manager.cc:5495] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:15.471320 14484 raft_consensus.cc:2229] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.474951 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.475343 14484 pending_rounds.cc:62] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
W20260811 06:17:15.475538 10564 leader_election.cc:341] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.475677 10564 leader_election.cc:302] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.474960 11361 ts_tablet_manager.cc:1428] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:15.475904 14480 raft_consensus.cc:2229] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.476035 11361 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.476293 14480 pending_rounds.cc:62] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:15.475682 14484 pending_rounds.cc:68] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213315640344576 op_type: NO_OP noop_request { }
I20260811 06:17:15.477218 14480 pending_rounds.cc:68] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213328944463872 op_type: NO_OP noop_request { }
I20260811 06:17:15.477440 14480 raft_consensus.cc:2866] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:15.477610 14480 raft_consensus.cc:2258] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.478027 14483 ts_tablet_manager.cc:1905] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.479136 11365 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.480860 11365 tablet_bootstrap.cc:654] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.481220 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:15.481475 14408 raft_consensus.cc:2726] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.482167 14480 ts_tablet_manager.cc:1905] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.482601 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:15.485896 14484 raft_consensus.cc:2866] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:15.486111 14484 raft_consensus.cc:2258] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.487438 11361 tablet_bootstrap.cc:654] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.491065 11684 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:15.491856 14480 ts_tablet_manager.cc:1918] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.492606 14480 log.cc:1196] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e329d808c59c4f66bbc515d751255e96
I20260811 06:17:15.493415 14480 ts_tablet_manager.cc:1939] T e329d808c59c4f66bbc515d751255e96 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.494835 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet e329d808c59c4f66bbc515d751255e96 (table default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]) successfully deleted
I20260811 06:17:15.495599 11362 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.495720 11362 ts_tablet_manager.cc:1397] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20260811 06:17:15.496194 14480 tablet_replica.cc:330] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.496361 11362 raft_consensus.cc:348] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.496567 11362 raft_consensus.cc:374] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.496628 11362 raft_consensus.cc:729] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.493948 14484 ts_tablet_manager.cc:1905] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.496855 14480 raft_consensus.cc:2229] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.497294 14480 raft_consensus.cc:2258] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.497321 14348 consensus_queue.cc:1035] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.498064 14480 ts_tablet_manager.cc:1905] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.501317 12944 raft_consensus.cc:482] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.501447 12944 raft_consensus.cc:504] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.496866 11362 consensus_queue.cc:260] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.502005 12944 leader_election.cc:288] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.503007 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.503137 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.503225 10645 raft_consensus.cc:2454] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.503310 11158 raft_consensus.cc:2454] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.503614 10813 leader_election.cc:302] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.503949 12944 raft_consensus.cc:2781] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.504019 12944 raft_consensus.cc:482] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.504087 12944 raft_consensus.cc:3037] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.504163 14408 raft_consensus.cc:482] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.504259 11362 ts_tablet_manager.cc:1428] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260811 06:17:15.504289 14408 raft_consensus.cc:504] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.504848 14408 leader_election.cc:288] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.505534 11362 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.505786 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.505990 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:15.506727 10555 leader_election.cc:341] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.507164 10564 leader_election.cc:341] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.507267 10564 leader_election.cc:302] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.507642 14408 raft_consensus.cc:2726] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.508528 12944 raft_consensus.cc:504] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.509483 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.509675 10645 raft_consensus.cc:3037] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.512468 10645 raft_consensus.cc:2454] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.513644 10810 leader_election.cc:302] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:15.514014 14455 raft_consensus.cc:2781] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.514137 14455 raft_consensus.cc:686] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:15.514359 14455 consensus_queue.cc:237] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.517594 14480 ts_tablet_manager.cc:1918] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.519131 14480 log.cc:1196] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/dc4a4e8bfe3b43aeb0c1617dcb29e685
I20260811 06:17:15.519299 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10bb259b9721485db9c968763434f67e" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:15.519454 12944 leader_election.cc:288] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.519505 11158 raft_consensus.cc:3037] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.520321 14480 ts_tablet_manager.cc:1939] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.521494 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (table default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]) successfully deleted
I20260811 06:17:15.522548 11158 raft_consensus.cc:2454] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.523116 14480 tablet_replica.cc:330] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.523487 14480 raft_consensus.cc:2229] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.523998 14480 pending_rounds.cc:62] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:15.526656 11361 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.526795 11361 ts_tablet_manager.cc:1397] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.001s
I20260811 06:17:15.529156 11361 raft_consensus.cc:348] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.529217 14348 consensus_queue.cc:1035] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.529398 11361 raft_consensus.cc:374] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.529457 11361 raft_consensus.cc:729] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.530918 11361 consensus_queue.cc:260] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.532637 11361 ts_tablet_manager.cc:1428] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:17:15.532948 11361 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.534858 14348 raft_consensus.cc:482] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.534976 14348 raft_consensus.cc:504] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.535554 14348 leader_election.cc:288] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.536463 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.536700 10654 raft_consensus.cc:2454] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.537194 11046 leader_election.cc:302] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.537500 14348 raft_consensus.cc:2781] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.537576 14348 raft_consensus.cc:482] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.537635 14348 raft_consensus.cc:3037] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.538540 14480 pending_rounds.cc:68] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213327912321024 op_type: NO_OP noop_request { }
I20260811 06:17:15.538719 14480 raft_consensus.cc:2866] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:15.538818 14480 raft_consensus.cc:2258] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.540735 14480 ts_tablet_manager.cc:1905] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.540657 14348 raft_consensus.cc:504] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.541359 14348 leader_election.cc:288] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.542318 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.542552 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:15.542960 11047 leader_election.cc:341] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.542997 10654 raft_consensus.cc:3037] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.543677 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:15.545428 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:15.545674 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 167599e794e5436898df2a78c7438d54 (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:15.545867 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:15.546023 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:15.546213 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:15.546592 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:15.546742 14483 ts_tablet_manager.cc:1918] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.546976 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:15.547304 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:15.547780 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:15.548034 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:15.548388 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:15.548931 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:15.549746 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:15.550073 14343 raft_consensus.cc:482] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.550132 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:15.550211 14343 raft_consensus.cc:504] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.550310 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:15.550525 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:15.527987 11362 tablet_bootstrap.cc:654] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.535439 10867 tablet_service.cc:1467] Processing CreateTablet for tablet 167599e794e5436898df2a78c7438d54 (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:15.550732 14343 leader_election.cc:288] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.550998 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167599e794e5436898df2a78c7438d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:15.550981 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:15.551312 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9f44d4df9df7407890790c80fc71f8cb (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:15.553010 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:15.553217 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:15.553565 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:15.536283 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.553839 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:15.554229 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:15.555125 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.555600 11047 leader_election.cc:341] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.556028 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167599e794e5436898df2a78c7438d54. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:15.556334 11047 leader_election.cc:341] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.562505 11361 tablet_bootstrap.cc:654] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.562772 14484 ts_tablet_manager.cc:1918] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.565697 14484 log.cc:1196] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c5c3e243e72f4cffb3318246ab428bd6
I20260811 06:17:15.565827 14480 ts_tablet_manager.cc:1918] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.565989 14480 log.cc:1196] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:15.566493 14480 ts_tablet_manager.cc:1939] T 3b5bb21784e34ad7addf144e0b10a444 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.567358 14484 ts_tablet_manager.cc:1939] T c5c3e243e72f4cffb3318246ab428bd6 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.568270 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:15.568617 14484 tablet_replica.cc:330] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.568720 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet c5c3e243e72f4cffb3318246ab428bd6 (table default.Table_44c05bf06b9b40f4bd44080f3207b882 [id=e41f4c488672459b89866fa1a9b480e5]) successfully deleted
I20260811 06:17:15.569103 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:15.569239 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 3b5bb21784e34ad7addf144e0b10a444 (table default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]) successfully deleted
I20260811 06:17:15.569738 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:15.570302 14480 tablet_replica.cc:330] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.570413 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:15.570499 14480 raft_consensus.cc:2229] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.570839 14480 raft_consensus.cc:2258] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.547753 10654 raft_consensus.cc:2454] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.571275 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:15.571332 14483 log.cc:1196] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:15.548756 10606 tablet_service.cc:1467] Processing CreateTablet for tablet 167599e794e5436898df2a78c7438d54 (DEFAULT_TABLE table=default.Table_b28c0f67c5f24e09a49263620f5d61f3 [id=6dddb4929fdc4aab99d28be6fc14ed40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:15.571578 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:15.571717 14483 ts_tablet_manager.cc:1939] T d9fa71e5477644e0a0d7c40ecc55928b P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:15.571751 10606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167599e794e5436898df2a78c7438d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:15.571866 11365 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.571940 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:15.571981 11365 ts_tablet_manager.cc:1397] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.093s user 0.010s sys 0.011s
I20260811 06:17:15.572605 11365 raft_consensus.cc:348] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.573549 11365 raft_consensus.cc:374] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.573632 11365 raft_consensus.cc:729] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.554091 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.554507 14408 raft_consensus.cc:482] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.573868 11365 consensus_queue.cc:260] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.573884 14408 raft_consensus.cc:504] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.573863 10649 raft_consensus.cc:2454] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.574507 14408 leader_election.cc:288] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.572674 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet d9fa71e5477644e0a0d7c40ecc55928b (table default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]) successfully deleted
W20260811 06:17:15.574896 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because the tablet was not found. No further retry: Not found: Tablet not found: 516e3c37321f4c7b9f3373164682a0ff
W20260811 06:17:15.575098 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 12971f852ea943b78d967f7672680cad because the tablet was not found. No further retry: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
I20260811 06:17:15.575100 11365 ts_tablet_manager.cc:1428] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:15.576041 14480 ts_tablet_manager.cc:1905] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.576786 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.577320 10555 leader_election.cc:341] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.572551 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:15.577687 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:15.577963 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:15.578228 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:15.580626 10029 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
/tmp/dist-test-taskcM0g7B/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--webserver_interface=127.9.203.124
--webserver_port=39467
--builtin_ntp_servers=127.9.203.84:41527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260811 06:17:15.581266 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because the tablet was not found. No further retry: Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
I20260811 06:17:15.581437 11365 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:15.581864 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because the tablet was not found. No further retry: Not found: Tablet not found: dc4a4e8bfe3b43aeb0c1617dcb29e685
W20260811 06:17:15.582719 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
I20260811 06:17:15.582846 11365 tablet_bootstrap.cc:654] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.582988 14483 tablet_replica.cc:330] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.583781 14483 raft_consensus.cc:2229] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.588971 14483 raft_consensus.cc:2258] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.580062 11362 tablet_bootstrap.cc:492] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.592559 14480 ts_tablet_manager.cc:1918] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.592907 14480 log.cc:1196] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:15.593039 14483 ts_tablet_manager.cc:1905] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.593495 14480 ts_tablet_manager.cc:1939] T a183d0915a5a48c2a26994d47f6fe266 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.574504 11046 leader_election.cc:302] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.593865 14484 raft_consensus.cc:2229] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.592689 11362 ts_tablet_manager.cc:1397] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
I20260811 06:17:15.595309 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a183d0915a5a48c2a26994d47f6fe266 (table default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]) successfully deleted
I20260811 06:17:15.595503 11362 raft_consensus.cc:348] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.595762 11362 raft_consensus.cc:374] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.595829 11362 raft_consensus.cc:729] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.596071 11362 consensus_queue.cc:260] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.596686 14480 tablet_replica.cc:330] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.597096 14480 raft_consensus.cc:2229] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.597497 14480 raft_consensus.cc:2258] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.598158 14480 ts_tablet_manager.cc:1905] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.603916 11362 ts_tablet_manager.cc:1428] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260811 06:17:15.605535 11362 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.607194 14483 ts_tablet_manager.cc:1918] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.607875 14483 log.cc:1196] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:15.607888 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:15.608211 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:15.608279 14483 ts_tablet_manager.cc:1939] T 32407c8872464da2b1470a8ae21c86fd P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:15.608407 11365 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.608485 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:15.608542 11365 ts_tablet_manager.cc:1397] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.001s
I20260811 06:17:15.608837 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:15.609838 11362 tablet_bootstrap.cc:654] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.610160 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:15.610700 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:15.610834 11365 raft_consensus.cc:348] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.611050 11365 raft_consensus.cc:374] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.611107 11365 raft_consensus.cc:729] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.611304 11365 consensus_queue.cc:260] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.612087 14484 raft_consensus.cc:2258] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.579433 14348 raft_consensus.cc:482] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.612320 14348 raft_consensus.cc:504] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.612638 14484 ts_tablet_manager.cc:1905] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.612978 14348 leader_election.cc:288] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.593932 14352 raft_consensus.cc:2781] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.613469 14352 raft_consensus.cc:482] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.613584 14352 raft_consensus.cc:3037] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.594322 11046 leader_election.cc:302] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.576735 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.611904 11361 tablet_bootstrap.cc:492] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.614903 11361 ts_tablet_manager.cc:1397] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.002s
I20260811 06:17:15.614905 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.615121 10923 raft_consensus.cc:2454] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.615231 14343 raft_consensus.cc:2781] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.615289 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.615370 14343 raft_consensus.cc:686] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.615499 10649 raft_consensus.cc:2454] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.615710 11047 leader_election.cc:302] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.615643 14343 consensus_queue.cc:237] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.616333 14289 raft_consensus.cc:2781] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.616415 14289 raft_consensus.cc:482] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.616282 11361 raft_consensus.cc:348] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.616505 14289 raft_consensus.cc:3037] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.616526 11361 raft_consensus.cc:374] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.616601 11361 raft_consensus.cc:729] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.616787 11361 consensus_queue.cc:260] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.617300 11361 ts_tablet_manager.cc:1428] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260811 06:17:15.617568 10564 leader_election.cc:341] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.617699 10564 leader_election.cc:302] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.618109 14408 raft_consensus.cc:2726] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.619349 14289 raft_consensus.cc:504] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.620658 14352 raft_consensus.cc:504] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.621070 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.621320 11361 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.621443 14352 leader_election.cc:288] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.623867 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c03f18c65ada4b0b86534d29cd363d9a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.624064 10649 raft_consensus.cc:3037] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.624094 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 32407c8872464da2b1470a8ae21c86fd (table default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]) successfully deleted
W20260811 06:17:15.624441 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:15.624715 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:15.624655 14348 consensus_queue.cc:1035] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:15.624915 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:15.625140 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:15.625360 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because the tablet was not found. No further retry: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
W20260811 06:17:15.625603 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
W20260811 06:17:15.625856 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 91f079882c3c46318f70190d5293868e because the tablet was not found. No further retry: Not found: Tablet not found: 91f079882c3c46318f70190d5293868e
I20260811 06:17:15.626127 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.626331 10654 raft_consensus.cc:3037] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.626699 10649 raft_consensus.cc:2454] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.627125 11046 leader_election.cc:302] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.627415 14348 raft_consensus.cc:2781] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.627552 14348 raft_consensus.cc:686] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.627774 14348 consensus_queue.cc:237] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.628856 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:15.629083 10654 raft_consensus.cc:2454] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.630856 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:15.632143 11047 leader_election.cc:341] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.633028 11046 leader_election.cc:302] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.633625 13740 raft_consensus.cc:2781] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.633783 13740 raft_consensus.cc:686] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.634018 13740 consensus_queue.cc:237] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.637872 14289 leader_election.cc:288] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.641899 12944 raft_consensus.cc:482] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.642058 12944 raft_consensus.cc:504] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:15.642580 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
I20260811 06:17:15.642659 12944 leader_election.cc:288] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.643190 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c997501cefd4e6b9e5824e5403dd39b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.643430 11163 raft_consensus.cc:2454] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:15.643699 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1a2e55d5e0244c299d837aed98f94aad because the tablet was not found. No further retry: Not found: Tablet not found: 1a2e55d5e0244c299d837aed98f94aad
W20260811 06:17:15.643790 10810 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:15.644496 10813 leader_election.cc:302] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
W20260811 06:17:15.644785 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:15.644837 14455 raft_consensus.cc:2781] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.644914 14455 raft_consensus.cc:482] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.644980 14455 raft_consensus.cc:3037] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.645620 11365 ts_tablet_manager.cc:1428] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
W20260811 06:17:15.645872 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:15.646854 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a04766ede03342efb594aaf081e112af because the tablet was not found. No further retry: Not found: Tablet not found: a04766ede03342efb594aaf081e112af
I20260811 06:17:15.647527 14483 tablet_replica.cc:330] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.648126 14483 raft_consensus.cc:2229] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.648281 14455 raft_consensus.cc:504] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.648823 14455 leader_election.cc:288] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.648873 14483 raft_consensus.cc:2258] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.649422 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c997501cefd4e6b9e5824e5403dd39b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:15.649505 10810 leader_election.cc:341] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:15.647790 11365 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.649631 11163 raft_consensus.cc:3037] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.650363 14483 ts_tablet_manager.cc:1905] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.652318 11163 raft_consensus.cc:2454] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.652880 10813 leader_election.cc:302] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:15.653268 14455 raft_consensus.cc:2781] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.654143 14352 raft_consensus.cc:482] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.654311 14352 raft_consensus.cc:504] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.654515 14455 raft_consensus.cc:686] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:15.654752 14455 consensus_queue.cc:237] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.655088 14408 raft_consensus.cc:482] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.655220 14408 raft_consensus.cc:504] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.655779 14408 leader_election.cc:288] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.654917 14352 leader_election.cc:288] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.656652 12944 raft_consensus.cc:482] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.656773 12944 raft_consensus.cc:504] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.657199 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.657260 12944 leader_election.cc:288] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.657397 10654 raft_consensus.cc:2454] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.657836 11046 leader_election.cc:302] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.658226 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.658360 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.658469 11361 tablet_bootstrap.cc:654] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.658221 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.651096 11365 tablet_bootstrap.cc:654] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:15.659153 10555 leader_election.cc:341] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.661360 14480 ts_tablet_manager.cc:1918] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.662119 14289 raft_consensus.cc:2781] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.662178 14480 log.cc:1196] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/516e3c37321f4c7b9f3373164682a0ff
I20260811 06:17:15.662066 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b246b0e53af34c089f4fd67174396f44" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.662482 14480 ts_tablet_manager.cc:1939] T 516e3c37321f4c7b9f3373164682a0ff P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.662468 14289 raft_consensus.cc:482] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.662565 14289 raft_consensus.cc:3037] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.663945 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 516e3c37321f4c7b9f3373164682a0ff (table default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]) successfully deleted
I20260811 06:17:15.664755 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
W20260811 06:17:15.662082 11047 leader_election.cc:341] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.665011 14480 tablet_replica.cc:330] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.665198 14480 raft_consensus.cc:2229] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.665503 14480 pending_rounds.cc:62] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:15.665555 14480 pending_rounds.cc:68] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213317993119744 op_type: NO_OP noop_request { }
I20260811 06:17:15.665762 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_c27690eca2084b0cbcb99426b13ff8ee [id=31d35606d6554b798cc3890eae2547ab]). Expected version 1 got 0
I20260811 06:17:15.666060 10813 leader_election.cc:302] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.666182 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.666656 12944 raft_consensus.cc:2726] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:15.666718 10564 leader_election.cc:341] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.666704 14289 raft_consensus.cc:504] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.666826 10564 leader_election.cc:302] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.667202 14408 raft_consensus.cc:2726] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.667390 14289 leader_election.cc:288] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.668007 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:15.668581 11047 leader_election.cc:341] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.668826 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.665664 14480 raft_consensus.cc:2866] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:15.669085 14480 raft_consensus.cc:2258] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.669113 10654 raft_consensus.cc:3037] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.669689 14480 ts_tablet_manager.cc:1905] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.671679 10654 raft_consensus.cc:2454] T 576a3e27d5424e4b999a05beb898d4bb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.672135 11046 leader_election.cc:302] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.674571 14408 raft_consensus.cc:482] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.674638 14343 raft_consensus.cc:2781] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.674686 14408 raft_consensus.cc:504] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.674948 14343 raft_consensus.cc:686] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.675261 14408 leader_election.cc:288] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.675318 14343 consensus_queue.cc:237] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.676242 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.676787 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
W20260811 06:17:15.676817 10555 leader_election.cc:341] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.677110 11362 tablet_bootstrap.cc:492] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.677114 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.677240 11362 ts_tablet_manager.cc:1397] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.001s
W20260811 06:17:15.677682 10564 leader_election.cc:341] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.677810 10564 leader_election.cc:302] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.678145 14408 raft_consensus.cc:2726] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.678272 11362 raft_consensus.cc:348] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.678494 11362 raft_consensus.cc:374] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.678546 11362 raft_consensus.cc:729] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.678831 11362 consensus_queue.cc:260] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.680207 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:15.683089 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:15.684114 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:15.684329 14455 raft_consensus.cc:482] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.684458 14455 raft_consensus.cc:504] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.685379 14455 leader_election.cc:288] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.685637 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.685891 10654 raft_consensus.cc:2454] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.686065 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.686260 10810 leader_election.cc:302] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:15.686322 11163 raft_consensus.cc:2454] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:15.686380 14480 ts_tablet_manager.cc:1918] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.686487 14480 log.cc:1196] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:15.686565 14455 raft_consensus.cc:2781] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.686645 14455 raft_consensus.cc:482] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.686714 14455 raft_consensus.cc:3037] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.686813 14480 ts_tablet_manager.cc:1939] T 585f92fc5b3d41bd97df525380fcab9f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.688329 11365 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.688453 11365 ts_tablet_manager.cc:1397] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.009s
I20260811 06:17:15.689085 11365 raft_consensus.cc:348] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.689276 11365 raft_consensus.cc:374] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.689318 11365 raft_consensus.cc:729] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.689239 14455 raft_consensus.cc:504] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.689484 11365 consensus_queue.cc:260] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.690596 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:15.690613 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:15.690802 11163 raft_consensus.cc:3037] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.691198 11365 ts_tablet_manager.cc:1428] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:15.692329 11365 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:15.693763 14455 leader_election.cc:288] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:15.693841 11365 tablet_bootstrap.cc:654] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.693758 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:15.694098 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:15.694386 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:15.694559 10910 raft_consensus.cc:3037] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.696167 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9f44d4df9df7407890790c80fc71f8cb (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:15.696367 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:15.696827 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:15.697098 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:15.697572 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:15.697861 14343 consensus_queue.cc:1035] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.697993 11653 catalog_manager.cc:5495] T 00c91236a8304bf2a03e85a5864aa669 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:15.698607 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_aae70e5ddc0c49fea99f4f77e876a4fd [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 1 got 0
I20260811 06:17:15.699769 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c03ffd4a98a49258a0c0d72aa6fb6eb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.700028 10654 raft_consensus.cc:3037] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.700096 10923 raft_consensus.cc:3037] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.702555 10923 raft_consensus.cc:2454] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.703212 10654 raft_consensus.cc:2454] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:15.703660 10810 leader_election.cc:302] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:15.703964 12944 raft_consensus.cc:2781] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.704082 12944 raft_consensus.cc:686] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:15.704277 12944 consensus_queue.cc:237] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.704792 14483 ts_tablet_manager.cc:1918] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.704921 14483 log.cc:1196] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/f6f682f675c344b6b5955e834f94091f
I20260811 06:17:15.705238 14483 ts_tablet_manager.cc:1939] T f6f682f675c344b6b5955e834f94091f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:15.710114 11362 ts_tablet_manager.cc:1428] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260811 06:17:15.710368 14484 ts_tablet_manager.cc:1918] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.711670 14483 tablet_replica.cc:330] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.711891 14483 raft_consensus.cc:2229] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.712049 14483 raft_consensus.cc:2258] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.712201 11362 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.712109 14343 consensus_queue.cc:1035] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.713016 14480 tablet_replica.cc:330] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.712085 14484 log.cc:1196] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/91f079882c3c46318f70190d5293868e
I20260811 06:17:15.713451 14484 ts_tablet_manager.cc:1939] T 91f079882c3c46318f70190d5293868e P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.713577 14483 ts_tablet_manager.cc:1905] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.715279 11361 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.715477 11361 ts_tablet_manager.cc:1397] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260811 06:17:15.715210 14480 raft_consensus.cc:2229] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.716269 11361 raft_consensus.cc:348] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.716511 11361 raft_consensus.cc:374] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.716564 11361 raft_consensus.cc:729] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.716895 11361 consensus_queue.cc:260] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.698617 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 585f92fc5b3d41bd97df525380fcab9f (table default.Table_ea9c5d260a4a4dbaa9e355ce5f3f6d16 [id=5c6263242a8e458d9828e75a26bf6849]) successfully deleted
I20260811 06:17:15.706339 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet f6f682f675c344b6b5955e834f94091f (table default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]) successfully deleted
I20260811 06:17:15.716877 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 91f079882c3c46318f70190d5293868e (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]) successfully deleted
I20260811 06:17:15.717509 11361 ts_tablet_manager.cc:1428] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:15.717780 11361 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.717039 14480 raft_consensus.cc:2258] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.718622 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:15.718883 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:15.718884 14480 ts_tablet_manager.cc:1905] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.719152 11361 tablet_bootstrap.cc:654] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.719300 14484 tablet_replica.cc:330] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.719461 11362 tablet_bootstrap.cc:654] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.721024 14484 raft_consensus.cc:2229] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.724287 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:15.724547 14484 raft_consensus.cc:2258] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.724997 14343 consensus_queue.cc:1035] T 5753a44d13f943c695497573b56eec6c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.725703 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:15.725097 14484 ts_tablet_manager.cc:1905] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.727129 14343 raft_consensus.cc:482] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.727495 14343 raft_consensus.cc:504] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.728446 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.728667 10649 raft_consensus.cc:2454] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.729212 11046 leader_election.cc:302] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.729611 14343 leader_election.cc:288] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.729633 14352 raft_consensus.cc:2781] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.729799 14352 raft_consensus.cc:482] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.729877 14352 raft_consensus.cc:3037] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.730528 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.732759 11362 tablet_bootstrap.cc:492] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.732908 11362 ts_tablet_manager.cc:1397] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260811 06:17:15.733549 11362 raft_consensus.cc:348] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.733760 11362 raft_consensus.cc:374] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.733825 11362 raft_consensus.cc:729] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.734043 11362 consensus_queue.cc:260] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.735708 11362 ts_tablet_manager.cc:1428] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:15.735657 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:15.736122 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:15.736464 11365 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.736624 11365 ts_tablet_manager.cc:1397] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.006s
I20260811 06:17:15.736788 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:15.737141 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:15.737222 11365 raft_consensus.cc:348] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.737414 11365 raft_consensus.cc:374] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.737437 11362 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.737463 11365 raft_consensus.cc:729] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.738799 11362 tablet_bootstrap.cc:654] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.739425 14348 consensus_queue.cc:1035] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260811 06:17:15.740885 14408 raft_consensus.cc:482] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.741026 14408 raft_consensus.cc:504] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.741627 14408 leader_election.cc:288] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:15.741766 11047 leader_election.cc:341] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.742246 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.742432 14352 raft_consensus.cc:504] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.742568 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.742726 10564 leader_election.cc:341] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:15.743057 10555 leader_election.cc:341] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.743160 10555 leader_election.cc:302] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.743275 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.743460 10649 raft_consensus.cc:3037] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.743492 14408 raft_consensus.cc:2726] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.737649 11365 consensus_queue.cc:260] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.744232 14352 leader_election.cc:288] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.744490 14352 raft_consensus.cc:482] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.744596 14352 raft_consensus.cc:504] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.745375 11365 ts_tablet_manager.cc:1428] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:15.746066 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:15.746253 10645 raft_consensus.cc:2454] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:15.746443 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.746479 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eede55349694488b9899ec56a80c8d5b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.746800 11046 leader_election.cc:302] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:15.747005 11365 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:15.746976 11047 leader_election.cc:341] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.747071 14289 raft_consensus.cc:2781] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:15.747133 14289 raft_consensus.cc:482] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:15.747184 14289 raft_consensus.cc:3037] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:15.747162 11047 leader_election.cc:341] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.747316 14352 leader_election.cc:288] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.748306 11365 tablet_bootstrap.cc:654] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.749042 14480 ts_tablet_manager.cc:1918] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.749146 14480 log.cc:1196] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:15.749491 14480 ts_tablet_manager.cc:1939] T 8741294bc33e454a9c4ef1717ccef80f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.750123 10649 raft_consensus.cc:2454] T eede55349694488b9899ec56a80c8d5b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.750581 11046 leader_election.cc:302] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.750864 14480 tablet_replica.cc:330] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.749607 14289 raft_consensus.cc:504] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.751242 14480 raft_consensus.cc:2229] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.751387 14289 leader_election.cc:288] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.751507 14480 raft_consensus.cc:2258] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.751538 14289 raft_consensus.cc:2781] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.751636 14289 raft_consensus.cc:686] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.751822 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:15.751899 14289 consensus_queue.cc:237] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:15.752313 11047 leader_election.cc:341] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.752676 14480 ts_tablet_manager.cc:1905] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.753197 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:15.753378 10649 raft_consensus.cc:3037] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:15.755884 10649 raft_consensus.cc:2454] T 7821b08482ed49ea8e90155805a88ae5 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:15.756289 11046 leader_election.cc:302] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:15.756651 14352 raft_consensus.cc:2781] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:15.756759 14352 raft_consensus.cc:686] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:15.756953 14352 consensus_queue.cc:237] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.765909 14480 ts_tablet_manager.cc:1918] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.766203 14480 log.cc:1196] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/12971f852ea943b78d967f7672680cad
I20260811 06:17:15.766667 14480 ts_tablet_manager.cc:1939] T 12971f852ea943b78d967f7672680cad P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.770598 11361 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.750633 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 8741294bc33e454a9c4ef1717ccef80f (table default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]) successfully deleted
I20260811 06:17:15.770761 11361 ts_tablet_manager.cc:1397] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20260811 06:17:15.770973 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:15.771029 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 12971f852ea943b78d967f7672680cad (table default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]) successfully deleted
W20260811 06:17:15.771293 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c5c3e243e72f4cffb3318246ab428bd6 because the tablet was not found. No further retry: Not found: Tablet not found: c5c3e243e72f4cffb3318246ab428bd6
I20260811 06:17:15.771373 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
W20260811 06:17:15.771548 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61114d1bcdb94af7b6c55b0331accee5 because the tablet was not found. No further retry: Not found: Tablet not found: 61114d1bcdb94af7b6c55b0331accee5
I20260811 06:17:15.771458 11361 raft_consensus.cc:348] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.771672 11361 raft_consensus.cc:374] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.771721 11361 raft_consensus.cc:729] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:15.771811 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:15.771890 11361 consensus_queue.cc:260] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:15.772061 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2b0ae9a1d3b74c3985637439819b63ef because the tablet was not found. No further retry: Not found: Tablet not found: 2b0ae9a1d3b74c3985637439819b63ef
W20260811 06:17:15.772248 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0813b34919a14a2481857e9f87b217c8 because the tablet was not found. No further retry: Not found: Tablet not found: 0813b34919a14a2481857e9f87b217c8
I20260811 06:17:15.772455 11361 ts_tablet_manager.cc:1428] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260811 06:17:15.772469 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
W20260811 06:17:15.772683 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:15.772722 11361 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.773386 11163 raft_consensus.cc:2454] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:17:15.774287 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:15.774300 14483 ts_tablet_manager.cc:1918] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.774452 14483 log.cc:1196] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/7bcc463affbb4154877624aec28435bc
I20260811 06:17:15.774813 14483 ts_tablet_manager.cc:1939] T 7bcc463affbb4154877624aec28435bc P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:15.775065 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
W20260811 06:17:15.775699 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 916b91088d7d4024a02214c958c0825b because the tablet was not found. No further retry: Not found: Tablet not found: 916b91088d7d4024a02214c958c0825b
I20260811 06:17:15.776089 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 7bcc463affbb4154877624aec28435bc (table default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]) successfully deleted
W20260811 06:17:15.776376 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because the tablet was not found. No further retry: Not found: Tablet not found: 6703e639ab2042e78fadc63bd18c7602
W20260811 06:17:15.777455 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:15.778056 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:15.778553 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8b282afe70184b0fb68d0e7cdcbcd2b7 because the tablet was not found. No further retry: Not found: Tablet not found: 8b282afe70184b0fb68d0e7cdcbcd2b7
W20260811 06:17:15.779094 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
W20260811 06:17:15.780438 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:15.781044 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:15.781533 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
I20260811 06:17:15.786859 14352 consensus_queue.cc:1035] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.788491 10747 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:15.796640 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:15.771814 11653 catalog_manager.cc:5495] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:15.799328 11362 tablet_bootstrap.cc:492] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:15.799479 11362 ts_tablet_manager.cc:1397] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.000s
I20260811 06:17:15.774154 11361 tablet_bootstrap.cc:654] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.800182 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:15.800936 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:15.801276 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:15.801573 11362 raft_consensus.cc:348] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.801833 11362 raft_consensus.cc:374] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:15.801854 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3b5bb21784e34ad7addf144e0b10a444 because the tablet was not found. No further retry: Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:15.801894 11362 raft_consensus.cc:729] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.802099 11362 consensus_queue.cc:260] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.802654 11362 ts_tablet_manager.cc:1428] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 06:17:15.802991 11362 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:15.803215 14408 raft_consensus.cc:482] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.803361 14408 raft_consensus.cc:504] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.804009 14408 leader_election.cc:288] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.804601 14480 tablet_replica.cc:330] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.804798 14480 raft_consensus.cc:2229] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.804795 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:15.804880 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because the tablet was not found. No further retry: Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:15.804945 14480 raft_consensus.cc:2258] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:15.805188 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 14a36a644dc4491dad838ce4e19793ab because the tablet was not found. No further retry: Not found: Tablet not found: 14a36a644dc4491dad838ce4e19793ab
W20260811 06:17:15.805265 10564 leader_election.cc:341] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.805470 11362 tablet_bootstrap.cc:654] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.806360 11365 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:15.806507 11365 ts_tablet_manager.cc:1397] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.002s
W20260811 06:17:15.806494 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:15.806742 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:15.805455 14480 ts_tablet_manager.cc:1905] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.806974 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 91f079882c3c46318f70190d5293868e because the tablet was not found. No further retry: Not found: Tablet not found: 91f079882c3c46318f70190d5293868e
I20260811 06:17:15.807160 11365 raft_consensus.cc:348] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.807358 11365 raft_consensus.cc:374] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.807420 11365 raft_consensus.cc:729] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.807616 11365 consensus_queue.cc:260] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.808012 14483 tablet_replica.cc:330] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.808530 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.808694 14483 raft_consensus.cc:2229] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:15.809139 10555 leader_election.cc:341] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.809247 10555 leader_election.cc:302] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.802210 11653 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:15.810635 11679 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 167) took 2810 ms. Trace:
I20260811 06:17:15.810788 11679 rpcz_store.cc:276] 0811 06:17:13.000415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.471532 (+2471117us) service_pool.cc:227] Handling call
0811 06:17:15.475376 (+ 3844us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:15.476081 (+ 705us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:15.476264 (+ 183us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:15.476327 (+ 63us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:15.490753 (+ 14426us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.490759 (+ 6us) write_op.cc:454] Released schema lock
0811 06:17:15.490832 (+ 73us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:15.810593 (+319761us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.484117 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.484256 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.484264 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:15.484267 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.484402 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.484418 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.484423 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.484496 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:15.484499 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:15.484543 (+ 44us) write_op.cc:270] Start()
0811 06:17:15.484581 (+ 38us) write_op.cc:276] Timestamp: P: 1786429035482246 usec, L: 0
0811 06:17:15.484586 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.484799 (+ 213us) log.cc:842] Serialized 405 byte log entry
0811 06:17:15.488040 (+ 3241us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.488226 (+ 186us) write_op.cc:301] APPLY: starting
0811 06:17:15.488243 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.488283 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.488329 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.488387 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.488420 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.488426 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:15.488509 (+ 83us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.488584 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.488604 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:15.488611 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":445,"apply.run_wall_time_us":444,"num_ops":1,"prepare.queue_time_us":7289,"prepare.run_cpu_time_us":827,"prepare.run_wall_time_us":828,"raft.queue_time_us":172,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":324,"replication_time_us":3428}]]}
I20260811 06:17:15.809269 14484 ts_tablet_manager.cc:1918] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.810181 11361 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.814097 14484 log.cc:1196] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:15.814179 11361 ts_tablet_manager.cc:1397] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260811 06:17:15.815007 14480 ts_tablet_manager.cc:1918] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.814896 11361 raft_consensus.cc:348] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.815104 14480 log.cc:1196] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:15.815109 11361 raft_consensus.cc:374] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.815162 11361 raft_consensus.cc:729] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.815372 14480 ts_tablet_manager.cc:1939] T 035eee1d37c94471a7cd697fb0fbb951 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.816064 14408 raft_consensus.cc:482] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.815948 14484 ts_tablet_manager.cc:1939] T 1a2e55d5e0244c299d837aed98f94aad P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.816184 14408 raft_consensus.cc:504] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.816736 14408 leader_election.cc:288] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.817029 14483 raft_consensus.cc:2258] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.817216 14484 tablet_replica.cc:330] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.817265 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:15.817408 14484 raft_consensus.cc:2229] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.817553 14484 raft_consensus.cc:2258] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.818470 14484 ts_tablet_manager.cc:1905] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.819142 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 1a2e55d5e0244c299d837aed98f94aad (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2]) successfully deleted
W20260811 06:17:15.819415 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because the tablet was not found. No further retry: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
W20260811 06:17:15.817759 10564 leader_election.cc:341] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.817581 14483 ts_tablet_manager.cc:1905] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.821115 14408 raft_consensus.cc:2726] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.821980 11365 ts_tablet_manager.cc:1428] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260811 06:17:15.825920 11361 consensus_queue.cc:260] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.827678 11365 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:15.829051 11670 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5195c4d7b09d45b8873575e1f67a5cb3 consensus state has no leader
I20260811 06:17:15.829241 11365 tablet_bootstrap.cc:654] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:15.829772 11672 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1168c63178174571907981d4a6ac165f consensus state has no leader
I20260811 06:17:15.830410 11656 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_d4486408cf04456dab448807e8c08e90 [id=5c3567ca43b14ae78bd7df4dc89d4733] alter complete (version 2)
W20260811 06:17:15.832150 11656 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7b815bc117cf46db8250f33e5fec861d consensus state has no leader
I20260811 06:17:15.832612 11361 ts_tablet_manager.cc:1428] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260811 06:17:15.833009 11361 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.834426 11361 tablet_bootstrap.cc:654] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:15.836813 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 91) took 2087 ms (client timeout 1000 ms). Trace:
W20260811 06:17:15.836913 11676 rpcz_store.cc:269] 0811 06:17:13.749057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.940268 (+191211us) service_pool.cc:227] Handling call
0811 06:17:14.368748 (+428480us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:14.368755 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:15.836748 (+1467993us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:14.359525 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:14.359660 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:14.359668 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:14.359671 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:14.359783 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:14.359798 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:14.359803 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:14.359876 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:14.359879 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:14.359917 (+ 38us) write_op.cc:270] Start()
0811 06:17:14.359953 (+ 36us) write_op.cc:276] Timestamp: P: 1786429034359861 usec, L: 0
0811 06:17:14.359957 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:14.360185 (+ 228us) log.cc:842] Serialized 530 byte log entry
0811 06:17:14.363692 (+ 3507us) op_driver.cc:444] REPLICATION: finished
0811 06:17:14.364257 (+ 565us) write_op.cc:301] APPLY: starting
0811 06:17:14.364277 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:14.364326 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:14.364355 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:14.364420 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:14.364456 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:14.364476 (+ 20us) write_op.cc:312] APPLY: finished
0811 06:17:14.364565 (+ 89us) log.cc:842] Serialized 23 byte log entry
0811 06:17:14.364626 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:14.364647 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:14.364654 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":498,"apply.run_cpu_time_us":464,"apply.run_wall_time_us":464,"num_ops":1,"prepare.queue_time_us":8861,"prepare.run_cpu_time_us":776,"prepare.run_wall_time_us":775,"raft.queue_time_us":88,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":243,"replication_time_us":3709}]]}
W20260811 06:17:15.839039 11683 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 60c3a381b6744b8d989d644f2b643958 (table default.Table_c8f687b8d15f43d2a993c347c59f46cb [id=3576c6c61875418e96e50dad6f8414a2], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 60c3a381b6744b8d989d644f2b643958 consensus state has no leader
W20260811 06:17:15.839696 11683 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc consensus state has no leader
I20260811 06:17:15.840495 14484 ts_tablet_manager.cc:1918] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.840600 14484 log.cc:1196] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:15.840973 14484 ts_tablet_manager.cc:1939] T 8741294bc33e454a9c4ef1717ccef80f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.843966 14483 ts_tablet_manager.cc:1918] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.844107 14483 log.cc:1196] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:15.844398 14483 ts_tablet_manager.cc:1939] T 10211a4e95464e9e9e2b2e70d23086a5 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:15.845309 14483 tablet_replica.cc:330] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:15.845525 14483 raft_consensus.cc:2229] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.845674 14483 raft_consensus.cc:2258] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.846256 14483 ts_tablet_manager.cc:1905] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.851620 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.851848 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.851902 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]) successfully deleted
I20260811 06:17:15.852005 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852154 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852221 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852286 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852411 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852464 10629 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852481 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet e4171d257dd6453a9159c59ae713b2e0 with delete_type TABLET_DATA_DELETED (replaced by tablet a815299e01bb4e3dabe0627edb86c3a6) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852291 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852653 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 with delete_type TABLET_DATA_DELETED (replaced by tablet 2707979dce35428aa7145e9b34959989) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852705 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852656 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852783 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852909 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.852949 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853055 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853199 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853377 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853452 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853344 14352 consensus_queue.cc:1035] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.853624 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.853848 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854033 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854212 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854380 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854545 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854689 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854835 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.854959 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.856109 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 8741294bc33e454a9c4ef1717ccef80f (table default.Table_2c44fbe8edf948bb9f2584bfc76ce1cb [id=f652e10764a84067b2bfb3494a807263]) successfully deleted
I20260811 06:17:15.857055 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857268 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857402 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857523 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857663 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 91f079882c3c46318f70190d5293868e with delete_type TABLET_DATA_DELETED (replaced by tablet 1f50ee875a8e4fa3b5738c9660a46c91) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857690 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 1349b0ea48b848398d4bdda528358c30 with delete_type TABLET_DATA_DELETED (replaced by tablet 5195c4d7b09d45b8873575e1f67a5cb3) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857846 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 0813b34919a14a2481857e9f87b217c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 0a67f283a7a6447daaecc9c03703b977) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.857966 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.858073 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.858186 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet c5c3e243e72f4cffb3318246ab428bd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.858289 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.858404 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.873138 14352 consensus_queue.cc:1035] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.876472 11361 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.876632 11361 ts_tablet_manager.cc:1397] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.003s
I20260811 06:17:15.877275 11361 raft_consensus.cc:348] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.877507 11361 raft_consensus.cc:374] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.877568 11361 raft_consensus.cc:729] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.882392 14484 tablet_replica.cc:330] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:15.882709 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1a2e55d5e0244c299d837aed98f94aad because the tablet was not found. No further retry: Not found: Tablet not found: 1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:15.883083 14484 raft_consensus.cc:2229] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.884052 14484 raft_consensus.cc:2258] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:15.885537 11683 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 97) took 3387 ms (client timeout 1000 ms). Trace:
W20260811 06:17:15.885674 11683 rpcz_store.cc:269] 0811 06:17:12.498572 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:12.611033 (+112461us) service_pool.cc:227] Handling call
0811 06:17:15.885497 (+3274464us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":83412,"reported_tablets":198}
I20260811 06:17:15.887519 14484 ts_tablet_manager.cc:1905] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.885514 11361 consensus_queue.cc:260] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.888475 11683 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_58a2488cc0fa41369792941575db1367" } new_table_name: "default.Table_177834d7b9304f4da015488acfeb6ef9" modify_external_catalogs: true
W20260811 06:17:15.892045 11656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 98) took 2326 ms (client timeout 1000 ms). Trace:
I20260811 06:17:15.888770 11361 ts_tablet_manager.cc:1428] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260811 06:17:15.893029 11361 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.894737 11361 tablet_bootstrap.cc:654] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.898097 11684 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_06207def0d7646999e471424624de3fd [id=32c58f06cf094acdac22d9ca6fe36811] alter complete (version 1)
I20260811 06:17:15.837646 11676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_74b425e2198e46b0933c2694cd644a24" } modify_external_catalogs: true
I20260811 06:17:15.899601 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b4eb7864cc742929ac1756949b6bec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:15.899866 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:15.892366 11656 rpcz_store.cc:269] 0811 06:17:13.565554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.630080 (+ 64526us) service_pool.cc:227] Handling call
0811 06:17:15.892002 (+2261922us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.002487 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.002646 (+ 159us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.002655 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:15.002658 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.002835 (+ 177us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.002850 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.002855 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.002967 (+ 112us) tablet.cc:699] Row locks acquired
0811 06:17:15.002969 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:15.003010 (+ 41us) write_op.cc:270] Start()
0811 06:17:15.003048 (+ 38us) write_op.cc:276] Timestamp: P: 1786429035000760 usec, L: 0
0811 06:17:15.003052 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.003304 (+ 252us) log.cc:842] Serialized 530 byte log entry
0811 06:17:15.086743 (+ 83439us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.107365 (+ 20622us) write_op.cc:301] APPLY: starting
0811 06:17:15.107388 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.107439 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.107476 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.107572 (+ 96us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.107610 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.107617 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:15.107752 (+ 135us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.107852 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.107877 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:15.107885 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.142271 (+ 34386us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.142279 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:15.370734 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.370855 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.370862 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:15.370864 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:15.370990 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.371005 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.371010 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.371086 (+ 76us) tablet.cc:699] Row locks acquired
0811 06:17:15.371088 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:15.371133 (+ 45us) write_op.cc:270] Start()
0811 06:17:15.371174 (+ 41us) write_op.cc:276] Timestamp: P: 1786429035368845 usec, L: 0
0811 06:17:15.371178 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.372934 (+ 1756us) log.cc:842] Serialized 356 byte log entry
0811 06:17:15.382692 (+ 9758us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.382801 (+ 109us) write_op.cc:301] APPLY: starting
0811 06:17:15.382821 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.382866 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.382912 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.382972 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.383009 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.383016 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:15.383103 (+ 87us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.383174 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.383196 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:15.383203 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.383262 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.383266 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":197,"child_traces":[["op",{"apply.queue_time_us":20535,"apply.run_cpu_time_us":724,"apply.run_wall_time_us":34998,"num_ops":1,"prepare.queue_time_us":12149,"prepare.run_cpu_time_us":1012,"prepare.run_wall_time_us":56835,"raft.queue_time_us":1226,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":2751,"replication_time_us":83658,"thread_start_us":61873,"threads_started":2}],["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":525,"apply.run_wall_time_us":524,"num_ops":1,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":930,"prepare.run_wall_time_us":2339,"raft.queue_time_us":178,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":249,"replication_time_us":11487}]]}
I20260811 06:17:15.927917 11656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_5d578b33478a413dac2573d652e6b411" } modify_external_catalogs: true
I20260811 06:17:15.929167 14584 tablet.cc:1722] T 17d90d3d23454c5bbeba1bb900b68c73 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:15.930150 14586 tablet.cc:1722] T 17d90d3d23454c5bbeba1bb900b68c73 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:15.930226 14483 ts_tablet_manager.cc:1918] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.930354 14483 log.cc:1196] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:15.930730 14480 tablet_replica.cc:330] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.930891 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 035eee1d37c94471a7cd697fb0fbb951 (table default.Table_1fd91288bb3747f69cb7219edb4271cb [id=8324cf6df8c9498f88e086e707131358]) successfully deleted
I20260811 06:17:15.930979 14480 raft_consensus.cc:2229] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.931118 14480 raft_consensus.cc:2258] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.931888 14480 ts_tablet_manager.cc:1905] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:15.931694 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:15.932065 14483 ts_tablet_manager.cc:1939] T fdc323cf778548ae86f45f0fd8bd4a89 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:15.932739 10555 leader_election.cc:341] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.932854 10555 leader_election.cc:302] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:15.933220 14467 raft_consensus.cc:2726] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:15.934500 14484 ts_tablet_manager.cc:1918] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.934633 14484 log.cc:1196] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:15.934746 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]) successfully deleted
I20260811 06:17:15.934931 14484 ts_tablet_manager.cc:1939] T 3b5bb21784e34ad7addf144e0b10a444 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:15.938313 14480 ts_tablet_manager.cc:1918] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.938525 14480 log.cc:1196] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/5e990aa374204f2b95c08b04121176bc
I20260811 06:17:15.938859 14480 ts_tablet_manager.cc:1939] T 5e990aa374204f2b95c08b04121176bc P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.940002 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 5e990aa374204f2b95c08b04121176bc (table default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]) successfully deleted
W20260811 06:17:15.940752 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because the tablet was not found. No further retry: Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
W20260811 06:17:15.941454 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
W20260811 06:17:15.942173 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:15.942793 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:15.943406 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:15.943696 11655 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_236cd15efbb74d3abf8d6140bb8702e3 [id=a7bbd23c07d24c52b33a8082168cbf87] alter complete (version 2)
I20260811 06:17:15.934849 14100 consensus_queue.cc:1035] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:15.948390 14484 tablet_replica.cc:330] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:15.948861 14484 raft_consensus.cc:2229] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:15.949458 14484 raft_consensus.cc:2258] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.949879 14480 tablet_replica.cc:330] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:15.950158 14480 raft_consensus.cc:2229] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:15.950382 14480 raft_consensus.cc:2258] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:15.951584 14480 ts_tablet_manager.cc:1905] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.954111 11684 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 92) took 969 ms (client timeout 1000 ms). Trace:
W20260811 06:17:15.954314 11684 rpcz_store.cc:269] 0811 06:17:14.984698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.376943 (+392245us) service_pool.cc:227] Handling call
0811 06:17:15.954062 (+577119us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.497827 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.497954 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.497961 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:15.497964 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.498165 (+ 201us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.498179 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.498184 (+ 5us) tablet.cc:683] Acquiring locks for 5 operations
0811 06:17:15.498366 (+ 182us) tablet.cc:699] Row locks acquired
0811 06:17:15.498369 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:15.498408 (+ 39us) write_op.cc:270] Start()
0811 06:17:15.498440 (+ 32us) write_op.cc:276] Timestamp: P: 1786429035498390 usec, L: 0
0811 06:17:15.498444 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.498638 (+ 194us) log.cc:842] Serialized 2039 byte log entry
0811 06:17:15.501963 (+ 3325us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.502108 (+ 145us) write_op.cc:301] APPLY: starting
0811 06:17:15.502124 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.502226 (+ 102us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.502252 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.502378 (+ 126us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.502415 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0811 06:17:15.502421 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:15.502505 (+ 84us) log.cc:842] Serialized 47 byte log entry
0811 06:17:15.502570 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.502594 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:15.502601 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.502656 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.502660 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:15.869294 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.869422 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.869429 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:15.869431 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:15.869561 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.869574 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.869580 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.869654 (+ 74us) tablet.cc:699] Row locks acquired
0811 06:17:15.869656 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:15.869693 (+ 37us) write_op.cc:270] Start()
0811 06:17:15.869756 (+ 63us) write_op.cc:276] Timestamp: P: 1786429035869640 usec, L: 0
0811 06:17:15.869761 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.869969 (+ 208us) log.cc:842] Serialized 356 byte log entry
0811 06:17:15.881487 (+ 11518us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.881642 (+ 155us) write_op.cc:301] APPLY: starting
0811 06:17:15.881660 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.881703 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.881792 (+ 89us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.881859 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.881897 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.881905 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:15.882028 (+ 123us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.882108 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.882132 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:15.882139 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.882202 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.882206 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5109,"reported_tablets":59,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":609,"apply.run_wall_time_us":608,"num_ops":5,"prepare.queue_time_us":5750,"prepare.run_cpu_time_us":929,"prepare.run_wall_time_us":929,"raft.queue_time_us":142,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":254,"replication_time_us":3497}],["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":598,"apply.run_wall_time_us":619,"num_ops":1,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":792,"prepare.run_wall_time_us":792,"raft.queue_time_us":136,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":11696}]]}
I20260811 06:17:15.951963 11361 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.955757 11361 ts_tablet_manager.cc:1397] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20260811 06:17:15.956548 11361 raft_consensus.cc:348] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.956784 11361 raft_consensus.cc:374] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.956843 11361 raft_consensus.cc:729] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.957597 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.957844 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.958007 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.958178 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a2e55d5e0244c299d837aed98f94aad with delete_type TABLET_DATA_DELETED (replaced by tablet 60c3a381b6744b8d989d644f2b643958) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.958702 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.959148 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.959324 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:15.957007 11361 consensus_queue.cc:260] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.959986 11361 ts_tablet_manager.cc:1428] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260811 06:17:15.960240 11361 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.961580 11361 tablet_bootstrap.cc:654] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:15.957505 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 3b5bb21784e34ad7addf144e0b10a444 (table default.Table_39662cb2c2484aff9fdaff055087b0ae [id=84c12a1a837a449da0c81b870920883a]) successfully deleted
I20260811 06:17:15.967119 14484 ts_tablet_manager.cc:1905] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:15.967758 11047 consensus_peers.cc:487] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:15.970639 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_be815b4de0f84b5c9d50ed9794cf6acc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:15.973309 11361 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:15.973470 11361 ts_tablet_manager.cc:1397] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
W20260811 06:17:15.973853 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be815b4de0f84b5c9d50ed9794cf6acc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:15.974488 11361 raft_consensus.cc:348] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.978379 11361 raft_consensus.cc:374] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:15.978842 11361 raft_consensus.cc:729] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:15.979409 11361 consensus_queue.cc:260] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:15.980033 11361 ts_tablet_manager.cc:1428] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:17:15.980327 11361 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:15.980598 14100 raft_consensus.cc:482] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:15.980707 14100 raft_consensus.cc:504] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:15.981303 14100 leader_election.cc:288] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:15.981876 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:15.982545 11047 leader_election.cc:341] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:15.983639 14480 ts_tablet_manager.cc:1918] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:15.983767 14480 log.cc:1196] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a04766ede03342efb594aaf081e112af
I20260811 06:17:15.984103 14480 ts_tablet_manager.cc:1939] T a04766ede03342efb594aaf081e112af P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:15.985146 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]) successfully deleted
I20260811 06:17:15.988862 14484 ts_tablet_manager.cc:1918] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:15.993824 11670 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 166) took 3008 ms. Trace:
I20260811 06:17:15.994000 11670 rpcz_store.cc:276] 0811 06:17:12.984973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.456060 (+2471087us) service_pool.cc:227] Handling call
0811 06:17:15.456530 (+ 470us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:15.456791 (+ 261us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:15.457011 (+ 220us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:15.457073 (+ 62us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:15.463926 (+ 6853us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:15.993777 (+529851us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.457626 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.457765 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.457771 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:15.457774 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.457882 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.457898 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.457903 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.457981 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:15.457983 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:15.458020 (+ 37us) write_op.cc:270] Start()
0811 06:17:15.458054 (+ 34us) write_op.cc:276] Timestamp: P: 1786429035455728 usec, L: 0
0811 06:17:15.458058 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.458273 (+ 215us) log.cc:842] Serialized 405 byte log entry
0811 06:17:15.461522 (+ 3249us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.461645 (+ 123us) write_op.cc:301] APPLY: starting
0811 06:17:15.461659 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.461701 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.461768 (+ 67us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.461824 (+ 56us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.461859 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.461865 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:15.461942 (+ 77us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.462005 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.462021 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:15.462028 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.462087 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.462090 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":474,"apply.run_wall_time_us":499,"num_ops":1,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":787,"prepare.run_wall_time_us":787,"raft.queue_time_us":165,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":302,"replication_time_us":3442}]]}
I20260811 06:17:15.995358 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_646c2b7f00884690b290fe7959028e5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:15.996013 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_646c2b7f00884690b290fe7959028e5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.000168 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 6703e639ab2042e78fadc63bd18c7602 because the tablet was not found. No further retry: Not found: Tablet not found: 6703e639ab2042e78fadc63bd18c7602
I20260811 06:17:16.000684 14484 log.cc:1196] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:16.001178 14480 tablet_replica.cc:330] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.001693 14484 ts_tablet_manager.cc:1939] T ae1118c96cff4ea387f3d0ee94bef79b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.002192 14480 raft_consensus.cc:2229] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:16.002740 14480 pending_rounds.cc:62] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:16.003397 14480 pending_rounds.cc:68] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213330044502016 op_type: NO_OP noop_request { }
I20260811 06:17:16.004484 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.004745 10649 raft_consensus.cc:2454] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.005223 11046 leader_election.cc:302] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.005415 14483 tablet_replica.cc:330] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.006057 14100 raft_consensus.cc:2781] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.006150 14100 raft_consensus.cc:482] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.006220 14100 raft_consensus.cc:3037] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.009012 14100 raft_consensus.cc:504] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.009622 14100 leader_election.cc:288] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.012244 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.012682 10655 raft_consensus.cc:3037] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.016161 10655 raft_consensus.cc:2454] T a33fc402d3084b458929d76b8fc22adb P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.016767 11046 leader_election.cc:302] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:16.017161 14100 raft_consensus.cc:2781] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.017421 14100 raft_consensus.cc:686] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.017771 14100 consensus_queue.cc:237] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.018899 14588 tablet.cc:1722] T 17d90d3d23454c5bbeba1bb900b68c73 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.010257 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a33fc402d3084b458929d76b8fc22adb" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:16.022179 14480 raft_consensus.cc:2866] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:16.022301 14480 raft_consensus.cc:2258] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.017251 14455 raft_consensus.cc:482] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.022581 14455 raft_consensus.cc:504] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.023141 14484 tablet_replica.cc:330] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.023255 14455 leader_election.cc:288] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.023375 14484 raft_consensus.cc:2229] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.023518 14484 raft_consensus.cc:2258] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.023507 14480 ts_tablet_manager.cc:1905] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.023908 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet ae1118c96cff4ea387f3d0ee94bef79b (table default.Table_f17b738cb4a84bcfbda964f7e432d1d5 [id=591fdcf6724e454999d9317bc3c79455]) successfully deleted
I20260811 06:17:16.024019 14484 ts_tablet_manager.cc:1905] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:16.024209 11047 leader_election.cc:341] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:16.024348 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 152f7db9fc6241c8abfdafd3adc30d47 because the tablet was not found. No further retry: Not found: Tablet not found: 152f7db9fc6241c8abfdafd3adc30d47
W20260811 06:17:16.024564 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 91f079882c3c46318f70190d5293868e because the tablet was not found. No further retry: Not found: Tablet not found: 91f079882c3c46318f70190d5293868e
W20260811 06:17:16.024760 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1349b0ea48b848398d4bdda528358c30 because the tablet was not found. No further retry: Not found: Tablet not found: 1349b0ea48b848398d4bdda528358c30
I20260811 06:17:16.026399 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10211a4e95464e9e9e2b2e70d23086a5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.026587 11163 raft_consensus.cc:2454] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:16.027422 10810 leader_election.cc:341] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
W20260811 06:17:16.028347 11047 consensus_peers.cc:487] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.028633 10813 leader_election.cc:302] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:16.029090 14455 raft_consensus.cc:2781] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.029165 14455 raft_consensus.cc:482] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.029220 14455 raft_consensus.cc:3037] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.030776 11672 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 165) took 3060 ms. Trace:
I20260811 06:17:16.030894 11672 rpcz_store.cc:276] 0811 06:17:12.970778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.432352 (+2461574us) service_pool.cc:227] Handling call
0811 06:17:15.458934 (+ 26582us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:15.459156 (+ 222us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:15.459310 (+ 154us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:15.459386 (+ 76us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:15.467137 (+ 7751us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:16.030706 (+563569us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.461314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.461407 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.461413 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:15.461415 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:15.461497 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.461506 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.461510 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.461564 (+ 54us) tablet.cc:699] Row locks acquired
0811 06:17:15.461566 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:15.461596 (+ 30us) write_op.cc:270] Start()
0811 06:17:15.461626 (+ 30us) write_op.cc:276] Timestamp: P: 1786429035459305 usec, L: 0
0811 06:17:15.461630 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.461803 (+ 173us) log.cc:842] Serialized 405 byte log entry
0811 06:17:15.466583 (+ 4780us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.466709 (+ 126us) write_op.cc:301] APPLY: starting
0811 06:17:15.466723 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.466760 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.466794 (+ 34us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.466839 (+ 45us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.466869 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.466875 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:15.466950 (+ 75us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.467026 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.467044 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:15.467050 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.467109 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.467113 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":465,"apply.run_wall_time_us":463,"num_ops":1,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":596,"prepare.run_wall_time_us":597,"raft.queue_time_us":59,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":4930}]]}
I20260811 06:17:16.031919 14455 raft_consensus.cc:504] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.032059 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 172) took 2899 ms. Trace:
I20260811 06:17:16.032187 11670 rpcz_store.cc:276] 0811 06:17:13.132487 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.995078 (+2862591us) service_pool.cc:227] Handling call
0811 06:17:15.996123 (+ 1045us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:15.996694 (+ 571us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.012160 (+ 15466us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.031882 (+ 19722us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.032016 (+ 134us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.997314 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.997414 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.997421 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:15.997424 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.997514 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.997530 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.997535 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:15.997616 (+ 81us) tablet.cc:699] Row locks acquired
0811 06:17:15.997619 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:15.997655 (+ 36us) write_op.cc:270] Start()
0811 06:17:15.997689 (+ 34us) write_op.cc:276] Timestamp: P: 1786429035997590 usec, L: 0
0811 06:17:15.997693 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.997954 (+ 261us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.001390 (+ 3436us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.001919 (+ 529us) write_op.cc:301] APPLY: starting
0811 06:17:16.001936 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.001982 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.002011 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.002135 (+ 124us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.002172 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.002178 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.002259 (+ 81us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.002320 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.002342 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:16.002348 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.002400 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.002403 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":465,"apply.run_cpu_time_us":551,"apply.run_wall_time_us":551,"num_ops":2,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":766,"prepare.run_wall_time_us":766,"raft.queue_time_us":221,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":231,"replication_time_us":3675}]]}
I20260811 06:17:16.033143 11670 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_248c738c20484140804c4244faa27ca4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.033843 11670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_248c738c20484140804c4244faa27ca4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.032500 11672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_34ed67520b7e43ed919366773d11e54e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.035344 11672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34ed67520b7e43ed919366773d11e54e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.037698 10810 leader_election.cc:341] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:16.038242 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10211a4e95464e9e9e2b2e70d23086a5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:16.038422 11163 raft_consensus.cc:3037] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.041791 10923 raft_consensus.cc:3037] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.046568 14402 raft_consensus.cc:482] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.046705 14402 raft_consensus.cc:504] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.047237 14402 leader_election.cc:288] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.047224 11163 raft_consensus.cc:2454] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:16.047436 14100 consensus_queue.cc:1035] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.050076 11676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_74b425e2198e46b0933c2694cd644a24" } modify_external_catalogs: true
I20260811 06:17:16.050755 11670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 174) took 2861 ms. Trace:
W20260811 06:17:16.050933 10810 leader_election.cc:341] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:16.052239 10813 leader_election.cc:302] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:16.052500 14402 raft_consensus.cc:2781] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.052433 11656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_5d578b33478a413dac2573d652e6b411" } modify_external_catalogs: true
I20260811 06:17:16.052651 14402 raft_consensus.cc:686] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:16.052925 14402 consensus_queue.cc:237] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.053175 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc323cf778548ae86f45f0fd8bd4a89" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.051232 11670 rpcz_store.cc:276] 0811 06:17:13.189561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.032936 (+2843375us) service_pool.cc:227] Handling call
0811 06:17:16.033963 (+ 1027us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.034415 (+ 452us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.050295 (+ 15880us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.050603 (+ 308us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.050704 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.035563 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.035646 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.035652 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.035654 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.035734 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.035744 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.035749 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.038283 (+ 2534us) tablet.cc:699] Row locks acquired
0811 06:17:16.038287 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:16.038329 (+ 42us) write_op.cc:270] Start()
0811 06:17:16.038364 (+ 35us) write_op.cc:276] Timestamp: P: 1786429036038308 usec, L: 0
0811 06:17:16.038368 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.038556 (+ 188us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.044362 (+ 5806us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.045080 (+ 718us) write_op.cc:301] APPLY: starting
0811 06:17:16.045091 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.045124 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.045148 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.045264 (+ 116us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.045291 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.045297 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.045355 (+ 58us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.045398 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.045413 (+ 15us) write_op.cc:454] Released schema lock
0811 06:17:16.045419 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.045482 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.045485 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":688,"apply.run_cpu_time_us":452,"apply.run_wall_time_us":450,"num_ops":2,"prepare.queue_time_us":743,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":5761,"raft.queue_time_us":505,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":5977,"threads_started":1}]]}
I20260811 06:17:16.053893 10813 leader_election.cc:302] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.054291 12944 raft_consensus.cc:2726] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.055261 14455 leader_election.cc:288] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.057176 14100 consensus_queue.cc:1035] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.029649 14483 raft_consensus.cc:2229] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.059752 14483 raft_consensus.cc:2258] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.060413 14483 ts_tablet_manager.cc:1905] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.063524 14480 ts_tablet_manager.cc:1918] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.073729 11361 tablet_bootstrap.cc:654] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.088646 11672 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 173) took 2926 ms. Trace:
I20260811 06:17:16.088785 11672 rpcz_store.cc:276] 0811 06:17:13.162155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.032147 (+2869992us) service_pool.cc:227] Handling call
0811 06:17:16.035433 (+ 3286us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.035850 (+ 417us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.074622 (+ 38772us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.088464 (+ 13842us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.088570 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.041376 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.041502 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.041507 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:16.041510 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.041593 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.041603 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.041607 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.041683 (+ 76us) tablet.cc:699] Row locks acquired
0811 06:17:16.041685 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.041746 (+ 61us) write_op.cc:270] Start()
0811 06:17:16.041780 (+ 34us) write_op.cc:276] Timestamp: P: 1786429036041722 usec, L: 0
0811 06:17:16.041793 (+ 13us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.041980 (+ 187us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.056353 (+ 14373us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.056428 (+ 75us) write_op.cc:301] APPLY: starting
0811 06:17:16.056444 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.056498 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.056567 (+ 69us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.056753 (+ 186us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.056791 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.056796 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:16.056898 (+ 102us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.057215 (+ 317us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.057236 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.057244 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.074789 (+ 17545us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.074795 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":19,"apply.run_cpu_time_us":754,"apply.run_wall_time_us":18446,"num_ops":2,"prepare.queue_time_us":5106,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":1417,"raft.queue_time_us":678,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":14538}]]}
I20260811 06:17:16.094403 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 171) took 2994 ms. Trace:
I20260811 06:17:16.094626 11684 rpcz_store.cc:276] 0811 06:17:13.099719 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.960037 (+2860318us) service_pool.cc:227] Handling call
0811 06:17:16.054343 (+ 94306us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.054824 (+ 481us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.083280 (+ 28456us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.094252 (+ 10972us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.094348 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.075451 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.075557 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.075563 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.075565 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.075668 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.075678 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.075683 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.075763 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:16.075765 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.075800 (+ 35us) write_op.cc:270] Start()
0811 06:17:16.075831 (+ 31us) write_op.cc:276] Timestamp: P: 1786429036075776 usec, L: 0
0811 06:17:16.075835 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.076006 (+ 171us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.082120 (+ 6114us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.082203 (+ 83us) write_op.cc:301] APPLY: starting
0811 06:17:16.082244 (+ 41us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.082312 (+ 68us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.082389 (+ 77us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.082596 (+ 207us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.082657 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.082662 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:16.082797 (+ 135us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.083129 (+ 332us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.083150 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.083157 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.083481 (+ 324us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.083519 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":733,"apply.run_wall_time_us":1397,"num_ops":2,"prepare.queue_time_us":20161,"prepare.run_cpu_time_us":711,"prepare.run_wall_time_us":10185,"raft.queue_time_us":3288,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"replication_time_us":6260}]]}
I20260811 06:17:16.095985 14480 log.cc:1196] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:16.096524 14480 ts_tablet_manager.cc:1939] T 8c997501cefd4e6b9e5824e5403dd39b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.096354 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_fc4a1a0d46f1451ebd5ae01ad358ff90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.096695 14467 raft_consensus.cc:482] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.096858 14467 raft_consensus.cc:504] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.097487 14467 leader_election.cc:288] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.097878 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 8c997501cefd4e6b9e5824e5403dd39b (table default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]) successfully deleted
I20260811 06:17:16.098217 14480 tablet_replica.cc:330] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.098266 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5008449b09e43fba758a7edab4a5c48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.098448 14480 raft_consensus.cc:2229] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:16.098699 14480 pending_rounds.cc:62] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:16.098769 14480 pending_rounds.cc:68] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213331676082176 op_type: NO_OP noop_request { }
I20260811 06:17:16.098906 14480 raft_consensus.cc:2866] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:16.099023 14480 raft_consensus.cc:2258] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.099352 10555 leader_election.cc:341] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:16.099848 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc4a1a0d46f1451ebd5ae01ad358ff90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.104274 11362 tablet_bootstrap.cc:492] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.108906 11362 ts_tablet_manager.cc:1397] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.306s user 0.022s sys 0.011s
I20260811 06:17:16.109529 14480 ts_tablet_manager.cc:1905] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.109670 11362 raft_consensus.cc:348] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.109949 11362 raft_consensus.cc:374] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.110025 11362 raft_consensus.cc:729] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.110502 11362 consensus_queue.cc:260] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.115402 11362 ts_tablet_manager.cc:1428] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:16.116788 11362 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.118029 14467 raft_consensus.cc:482] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.118182 14467 raft_consensus.cc:504] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.118376 11362 tablet_bootstrap.cc:654] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.118873 14467 leader_election.cc:288] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.119509 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d9627d9f88466ba499aa175151f46a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:16.120069 10555 leader_election.cc:341] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.122373 14484 ts_tablet_manager.cc:1918] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.123632 14484 log.cc:1196] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/0813b34919a14a2481857e9f87b217c8
I20260811 06:17:16.122969 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d9627d9f88466ba499aa175151f46a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.098712 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5008449b09e43fba758a7edab4a5c48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.124523 11158 raft_consensus.cc:2454] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 0.
W20260811 06:17:16.125393 10564 leader_election.cc:341] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.125516 10564 leader_election.cc:302] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.125896 10564 leader_election.cc:302] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.126153 14408 raft_consensus.cc:2726] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.126302 14408 raft_consensus.cc:2781] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.126354 14408 raft_consensus.cc:482] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.126412 14408 raft_consensus.cc:3037] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.128237 14480 ts_tablet_manager.cc:1918] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.128361 14480 log.cc:1196] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:16.128751 14480 ts_tablet_manager.cc:1939] T 10211a4e95464e9e9e2b2e70d23086a5 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.128861 14408 raft_consensus.cc:504] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.129453 14408 leader_election.cc:288] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Requested vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.130218 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]) successfully deleted
I20260811 06:17:16.130349 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5008449b09e43fba758a7edab4a5c48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:16.130532 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5008449b09e43fba758a7edab4a5c48" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:16.130710 11158 raft_consensus.cc:3037] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:16.131275 10555 leader_election.cc:341] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.131771 14480 tablet_replica.cc:330] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.132091 14480 raft_consensus.cc:2229] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.132323 14480 raft_consensus.cc:2258] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.133297 14480 ts_tablet_manager.cc:1905] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.134096 11365 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.134275 11365 ts_tablet_manager.cc:1397] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.307s user 0.013s sys 0.009s
I20260811 06:17:16.134997 11365 raft_consensus.cc:348] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.135267 11365 raft_consensus.cc:374] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.135354 11365 raft_consensus.cc:729] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.135679 11365 consensus_queue.cc:260] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.137154 11365 ts_tablet_manager.cc:1428] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:16.137986 11365 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.139572 11158 raft_consensus.cc:2454] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24d29113b2454d9c93e23db3e3dac801 in term 1.
I20260811 06:17:16.140290 14484 ts_tablet_manager.cc:1939] T 0813b34919a14a2481857e9f87b217c8 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.140617 10564 leader_election.cc:302] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.140992 14408 raft_consensus.cc:2781] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.141155 14408 raft_consensus.cc:686] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Becoming Leader. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Running, Role: LEADER
I20260811 06:17:16.141553 14484 tablet_replica.cc:330] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.141528 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 0813b34919a14a2481857e9f87b217c8 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]) successfully deleted
I20260811 06:17:16.141840 14484 raft_consensus.cc:2229] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.142006 14484 raft_consensus.cc:2258] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.141863 14408 consensus_queue.cc:237] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.142616 14484 ts_tablet_manager.cc:1905] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.155563 14480 ts_tablet_manager.cc:1918] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.156344 14480 log.cc:1196] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:16.162858 14348 consensus_queue.cc:1035] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.163410 11362 tablet_bootstrap.cc:492] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.163641 11362 ts_tablet_manager.cc:1397] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.002s
I20260811 06:17:16.164480 11362 raft_consensus.cc:348] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.164870 11362 raft_consensus.cc:374] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.165002 11362 raft_consensus.cc:729] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.165329 11362 consensus_queue.cc:260] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.168107 11365 tablet_bootstrap.cc:654] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.168916 11361 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.169302 11362 ts_tablet_manager.cc:1428] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260811 06:17:16.169433 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 175) took 2976 ms. Trace:
I20260811 06:17:16.169632 11684 rpcz_store.cc:276] 0811 06:17:13.193077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.096100 (+2903023us) service_pool.cc:227] Handling call
0811 06:17:16.100034 (+ 3934us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.100678 (+ 644us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.125446 (+ 24768us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.125455 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:16.131388 (+ 5933us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.169250 (+ 37862us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.169377 (+ 127us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.101221 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.101324 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.101331 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.101333 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.101418 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.101518 (+ 100us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.101527 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.101630 (+ 103us) tablet.cc:699] Row locks acquired
0811 06:17:16.101632 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.101677 (+ 45us) write_op.cc:270] Start()
0811 06:17:16.101738 (+ 61us) write_op.cc:276] Timestamp: P: 1786429036101647 usec, L: 0
0811 06:17:16.101741 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.101948 (+ 207us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.105835 (+ 3887us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.108127 (+ 2292us) write_op.cc:301] APPLY: starting
0811 06:17:16.108146 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.108189 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.108230 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.108344 (+ 114us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.108380 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.108386 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.108484 (+ 98us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.108554 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.108576 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:16.108582 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1998,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":529,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":887,"prepare.run_wall_time_us":2164,"raft.queue_time_us":572,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":225,"replication_time_us":4069}]]}
I20260811 06:17:16.170639 11362 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.171373 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_70c04617779f409ebcd0de067b766d8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.172116 11361 ts_tablet_manager.cc:1397] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.192s user 0.004s sys 0.001s
W20260811 06:17:16.172165 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70c04617779f409ebcd0de067b766d8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.172892 11361 raft_consensus.cc:348] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.176085 11361 raft_consensus.cc:374] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.176214 11361 raft_consensus.cc:729] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.175972 14484 ts_tablet_manager.cc:1918] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.176570 14484 log.cc:1196] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/dc4a4e8bfe3b43aeb0c1617dcb29e685
I20260811 06:17:16.177175 11361 consensus_queue.cc:260] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.177521 11362 tablet_bootstrap.cc:654] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.177501 14484 ts_tablet_manager.cc:1939] T dc4a4e8bfe3b43aeb0c1617dcb29e685 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.178409 14348 raft_consensus.cc:482] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.178784 14480 ts_tablet_manager.cc:1939] T fdc323cf778548ae86f45f0fd8bd4a89 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.178748 14348 raft_consensus.cc:504] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.179330 14348 leader_election.cc:288] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.180049 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.180749 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]) successfully deleted
W20260811 06:17:16.181502 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 78d94d27431a4d5e93f1c1ce8c7b6752 because the tablet was not found. No further retry: Not found: Tablet not found: 78d94d27431a4d5e93f1c1ce8c7b6752
W20260811 06:17:16.182302 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:16.182452 11047 leader_election.cc:341] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.182829 14480 tablet_replica.cc:330] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.183116 14480 raft_consensus.cc:2229] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:16.183197 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.183537 14480 raft_consensus.cc:2258] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.184111 14480 ts_tablet_manager.cc:1905] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.183416 10655 raft_consensus.cc:2454] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.185367 11046 leader_election.cc:302] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.185812 14100 raft_consensus.cc:2781] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.185948 14100 raft_consensus.cc:482] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.186067 14100 raft_consensus.cc:3037] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.188840 14100 raft_consensus.cc:504] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.189224 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 176) took 2933 ms. Trace:
I20260811 06:17:16.189399 11684 rpcz_store.cc:276] 0811 06:17:13.255272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.171123 (+2915851us) service_pool.cc:227] Handling call
0811 06:17:16.172280 (+ 1157us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.172753 (+ 473us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.188832 (+ 16079us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.188840 (+ 8us) write_op.cc:454] Released schema lock
0811 06:17:16.188946 (+ 106us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.189071 (+ 125us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.189177 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.174089 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.174216 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.174236 (+ 20us) write_op.cc:435] Acquired schema lock
0811 06:17:16.174239 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.174532 (+ 293us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.174549 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.174553 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.174648 (+ 95us) tablet.cc:699] Row locks acquired
0811 06:17:16.174651 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.174882 (+ 231us) write_op.cc:270] Start()
0811 06:17:16.174922 (+ 40us) write_op.cc:276] Timestamp: P: 1786429036174845 usec, L: 0
0811 06:17:16.174942 (+ 20us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.175166 (+ 224us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.180576 (+ 5410us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.180737 (+ 161us) write_op.cc:301] APPLY: starting
0811 06:17:16.180754 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.180801 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.180830 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.180955 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.180995 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.181001 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.181090 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.181161 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.181186 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:16.181193 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":103,"apply.run_cpu_time_us":524,"apply.run_wall_time_us":523,"num_ops":2,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":911,"prepare.run_wall_time_us":9462,"raft.queue_time_us":66,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":391,"replication_time_us":5608}]]}
I20260811 06:17:16.190433 11361 ts_tablet_manager.cc:1428] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20260811 06:17:16.191346 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 (table default.Table_71a49e0ffd5f4420a30d39b21a9487af [id=e254b8915e5b46c491e3415ff670b6a0]) successfully deleted
I20260811 06:17:16.191331 14348 raft_consensus.cc:482] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.192257 14348 raft_consensus.cc:504] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.193042 14348 leader_election.cc:288] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.193892 14100 leader_election.cc:288] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.193908 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.194325 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:16.194868 11047 leader_election.cc:341] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:16.195122 11047 leader_election.cc:341] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.197672 11361 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.199292 14484 tablet_replica.cc:330] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.199509 14484 raft_consensus.cc:2229] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.199682 14484 raft_consensus.cc:2258] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.203073 11362 tablet_bootstrap.cc:492] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.206131 14484 ts_tablet_manager.cc:1905] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.206636 11362 ts_tablet_manager.cc:1397] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.003s
I20260811 06:17:16.207723 11362 raft_consensus.cc:348] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.209051 11362 raft_consensus.cc:374] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.209983 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_324a200ace884f2bbede37c5207d7f93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.210471 11361 tablet_bootstrap.cc:654] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.211115 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_324a200ace884f2bbede37c5207d7f93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.212807 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.213009 10655 raft_consensus.cc:3037] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.214293 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.214495 10654 raft_consensus.cc:2454] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.215049 11046 leader_election.cc:302] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.215510 14100 raft_consensus.cc:2781] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.215586 14100 raft_consensus.cc:482] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.215641 14100 raft_consensus.cc:3037] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.217737 14467 raft_consensus.cc:482] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.217898 14467 raft_consensus.cc:504] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.218135 14100 raft_consensus.cc:504] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.218914 14100 leader_election.cc:288] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.219419 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:16.219552 14467 leader_election.cc:288] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:16.220655 11047 leader_election.cc:341] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.220811 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.221014 10645 raft_consensus.cc:3037] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.221033 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.221514 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
W20260811 06:17:16.221611 10555 leader_election.cc:341] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.221778 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:16.221976 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:16.221909 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.222210 11679 catalog_manager.cc:5495] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:16.222703 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:16.223338 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:16.223639 10645 raft_consensus.cc:2454] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.223652 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:16.224911 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 177) took 2954 ms. Trace:
I20260811 06:17:16.225426 10655 raft_consensus.cc:2454] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.225116 11684 rpcz_store.cc:276] 0811 06:17:13.270855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.209539 (+2938684us) service_pool.cc:227] Handling call
0811 06:17:16.211296 (+ 1757us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.211790 (+ 494us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.224663 (+ 12873us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.224778 (+ 115us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.224870 (+ 92us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.212407 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.212522 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.212531 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:16.212533 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.212639 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.212657 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.212661 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.212767 (+ 106us) tablet.cc:699] Row locks acquired
0811 06:17:16.212770 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.212815 (+ 45us) write_op.cc:270] Start()
0811 06:17:16.212857 (+ 42us) write_op.cc:276] Timestamp: P: 1786429036212774 usec, L: 0
0811 06:17:16.212862 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.213116 (+ 254us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.220783 (+ 7667us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.221202 (+ 419us) write_op.cc:301] APPLY: starting
0811 06:17:16.221222 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.221298 (+ 76us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.221334 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.221463 (+ 129us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.221506 (+ 43us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.221512 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.221605 (+ 93us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.221676 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.221701 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:16.221709 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.223410 (+ 1701us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.223417 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":344,"apply.run_cpu_time_us":726,"apply.run_wall_time_us":2287,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":837,"prepare.run_wall_time_us":839,"raft.queue_time_us":984,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":302,"replication_time_us":7891}]]}
W20260811 06:17:16.225950 10564 leader_election.cc:341] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.226075 10564 leader_election.cc:302] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.226418 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_7f87228ce650443f9095ff35a39e7bfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.226545 11046 leader_election.cc:302] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.226936 11046 leader_election.cc:302] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:16.227170 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f87228ce650443f9095ff35a39e7bfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.227169 14289 raft_consensus.cc:2781] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.227296 14289 raft_consensus.cc:686] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.227322 14467 raft_consensus.cc:2726] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.227536 14289 consensus_queue.cc:237] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.228089 14100 raft_consensus.cc:2781] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.228268 14100 raft_consensus.cc:686] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.228529 14100 consensus_queue.cc:237] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.236063 11361 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.236214 11361 ts_tablet_manager.cc:1397] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260811 06:17:16.236778 14483 ts_tablet_manager.cc:1918] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.236974 14483 log.cc:1196] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/45fc206d95a244e395d19328ae289485
I20260811 06:17:16.236946 11361 raft_consensus.cc:348] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.237159 11361 raft_consensus.cc:374] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.237210 11361 raft_consensus.cc:729] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.237421 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 178) took 2941 ms. Trace:
I20260811 06:17:16.237452 11361 consensus_queue.cc:260] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.237622 14483 ts_tablet_manager.cc:1939] T 45fc206d95a244e395d19328ae289485 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.238018 11361 ts_tablet_manager.cc:1428] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:16.237614 11684 rpcz_store.cc:276] 0811 06:17:13.295549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.226138 (+2930589us) service_pool.cc:227] Handling call
0811 06:17:16.227350 (+ 1212us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.227819 (+ 469us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.237103 (+ 9284us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.237240 (+ 137us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.237369 (+ 129us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.228371 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.228501 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.228507 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.228509 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.228602 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.228616 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.228620 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.228703 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:16.228706 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.228743 (+ 37us) write_op.cc:270] Start()
0811 06:17:16.228783 (+ 40us) write_op.cc:276] Timestamp: P: 1786429036228703 usec, L: 0
0811 06:17:16.228787 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.228997 (+ 210us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.233120 (+ 4123us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.234821 (+ 1701us) write_op.cc:301] APPLY: starting
0811 06:17:16.234840 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.234894 (+ 54us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.234940 (+ 46us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.235077 (+ 137us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.235113 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.235120 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.235201 (+ 81us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.235260 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.235282 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:16.235289 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.235339 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.235343 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1634,"apply.run_cpu_time_us":577,"apply.run_wall_time_us":578,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":739,"prepare.run_wall_time_us":739,"raft.queue_time_us":167,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":227,"replication_time_us":4305}]]}
I20260811 06:17:16.238684 14483 tablet_replica.cc:330] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.238770 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 45fc206d95a244e395d19328ae289485 (table default.Table_c37fb719a3e14506afcc1723b90ae323 [id=effd576838844300b8d7a4ee9a30a0d0]) successfully deleted
I20260811 06:17:16.238890 14483 raft_consensus.cc:2229] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.239032 14483 raft_consensus.cc:2258] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.240214 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_63f05d0e9aaa4fb5a48aa59062a3a456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.240940 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63f05d0e9aaa4fb5a48aa59062a3a456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.243782 11361 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.245364 11361 tablet_bootstrap.cc:654] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.209297 11362 raft_consensus.cc:729] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.246290 11362 consensus_queue.cc:260] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.247362 11365 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.247495 11365 ts_tablet_manager.cc:1397] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.001s
I20260811 06:17:16.223832 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:16.249521 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_7fdf20d774f64959bc896c7805f6844f [id=31d35606d6554b798cc3890eae2547ab]). Expected version 2 got 0
I20260811 06:17:16.249567 11362 ts_tablet_manager.cc:1428] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20260811 06:17:16.252691 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:16.254365 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:16.258919 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:16.261013 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:16.261696 11365 raft_consensus.cc:348] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.262037 11365 raft_consensus.cc:374] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.262123 11365 raft_consensus.cc:729] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.262383 11365 consensus_queue.cc:260] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.262981 11365 ts_tablet_manager.cc:1428] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260811 06:17:16.263558 11365 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.264693 11362 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.265199 14484 ts_tablet_manager.cc:1918] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.265427 14484 log.cc:1196] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:16.266525 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:16.266743 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:16.266979 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 9f44d4df9df7407890790c80fc71f8cb (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:16.267366 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:16.267593 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:16.267928 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:16.268520 14484 ts_tablet_manager.cc:1939] T 05867781f7954fb280cc83b2a13d0d61 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.268721 11362 tablet_bootstrap.cc:654] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.268988 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:16.269809 11365 tablet_bootstrap.cc:654] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.271200 11047 consensus_peers.cc:487] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.271509 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 179) took 2893 ms. Trace:
I20260811 06:17:16.271660 11684 rpcz_store.cc:276] 0811 06:17:13.377559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.239980 (+2862421us) service_pool.cc:227] Handling call
0811 06:17:16.241090 (+ 1110us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.241494 (+ 404us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.271217 (+ 29723us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.271341 (+ 124us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.271461 (+ 120us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.242093 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.242205 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.242211 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.242214 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.242312 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.242329 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.242334 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.242424 (+ 90us) tablet.cc:699] Row locks acquired
0811 06:17:16.242427 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.242464 (+ 37us) write_op.cc:270] Start()
0811 06:17:16.242501 (+ 37us) write_op.cc:276] Timestamp: P: 1786429036242423 usec, L: 0
0811 06:17:16.242506 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.242707 (+ 201us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.253083 (+ 10376us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.253274 (+ 191us) write_op.cc:301] APPLY: starting
0811 06:17:16.253294 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.253341 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.253369 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.253492 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.253529 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.253538 (+ 9us) write_op.cc:312] APPLY: finished
0811 06:17:16.253638 (+ 100us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.253734 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.253761 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:16.253769 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.253832 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.253836 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":620,"apply.run_wall_time_us":619,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":717,"raft.queue_time_us":135,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":241,"replication_time_us":10546}]]}
I20260811 06:17:16.273291 14483 ts_tablet_manager.cc:1905] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.274288 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 05867781f7954fb280cc83b2a13d0d61 (table default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]) successfully deleted
I20260811 06:17:16.275490 14480 ts_tablet_manager.cc:1918] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.275635 14480 log.cc:1196] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:16.275990 14480 ts_tablet_manager.cc:1939] T 05867781f7954fb280cc83b2a13d0d61 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.273880 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_48d9c06727ce47bea11ed7220289a258"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.276791 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48d9c06727ce47bea11ed7220289a258 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.277133 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 05867781f7954fb280cc83b2a13d0d61 (table default.Table_a8722fababeb4520abf519495d15cb6c [id=c6c5526174c744e6acf5ec74eae5e20e]) successfully deleted
I20260811 06:17:16.277791 14484 tablet_replica.cc:330] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:16.277793 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet c5c3e243e72f4cffb3318246ab428bd6 because the tablet was not found. No further retry: Not found: Tablet not found: c5c3e243e72f4cffb3318246ab428bd6
I20260811 06:17:16.278599 14484 raft_consensus.cc:2229] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.279562 14289 raft_consensus.cc:482] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.279707 14289 raft_consensus.cc:504] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.280349 14289 leader_election.cc:288] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.273900 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:16.281260 14484 raft_consensus.cc:2258] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.281154 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.281406 10659 raft_consensus.cc:2454] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.281414 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:16.281858 11046 leader_election.cc:302] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:16.282111 14289 raft_consensus.cc:2781] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 06:17:16.282133 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
I20260811 06:17:16.282183 14289 raft_consensus.cc:482] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.282245 14289 raft_consensus.cc:3037] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.282218 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 2 got 0
I20260811 06:17:16.282483 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:16.282634 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:16.283941 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.283210 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1168c63178174571907981d4a6ac165f (table default.Table_e8aa31ae81824fd699449a5bfe4ba023 [id=485faa9398f8447398dbdc64b6ef2167]). Expected version 1 got 0
I20260811 06:17:16.284284 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:16.284515 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
W20260811 06:17:16.284595 11047 leader_election.cc:341] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.284945 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:16.285310 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:16.285475 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:16.285434 14289 raft_consensus.cc:504] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.285740 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:16.286074 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:16.286448 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:16.286643 14289 leader_election.cc:288] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.286581 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.286758 14289 raft_consensus.cc:482] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.286777 10659 raft_consensus.cc:3037] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.286876 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:16.286862 14289 raft_consensus.cc:504] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.287438 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:16.287577 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:16.287700 14289 leader_election.cc:288] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.287703 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:16.288045 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
W20260811 06:17:16.288198 11047 leader_election.cc:341] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.288623 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:16.289271 11047 leader_election.cc:341] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.289477 10659 raft_consensus.cc:2454] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.289794 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.290014 10655 raft_consensus.cc:2454] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.291739 11046 leader_election.cc:302] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.292164 11046 leader_election.cc:302] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.292510 14100 raft_consensus.cc:2781] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.292675 14348 raft_consensus.cc:2781] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.292723 14348 raft_consensus.cc:482] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.292774 14348 raft_consensus.cc:3037] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.294924 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 180) took 2904 ms. Trace:
I20260811 06:17:16.295069 11684 rpcz_store.cc:276] 0811 06:17:13.390758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.273594 (+2882836us) service_pool.cc:227] Handling call
0811 06:17:16.277487 (+ 3893us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:16.278969 (+ 1482us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:16.294540 (+ 15571us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.294548 (+ 8us) write_op.cc:454] Released schema lock
0811 06:17:16.294639 (+ 91us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:16.294775 (+ 136us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:16.294876 (+ 101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.280240 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.280360 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.280367 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.280373 (+ 6us) tablet.cc:660] Decoding operations
0811 06:17:16.280480 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.280496 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.280501 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.280595 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:16.280597 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.280639 (+ 42us) write_op.cc:270] Start()
0811 06:17:16.280678 (+ 39us) write_op.cc:276] Timestamp: P: 1786429036280593 usec, L: 0
0811 06:17:16.280682 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.280900 (+ 218us) log.cc:842] Serialized 433 byte log entry
0811 06:17:16.286007 (+ 5107us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.286178 (+ 171us) write_op.cc:301] APPLY: starting
0811 06:17:16.286196 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.286246 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.286283 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.286442 (+ 159us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.286482 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:16.286488 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.286581 (+ 93us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.286653 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.286678 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:16.286689 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":578,"num_ops":2,"prepare.queue_time_us":709,"prepare.run_cpu_time_us":791,"prepare.run_wall_time_us":792,"raft.queue_time_us":1013,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":254,"replication_time_us":5300}]]}
I20260811 06:17:16.295625 14348 raft_consensus.cc:504] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.296545 14348 leader_election.cc:288] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.298235 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:16.298894 11047 leader_election.cc:341] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.299674 14100 raft_consensus.cc:686] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.299615 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8513fc279dc44f48c45e9dda40e5398" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.299809 10655 raft_consensus.cc:3037] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.299942 14100 consensus_queue.cc:237] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.302340 10655 raft_consensus.cc:2454] T a8513fc279dc44f48c45e9dda40e5398 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.302332 11684 master_service.cc:946] ReplaceTablet: received request to replace tablet 4209fc7d2efb415e8794fb33e7f2e5ac from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:16.302773 11046 leader_election.cc:302] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.303342 14348 raft_consensus.cc:2781] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.303392 11365 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.303551 11365 ts_tablet_manager.cc:1397] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.001s
I20260811 06:17:16.303682 14348 raft_consensus.cc:686] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.303915 14348 consensus_queue.cc:237] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.304368 11365 raft_consensus.cc:348] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.304605 11365 raft_consensus.cc:374] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.304672 11365 raft_consensus.cc:729] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.304934 11365 consensus_queue.cc:260] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.305563 11365 ts_tablet_manager.cc:1428] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:16.305882 11365 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.307356 11365 tablet_bootstrap.cc:654] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.309580 14467 raft_consensus.cc:482] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.309697 14467 raft_consensus.cc:504] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:16.310256 14467 leader_election.cc:288] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.311311 14483 ts_tablet_manager.cc:1918] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.311439 14483 log.cc:1196] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1f48707b4fb746f49eaaf91b5b81e814
I20260811 06:17:16.311780 14483 ts_tablet_manager.cc:1939] T 1f48707b4fb746f49eaaf91b5b81e814 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.311942 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2527862e75b42aa9091456b0f5f994e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.312552 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2527862e75b42aa9091456b0f5f994e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.312765 14455 raft_consensus.cc:482] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.312918 14455 raft_consensus.cc:504] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.313124 10555 leader_election.cc:341] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.313535 14455 leader_election.cc:288] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.313509 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1f48707b4fb746f49eaaf91b5b81e814 (table default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]) successfully deleted
W20260811 06:17:16.313833 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c5c3e243e72f4cffb3318246ab428bd6 because the tablet was not found. No further retry: Not found: Tablet not found: c5c3e243e72f4cffb3318246ab428bd6
W20260811 06:17:16.314090 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because the tablet was not found. No further retry: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:16.314126 14483 tablet_replica.cc:330] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:16.314301 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 61114d1bcdb94af7b6c55b0331accee5 because the tablet was not found. No further retry: Not found: Tablet not found: 61114d1bcdb94af7b6c55b0331accee5
W20260811 06:17:16.314309 10564 leader_election.cc:341] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.314424 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:16.314541 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because the tablet was not found. No further retry: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:16.314648 10655 raft_consensus.cc:2379] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
W20260811 06:17:16.314728 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because the tablet was not found. No further retry: Not found: Tablet not found: 5e990aa374204f2b95c08b04121176bc
I20260811 06:17:16.314440 10564 leader_election.cc:302] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:16.315452 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
I20260811 06:17:16.315603 14467 raft_consensus.cc:2726] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:16.315694 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:16.315876 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:16.316038 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
I20260811 06:17:16.314316 14483 raft_consensus.cc:2229] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.316131 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce5f2fa8c64247419f2ca9b26df825b0" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:16.316246 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:16.316287 14483 raft_consensus.cc:2258] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.316449 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because the tablet was not found. No further retry: Not found: Tablet not found: d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:16.316648 10813 leader_election.cc:302] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.317030 14455 raft_consensus.cc:3037] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.317404 14483 ts_tablet_manager.cc:1905] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.319963 14455 raft_consensus.cc:2726] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.289292 14484 ts_tablet_manager.cc:1905] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.326862 11365 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.327011 11365 ts_tablet_manager.cc:1397] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260811 06:17:16.327822 11365 raft_consensus.cc:348] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.328037 11365 raft_consensus.cc:374] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.328090 11365 raft_consensus.cc:729] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.328325 11365 consensus_queue.cc:260] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.328887 11365 ts_tablet_manager.cc:1428] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:16.329859 11362 tablet_bootstrap.cc:492] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.330037 11362 ts_tablet_manager.cc:1397] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.001s
I20260811 06:17:16.330852 11362 raft_consensus.cc:348] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.331132 11362 raft_consensus.cc:374] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.331210 11362 raft_consensus.cc:729] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.331422 11362 consensus_queue.cc:260] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.332022 11362 ts_tablet_manager.cc:1428] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:16.333155 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 4209fc7d2efb415e8794fb33e7f2e5ac
I20260811 06:17:16.333550 11362 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.333938 11684 catalog_manager.cc:6565] ReplaceTablet: tablet 4209fc7d2efb415e8794fb33e7f2e5ac deleted and replaced by tablet f1cebe398a2245d18b185ab4967ee563
I20260811 06:17:16.334085 11684 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 181) took 2684 ms. Trace:
I20260811 06:17:16.334100 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac with delete_type TABLET_DATA_DELETED (replaced by tablet f1cebe398a2245d18b185ab4967ee563) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.334183 11684 rpcz_store.cc:276] 0811 06:17:13.649595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.302218 (+2652623us) service_pool.cc:227] Handling call
0811 06:17:16.334029 (+ 31811us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.322929 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.323046 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.323053 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.323055 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.323181 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.323197 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.323202 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.323294 (+ 92us) tablet.cc:699] Row locks acquired
0811 06:17:16.323297 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.323343 (+ 46us) write_op.cc:270] Start()
0811 06:17:16.323386 (+ 43us) write_op.cc:276] Timestamp: P: 1786429036323292 usec, L: 0
0811 06:17:16.323390 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.323636 (+ 246us) log.cc:842] Serialized 659 byte log entry
0811 06:17:16.331987 (+ 8351us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.332125 (+ 138us) write_op.cc:301] APPLY: starting
0811 06:17:16.332145 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.332193 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.332244 (+ 51us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.332377 (+ 133us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.332448 (+ 71us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.332454 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.332550 (+ 96us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.332626 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.332652 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:16.332659 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.332721 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.332724 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":71,"apply.run_cpu_time_us":657,"apply.run_wall_time_us":657,"num_ops":2,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":824,"prepare.run_wall_time_us":825,"raft.queue_time_us":976,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":267,"replication_time_us":8563}]]}
I20260811 06:17:16.335021 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_3564f87a2e944d778e6e043901d156b5" } new_table_name: "default.Table_de974c553cfc44e5b22f7277e9ca9388" modify_external_catalogs: true
I20260811 06:17:16.335822 11365 tablet_bootstrap.cc:492] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.337060 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac with delete_type TABLET_DATA_DELETED (replaced by tablet f1cebe398a2245d18b185ab4967ee563) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.338073 11365 tablet_bootstrap.cc:654] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.340010 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac with delete_type TABLET_DATA_DELETED (replaced by tablet f1cebe398a2245d18b185ab4967ee563) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.341113 14480 tablet_replica.cc:330] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.341373 14480 raft_consensus.cc:2229] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.341576 14480 raft_consensus.cc:2258] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.342249 14480 ts_tablet_manager.cc:1905] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.347899 14483 ts_tablet_manager.cc:1918] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.348047 14483 log.cc:1196] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:16.348404 14483 ts_tablet_manager.cc:1939] T e00a72f178f74ca59cc073fe78c99373 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.348963 11361 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.349824 14455 consensus_queue.cc:1035] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.349817 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e00a72f178f74ca59cc073fe78c99373 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]) successfully deleted
W20260811 06:17:16.350453 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:16.351053 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e4171d257dd6453a9159c59ae713b2e0 because the tablet was not found. No further retry: Not found: Tablet not found: e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:16.351199 14483 tablet_replica.cc:330] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.351423 14483 raft_consensus.cc:2229] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.351567 14483 raft_consensus.cc:2258] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.351768 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
W20260811 06:17:16.352088 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 8e721083b8b2428bbea6b9e87a4a6e14 because the tablet was not found. No further retry: Not found: Tablet not found: 8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:16.352274 11362 tablet_bootstrap.cc:654] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.352423 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 152f7db9fc6241c8abfdafd3adc30d47 because the tablet was not found. No further retry: Not found: Tablet not found: 152f7db9fc6241c8abfdafd3adc30d47
W20260811 06:17:16.352695 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
W20260811 06:17:16.352944 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f6f682f675c344b6b5955e834f94091f because the tablet was not found. No further retry: Not found: Tablet not found: f6f682f675c344b6b5955e834f94091f
W20260811 06:17:16.353217 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because the tablet was not found. No further retry: Not found: Tablet not found: 516e3c37321f4c7b9f3373164682a0ff
W20260811 06:17:16.353480 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 12971f852ea943b78d967f7672680cad because the tablet was not found. No further retry: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
W20260811 06:17:16.353749 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because the tablet was not found. No further retry: Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
W20260811 06:17:16.354012 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a04766ede03342efb594aaf081e112af because the tablet was not found. No further retry: Not found: Tablet not found: a04766ede03342efb594aaf081e112af
W20260811 06:17:16.354324 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7bcc463affbb4154877624aec28435bc because the tablet was not found. No further retry: Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc
W20260811 06:17:16.354625 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because the tablet was not found. No further retry: Not found: Tablet not found: 32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:16.355947 14480 ts_tablet_manager.cc:1918] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.356092 14480 log.cc:1196] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/4209fc7d2efb415e8794fb33e7f2e5ac
I20260811 06:17:16.356498 14480 ts_tablet_manager.cc:1939] T 4209fc7d2efb415e8794fb33e7f2e5ac P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.357666 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 4209fc7d2efb415e8794fb33e7f2e5ac (table default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]) successfully deleted
I20260811 06:17:16.358055 14483 ts_tablet_manager.cc:1905] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.358355 11361 ts_tablet_manager.cc:1397] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.000s
I20260811 06:17:16.362577 11361 raft_consensus.cc:348] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.362823 11361 raft_consensus.cc:374] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.362879 11361 raft_consensus.cc:729] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.363065 11361 consensus_queue.cc:260] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.367123 12944 consensus_queue.cc:1035] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.367818 11670 catalog_manager.cc:5495] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.368361 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:16.368628 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:16.368880 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:16.369082 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:16.369287 11670 catalog_manager.cc:5495] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:16.369668 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:16.370237 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:16.370550 11670 catalog_manager.cc:5495] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:16.371111 11670 catalog_manager.cc:5495] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.371735 11670 catalog_manager.cc:5495] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.372161 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:16.372383 11670 catalog_manager.cc:5495] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.372792 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:16.373072 11670 catalog_manager.cc:5495] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.373461 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:16.373653 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:16.374219 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:16.374503 11670 catalog_manager.cc:5495] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.375008 11670 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:16.375319 11670 catalog_manager.cc:5495] T 1271c4ab028d4d45acfee370f13a02d3 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.376056 14483 ts_tablet_manager.cc:1918] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.376189 14483 log.cc:1196] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:16.375950 11670 catalog_manager.cc:5495] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.376510 14483 ts_tablet_manager.cc:1939] T c2d9627d9f88466ba499aa175151f46a P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.379230 14484 ts_tablet_manager.cc:1918] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.380987 10867 tablet_service.cc:1467] Processing CreateTablet for tablet fda50f09671941688fb78d67315b7975 (DEFAULT_TABLE table=default.Table_646c2b7f00884690b290fe7959028e5a [id=c3217f14c4f94238b88d8b39f331e83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.381349 14484 log.cc:1196] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:16.381453 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fda50f09671941688fb78d67315b7975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:16.381790 14484 ts_tablet_manager.cc:1939] T a183d0915a5a48c2a26994d47f6fe266 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.388638 14289 raft_consensus.cc:482] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.388789 14289 raft_consensus.cc:504] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.388986 11361 ts_tablet_manager.cc:1428] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260811 06:17:16.389246 11361 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.389354 14289 leader_election.cc:288] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.389921 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.390897 10860 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (DEFAULT_TABLE table=default.Table_248c738c20484140804c4244faa27ca4 [id=4477e6c360934e079e00533d56a91c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.390911 10607 tablet_service.cc:1467] Processing CreateTablet for tablet fda50f09671941688fb78d67315b7975 (DEFAULT_TABLE table=default.Table_646c2b7f00884690b290fe7959028e5a [id=c3217f14c4f94238b88d8b39f331e83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.390966 11121 tablet_service.cc:1467] Processing CreateTablet for tablet fda50f09671941688fb78d67315b7975 (DEFAULT_TABLE table=default.Table_646c2b7f00884690b290fe7959028e5a [id=c3217f14c4f94238b88d8b39f331e83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.391287 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fda50f09671941688fb78d67315b7975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:16.391307 10860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:16.391404 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fda50f09671941688fb78d67315b7975. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:16.394681 11047 leader_election.cc:341] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.397900 14455 raft_consensus.cc:482] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.398079 14455 raft_consensus.cc:504] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.398723 14455 leader_election.cc:288] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.399448 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.399706 10659 raft_consensus.cc:2379] T fb5484b422a843b7810dd3b68a178ffd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:16.400225 11361 tablet_bootstrap.cc:654] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.400638 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5484b422a843b7810dd3b68a178ffd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.401260 10813 leader_election.cc:302] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.402247 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (DEFAULT_TABLE table=default.Table_248c738c20484140804c4244faa27ca4 [id=4477e6c360934e079e00533d56a91c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.402661 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:16.402946 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]) successfully deleted
I20260811 06:17:16.403030 10607 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (DEFAULT_TABLE table=default.Table_248c738c20484140804c4244faa27ca4 [id=4477e6c360934e079e00533d56a91c11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:16.403395 10607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:16.403666 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:16.404512 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:16.405309 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
I20260811 06:17:16.405823 14483 tablet_replica.cc:330] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.406003 12944 raft_consensus.cc:3037] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.406816 14483 raft_consensus.cc:2229] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.406991 14483 raft_consensus.cc:2258] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.408222 14484 tablet_replica.cc:330] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.408430 14484 raft_consensus.cc:2229] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:16.408605 12944 raft_consensus.cc:2726] T fb5484b422a843b7810dd3b68a178ffd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.408756 14484 raft_consensus.cc:2258] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.409276 14484 ts_tablet_manager.cc:1905] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.411672 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a183d0915a5a48c2a26994d47f6fe266 (table default.Table_e218ef3357a64431b19357d9e21e69bf [id=32214e2361bc4fc0b27c9f0e6c612e35]) successfully deleted
I20260811 06:17:16.407588 14483 ts_tablet_manager.cc:1905] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.416219 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.416455 10655 raft_consensus.cc:2454] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.416847 11046 leader_election.cc:302] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.417227 14348 raft_consensus.cc:2781] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.417311 14348 raft_consensus.cc:482] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.417373 14348 raft_consensus.cc:3037] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.423205 14348 raft_consensus.cc:504] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.423988 14348 leader_election.cc:288] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.424764 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:16.425294 11047 leader_election.cc:341] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.425581 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a7d05ec3851467dbf1ef9319b1c9462" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.425881 10655 raft_consensus.cc:3037] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.426417 14484 ts_tablet_manager.cc:1918] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.428645 10655 raft_consensus.cc:2454] T 1a7d05ec3851467dbf1ef9319b1c9462 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.435030 11362 tablet_bootstrap.cc:492] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.435206 11362 ts_tablet_manager.cc:1397] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.003s
I20260811 06:17:16.435962 11362 raft_consensus.cc:348] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.436225 11362 raft_consensus.cc:374] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.436308 11362 raft_consensus.cc:729] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.436564 14483 ts_tablet_manager.cc:1918] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.436704 14483 log.cc:1196] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/c2527862e75b42aa9091456b0f5f994e
I20260811 06:17:16.437083 14483 ts_tablet_manager.cc:1939] T c2527862e75b42aa9091456b0f5f994e P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.436995 11362 consensus_queue.cc:260] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.438536 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet c2527862e75b42aa9091456b0f5f994e (table default.Table_ac3235af8d1f42d29a220ec551aa448a [id=3b92a2f628794cb3827f5015816baa11]) successfully deleted
W20260811 06:17:16.438863 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
I20260811 06:17:16.438982 14483 tablet_replica.cc:330] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.429075 11046 leader_election.cc:302] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:16.439229 14483 raft_consensus.cc:2229] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.439396 14483 raft_consensus.cc:2258] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.439563 14348 raft_consensus.cc:2781] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
W20260811 06:17:16.439651 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:16.439877 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
W20260811 06:17:16.440105 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
W20260811 06:17:16.440320 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9b4eb7864cc742929ac1756949b6bec5 because the tablet was not found. No further retry: Not found: Tablet not found: 9b4eb7864cc742929ac1756949b6bec5
W20260811 06:17:16.440356 11600 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 02bb2819d9cc4880803ef959c131b9ac consensus state has no leader
W20260811 06:17:16.440593 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:16.441288 14348 raft_consensus.cc:686] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.441593 14348 consensus_queue.cc:237] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.443521 14484 log.cc:1196] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/12971f852ea943b78d967f7672680cad
I20260811 06:17:16.444133 14484 ts_tablet_manager.cc:1939] T 12971f852ea943b78d967f7672680cad P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.445056 14483 ts_tablet_manager.cc:1905] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.446329 11362 ts_tablet_manager.cc:1428] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260811 06:17:16.448632 11365 tablet_bootstrap.cc:492] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.448777 11365 ts_tablet_manager.cc:1397] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.113s user 0.015s sys 0.014s
I20260811 06:17:16.449167 14484 tablet_replica.cc:330] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.449532 11365 raft_consensus.cc:348] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.449781 11365 raft_consensus.cc:374] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.449854 11365 raft_consensus.cc:729] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.450349 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 12971f852ea943b78d967f7672680cad (table default.Table_4ea49146e0734f28907e8531d1e8a5e0 [id=39d689f9714e437f8f87538be1536a7e]) successfully deleted
I20260811 06:17:16.451267 11365 consensus_queue.cc:260] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.452744 14484 raft_consensus.cc:2229] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:16.453733 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:16.453926 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:16.454221 14484 pending_rounds.cc:62] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Trying to abort 1 pending ops.
I20260811 06:17:16.454427 14484 pending_rounds.cc:68] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213329959194624 op_type: NO_OP noop_request { }
I20260811 06:17:16.454936 14484 raft_consensus.cc:2866] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:16.455211 14484 raft_consensus.cc:2258] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.454888 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:16.455456 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:16.455996 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 369a031402a24a6a91f0c7ba8a5f288a (table default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98]). Expected version 1 got 0
I20260811 06:17:16.456637 11362 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.457059 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:16.457741 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:16.458448 14484 ts_tablet_manager.cc:1905] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.458592 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:16.458992 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 17d90d3d23454c5bbeba1bb900b68c73 (table default.Table_7fdf20d774f64959bc896c7805f6844f [id=31d35606d6554b798cc3890eae2547ab]). Expected version 2 got 0
I20260811 06:17:16.459266 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:16.459726 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:16.460096 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:16.461862 11365 ts_tablet_manager.cc:1428] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260811 06:17:16.463508 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:16.465214 11362 tablet_bootstrap.cc:654] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.465402 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:16.466199 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:16.466668 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 9f44d4df9df7407890790c80fc71f8cb (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]). Expected version 1 got 0
I20260811 06:17:16.467170 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1168c63178174571907981d4a6ac165f (table default.Table_e8aa31ae81824fd699449a5bfe4ba023 [id=485faa9398f8447398dbdc64b6ef2167]). Expected version 1 got 0
I20260811 06:17:16.467383 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:16.467665 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:16.468323 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:16.468623 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:16.468844 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:16.469201 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:16.470278 11361 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.470480 11361 ts_tablet_manager.cc:1397] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.081s user 0.009s sys 0.000s
I20260811 06:17:16.471217 11361 raft_consensus.cc:348] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.471493 11361 raft_consensus.cc:374] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.471590 11361 raft_consensus.cc:729] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.471832 11361 consensus_queue.cc:260] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.472437 11361 ts_tablet_manager.cc:1428] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:16.472769 11361 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.474189 11365 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.474718 11361 tablet_bootstrap.cc:654] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.469512 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:16.475835 11365 tablet_bootstrap.cc:654] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.476029 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:16.476361 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:16.476758 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5195c4d7b09d45b8873575e1f67a5cb3 (table default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 2 got 0
I20260811 06:17:16.477203 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:16.477890 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:16.478572 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:16.479038 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:16.479769 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 370d971f8ef14131afc5b54dbdbaae98 (table default.Table_2d172324032f4a89805a6dfb19f8db45 [id=313d481f9dff4c88b5611606ebf4faac]). Expected version 1 got 0
I20260811 06:17:16.480594 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:16.481264 14483 ts_tablet_manager.cc:1918] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.481391 14483 log.cc:1196] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/4209fc7d2efb415e8794fb33e7f2e5ac
I20260811 06:17:16.481837 14483 ts_tablet_manager.cc:1939] T 4209fc7d2efb415e8794fb33e7f2e5ac P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.482256 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:16.482612 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:16.483009 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 4209fc7d2efb415e8794fb33e7f2e5ac (table default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]) successfully deleted
I20260811 06:17:16.483798 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:16.484267 11365 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.484409 11365 ts_tablet_manager.cc:1397] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20260811 06:17:16.484795 11672 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:16.485140 11365 raft_consensus.cc:348] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.485383 11365 raft_consensus.cc:374] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.485440 11365 raft_consensus.cc:729] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.485656 11365 consensus_queue.cc:260] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.486665 11683 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 consensus state has no leader
I20260811 06:17:16.486864 11683 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 169) took 3462 ms. Trace:
I20260811 06:17:16.486987 11683 rpcz_store.cc:276] 0811 06:17:13.024889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.888268 (+2863379us) service_pool.cc:227] Handling call
0811 06:17:16.030521 (+142253us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.032811 (+ 2290us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:16.033495 (+ 684us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:16.033582 (+ 87us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:16.052213 (+ 18631us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.052218 (+ 5us) write_op.cc:454] Released schema lock
0811 06:17:16.052286 (+ 68us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:16.486822 (+434536us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.034247 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.034349 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.034357 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:16.034361 (+ 4us) tablet.cc:660] Decoding operations
0811 06:17:16.034479 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.034495 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.034499 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:16.034568 (+ 69us) tablet.cc:699] Row locks acquired
0811 06:17:16.034570 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.034610 (+ 40us) write_op.cc:270] Start()
0811 06:17:16.034645 (+ 35us) write_op.cc:276] Timestamp: P: 1786429036034587 usec, L: 0
0811 06:17:16.034649 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.034894 (+ 245us) log.cc:842] Serialized 405 byte log entry
0811 06:17:16.044222 (+ 9328us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.044630 (+ 408us) write_op.cc:301] APPLY: starting
0811 06:17:16.044647 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.044691 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.044724 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.044777 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.044812 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.044817 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:16.044902 (+ 85us) log.cc:842] Serialized 23 byte log entry
0811 06:17:16.044968 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.044987 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:16.044994 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":33236,"child_traces":[["op",{"apply.queue_time_us":345,"apply.run_cpu_time_us":428,"apply.run_wall_time_us":428,"num_ops":1,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":741,"prepare.run_wall_time_us":1271,"raft.queue_time_us":61,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"replication_time_us":9530}]]}
I20260811 06:17:16.487708 11683 master_service.cc:946] ReplaceTablet: received request to replace tablet 5195c4d7b09d45b8873575e1f67a5cb3 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:16.487735 11362 tablet_bootstrap.cc:492] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.487946 11362 ts_tablet_manager.cc:1397] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260811 06:17:16.488476 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_7fdf20d774f64959bc896c7805f6844f [id=31d35606d6554b798cc3890eae2547ab] alter complete (version 2)
I20260811 06:17:16.488731 11362 raft_consensus.cc:348] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.488977 11362 raft_consensus.cc:374] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.489034 11362 raft_consensus.cc:729] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.489269 11362 consensus_queue.cc:260] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.493630 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_7f4c4be1ee2342f4858a10f9067b541e" } modify_external_catalogs: true
I20260811 06:17:16.493912 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_7f4c4be1ee2342f4858a10f9067b541e" } modify_external_catalogs: true
I20260811 06:17:16.494546 11656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet e18f96539b76422ab3ae65bdfe2cf74d
I20260811 06:17:16.494990 11656 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 170) took 3411 ms. Trace:
I20260811 06:17:16.495082 11656 rpcz_store.cc:276] 0811 06:17:13.083216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.927707 (+2844491us) service_pool.cc:227] Handling call
0811 06:17:16.052606 (+124899us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.052742 (+ 136us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.052794 (+ 52us) catalog_manager.cc:2761] Locking tablets
0811 06:17:16.052918 (+ 124us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:16.077816 (+ 24898us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:16.094205 (+ 16389us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:16.494507 (+400302us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:16.494932 (+ 425us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.070924 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.071045 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.071050 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:16.071053 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.071192 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.071206 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.071210 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.071335 (+ 125us) tablet.cc:699] Row locks acquired
0811 06:17:16.071338 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.071378 (+ 40us) write_op.cc:270] Start()
0811 06:17:16.071415 (+ 37us) write_op.cc:276] Timestamp: P: 1786429036071353 usec, L: 0
0811 06:17:16.071420 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.071625 (+ 205us) log.cc:842] Serialized 762 byte log entry
0811 06:17:16.074812 (+ 3187us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.074920 (+ 108us) write_op.cc:301] APPLY: starting
0811 06:17:16.074945 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.077089 (+ 2144us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.077139 (+ 50us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.077230 (+ 91us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.077283 (+ 53us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.077290 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.077411 (+ 121us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.077676 (+ 265us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.077693 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:16.077700 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.077860 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.077864 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":625,"apply.run_wall_time_us":3048,"num_ops":2,"prepare.queue_time_us":16615,"prepare.run_cpu_time_us":839,"prepare.run_wall_time_us":4485,"raft.queue_time_us":55,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":232,"replication_time_us":3372}]]}
I20260811 06:17:16.495813 11656 master_service.cc:946] ReplaceTablet: received request to replace tablet 02bb2819d9cc4880803ef959c131b9ac from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:16.496634 11365 ts_tablet_manager.cc:1428] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260811 06:17:16.497598 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.497592 11121 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.497846 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.497895 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 40c31ffb11484783bca9263c947f37da
I20260811 06:17:16.498056 11096 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.498199 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.498318 11676 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 168) took 3484 ms. Trace:
I20260811 06:17:16.498342 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.498524 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.498445 11676 rpcz_store.cc:276] 0811 06:17:13.014275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.837465 (+2823190us) service_pool.cc:227] Handling call
0811 06:17:16.050377 (+212912us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.050540 (+ 163us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.050628 (+ 88us) catalog_manager.cc:2761] Locking tablets
0811 06:17:16.050782 (+ 154us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:16.079104 (+ 28322us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:16.088818 (+ 9714us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:16.497819 (+409001us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:16.498278 (+ 459us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.051559 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.051671 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.051676 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:16.051678 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.051809 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.051820 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.051824 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.052040 (+ 216us) tablet.cc:699] Row locks acquired
0811 06:17:16.052043 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.052083 (+ 40us) write_op.cc:270] Start()
0811 06:17:16.052117 (+ 34us) write_op.cc:276] Timestamp: P: 1786429036052059 usec, L: 0
0811 06:17:16.052122 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.063992 (+ 11870us) log.cc:842] Serialized 768 byte log entry
0811 06:17:16.064409 (+ 417us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:16.067729 (+ 3320us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.068030 (+ 301us) write_op.cc:301] APPLY: starting
0811 06:17:16.068048 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.068095 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.068098 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.068177 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.068212 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.068219 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.068298 (+ 79us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.068368 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.068391 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:16.068398 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.068469 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.068473 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":503,"apply.run_wall_time_us":503,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":1419,"prepare.run_wall_time_us":19323,"raft.queue_time_us":131,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":289,"replication_time_us":15584,"spinlock_wait_cycles":26759936}]]}
I20260811 06:17:16.499171 11676 master_service.cc:946] ReplaceTablet: received request to replace tablet a0c8b46163af4623b93af79302871941 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:16.499462 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.500156 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.500505 14480 tablet_replica.cc:330] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.500718 14480 raft_consensus.cc:2229] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.500917 14480 raft_consensus.cc:2258] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.501478 14480 ts_tablet_manager.cc:1905] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.503057 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.505689 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.506656 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.506897 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.507119 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.507308 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.507489 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.507681 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.507899 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508083 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508258 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508404 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508613 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508767 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.508422 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.509004 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.509235 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.509419 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.509603 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.509836 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.511960 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.512310 11365 tablet_bootstrap.cc:492] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.512236 14348 consensus_queue.cc:1035] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.516744 14455 consensus_queue.cc:1035] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.517264 11365 tablet_bootstrap.cc:654] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.518559 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 97) took 2926 ms (client timeout 1000 ms). Trace:
W20260811 06:17:16.518704 11663 rpcz_store.cc:269] 0811 06:17:13.592340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:13.675854 (+ 83514us) service_pool.cc:227] Handling call
0811 06:17:16.518457 (+2842603us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38165,"reported_tablets":211}
I20260811 06:17:16.519668 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.519892 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.520087 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.520263 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.520377 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.520490 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.520509 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.521600 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.521759 14483 tablet_replica.cc:330] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.522009 14483 raft_consensus.cc:2229] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.522104 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.522198 14483 raft_consensus.cc:2258] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.522866 14483 ts_tablet_manager.cc:1905] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.523109 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.524171 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.525141 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.525544 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.526079 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.526496 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.526888 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.527092 14484 ts_tablet_manager.cc:1918] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.527295 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet e4171d257dd6453a9159c59ae713b2e0 with delete_type TABLET_DATA_DELETED (replaced by tablet a815299e01bb4e3dabe0627edb86c3a6) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.527962 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.530563 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 182) took 2689 ms. Trace:
I20260811 06:17:16.530685 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e721083b8b2428bbea6b9e87a4a6e14 with delete_type TABLET_DATA_DELETED (replaced by tablet 2707979dce35428aa7145e9b34959989) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.530710 11684 rpcz_store.cc:276] 0811 06:17:13.841392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.334827 (+2493435us) service_pool.cc:227] Handling call
0811 06:17:16.335231 (+ 404us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.335461 (+ 230us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:16.335660 (+ 199us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:16.335744 (+ 84us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:16.345962 (+ 10218us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:16.530512 (+184550us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.338678 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.338790 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.338797 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.338800 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.338914 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.338929 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.338933 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:16.339002 (+ 69us) tablet.cc:699] Row locks acquired
0811 06:17:16.339005 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.339047 (+ 42us) write_op.cc:270] Start()
0811 06:17:16.339080 (+ 33us) write_op.cc:276] Timestamp: P: 1786429036338995 usec, L: 0
0811 06:17:16.339084 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.339311 (+ 227us) log.cc:842] Serialized 405 byte log entry
0811 06:17:16.343259 (+ 3948us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.343416 (+ 157us) write_op.cc:301] APPLY: starting
0811 06:17:16.343434 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.343476 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.343502 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.343563 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.343601 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.343608 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.343731 (+ 123us) log.cc:842] Serialized 23 byte log entry
0811 06:17:16.343810 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.343831 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.343838 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.343893 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.343897 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":532,"apply.run_wall_time_us":531,"num_ops":1,"prepare.queue_time_us":2441,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":751,"raft.queue_time_us":65,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":4148}]]}
I20260811 06:17:16.531438 11684 master_service.cc:946] ReplaceTablet: received request to replace tablet b5bf05ee95b244b88b943cc1d37f8839 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:16.534611 11655 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 9f44d4df9df7407890790c80fc71f8cb (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9f44d4df9df7407890790c80fc71f8cb consensus state has no leader
I20260811 06:17:16.536339 14402 consensus_queue.cc:1035] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.540321 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.540522 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.540669 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.540759 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.540930 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541059 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541203 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541314 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541405 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541524 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541594 10610 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541780 10627 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541776 10626 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541828 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.541986 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542128 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542328 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542488 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542623 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542757 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.542887 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.543020 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.543164 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.544888 14483 ts_tablet_manager.cc:1918] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.545025 14483 log.cc:1196] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/e18f96539b76422ab3ae65bdfe2cf74d
I20260811 06:17:16.545153 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.545601 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.545818 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.546168 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:16.537636 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 99) took 1753 ms (client timeout 1000 ms). Trace:
W20260811 06:17:16.548661 11655 rpcz_store.cc:269] 0811 06:17:14.784174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.362813 (+578639us) service_pool.cc:227] Handling call
0811 06:17:16.078302 (+715489us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x61b00024d3d0. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e53df1340 00007f3e53dec8ad 00007f3e53de73d1 00007f3e53f87ed7 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:16.537567 (+459265us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:15.847200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:15.847321 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:15.847328 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:15.847331 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:15.847440 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:15.847455 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:15.847460 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:15.847530 (+ 70us) tablet.cc:699] Row locks acquired
0811 06:17:15.847533 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:15.847573 (+ 40us) write_op.cc:270] Start()
0811 06:17:15.847608 (+ 35us) write_op.cc:276] Timestamp: P: 1786429035847522 usec, L: 0
0811 06:17:15.847612 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:15.847808 (+ 196us) log.cc:842] Serialized 356 byte log entry
0811 06:17:15.873759 (+ 25951us) op_driver.cc:444] REPLICATION: finished
0811 06:17:15.873913 (+ 154us) write_op.cc:301] APPLY: starting
0811 06:17:15.873942 (+ 29us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:15.873989 (+ 47us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:15.874016 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:15.874078 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:15.874115 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:15.874121 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:15.874222 (+ 101us) log.cc:842] Serialized 23 byte log entry
0811 06:17:15.874288 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.874309 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:15.874316 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:15.874371 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:15.874374 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":215,"spinlock_wait_cycles":28678912,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":513,"apply.run_wall_time_us":513,"num_ops":1,"prepare.queue_time_us":1201,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":728,"raft.queue_time_us":1588,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"replication_time_us":26120}]]}
I20260811 06:17:16.552528 11655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1796e17e33e24c69bbf95e8514e84395" } modify_external_catalogs: true
I20260811 06:17:16.553433 11655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1796e17e33e24c69bbf95e8514e84395" } modify_external_catalogs: true
I20260811 06:17:16.562837 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.563473 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.563609 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.563711 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.564097 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.564396 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.564719 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.572366 14480 ts_tablet_manager.cc:1918] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:16.572695 14480 log.cc:1196] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/e18f96539b76422ab3ae65bdfe2cf74d
I20260811 06:17:16.573078 11656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 02bb2819d9cc4880803ef959c131b9ac
I20260811 06:17:16.573298 14480 ts_tablet_manager.cc:1939] T e18f96539b76422ab3ae65bdfe2cf74d P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.573585 11656 catalog_manager.cc:6565] ReplaceTablet: tablet 02bb2819d9cc4880803ef959c131b9ac deleted and replaced by tablet 8af156c4975d47108000a5bccf21f9f7
I20260811 06:17:16.573727 11656 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 185) took 2502 ms. Trace:
I20260811 06:17:16.574046 14480 tablet_replica.cc:330] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.573848 11656 rpcz_store.cc:276] 0811 06:17:14.071350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.495728 (+2424378us) service_pool.cc:227] Handling call
0811 06:17:16.573675 (+ 77947us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.565566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.565694 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.565702 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:16.565705 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.565853 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.565869 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.565874 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.565963 (+ 89us) tablet.cc:699] Row locks acquired
0811 06:17:16.565965 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.566006 (+ 41us) write_op.cc:270] Start()
0811 06:17:16.566045 (+ 39us) write_op.cc:276] Timestamp: P: 1786429036565984 usec, L: 0
0811 06:17:16.566049 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.566254 (+ 205us) log.cc:842] Serialized 625 byte log entry
0811 06:17:16.570066 (+ 3812us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.570196 (+ 130us) write_op.cc:301] APPLY: starting
0811 06:17:16.570213 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.570273 (+ 60us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.570300 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.570408 (+ 108us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.570485 (+ 77us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.570491 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.570569 (+ 78us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.570633 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.570654 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.570660 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.570710 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.570713 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":82,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":567,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":812,"prepare.run_wall_time_us":813,"raft.queue_time_us":158,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":275,"replication_time_us":3993}]]}
I20260811 06:17:16.574352 14480 raft_consensus.cc:2229] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.574659 11656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_684e178eb9f141b7961759410506cbcc" } modify_external_catalogs: true
I20260811 06:17:16.574869 14480 raft_consensus.cc:2258] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.574888 11656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_684e178eb9f141b7961759410506cbcc" } modify_external_catalogs: true
I20260811 06:17:16.532588 14352 raft_consensus.cc:482] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.552412 14100 consensus_queue.cc:1035] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.575906 14352 raft_consensus.cc:504] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.576512 14352 leader_election.cc:288] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:16.565179 11047 consensus_peers.cc:487] T 576a3e27d5424e4b999a05beb898d4bb P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.566885 13740 consensus_queue.cc:1035] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.576766 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 02bb2819d9cc4880803ef959c131b9ac with delete_type TABLET_DATA_DELETED (replaced by tablet 8af156c4975d47108000a5bccf21f9f7) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.577296 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.577517 10649 raft_consensus.cc:2454] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:16.575752 14480 ts_tablet_manager.cc:1905] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.577975 11046 leader_election.cc:302] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:16.578243 13740 raft_consensus.cc:2781] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:16.578359 13740 raft_consensus.cc:482] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:16.578445 13740 raft_consensus.cc:3037] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.578634 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet e18f96539b76422ab3ae65bdfe2cf74d (table default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]) successfully deleted
I20260811 06:17:16.579298 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 02bb2819d9cc4880803ef959c131b9ac with delete_type TABLET_DATA_DELETED (replaced by tablet 8af156c4975d47108000a5bccf21f9f7) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.581033 13740 raft_consensus.cc:504] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.581387 11362 ts_tablet_manager.cc:1428] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.093s user 0.003s sys 0.000s
I20260811 06:17:16.581763 13740 leader_election.cc:288] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.582158 11362 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.583969 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 02bb2819d9cc4880803ef959c131b9ac with delete_type TABLET_DATA_DELETED (replaced by tablet 8af156c4975d47108000a5bccf21f9f7) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.584595 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.585014 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:16.586278 11047 leader_election.cc:341] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:16.586917 11047 leader_election.cc:341] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.587829 11361 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.589041 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:16.589246 10649 raft_consensus.cc:3037] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:16.591817 10649 raft_consensus.cc:2454] T b7409453e6e34172870dbb9fb3c5ac44 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:16.598733 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 0f4d1035d5b0435a8a3611e5e15c1547
I20260811 06:17:16.600238 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.600515 11655 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 188) took 1096 ms. Trace:
I20260811 06:17:16.600569 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.600950 11655 rpcz_store.cc:276] 0811 06:17:15.504013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.552251 (+1048238us) service_pool.cc:227] Handling call
0811 06:17:16.554074 (+ 1823us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.554245 (+ 171us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.554348 (+ 103us) catalog_manager.cc:2761] Locking tablets
0811 06:17:16.588141 (+ 33793us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:16.596596 (+ 8455us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.596603 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:16.596690 (+ 87us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:16.598117 (+ 1427us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:16.598183 (+ 66us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:16.600470 (+ 2287us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.588918 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.589036 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.589043 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.589045 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.589191 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.589206 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.589211 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.589348 (+ 137us) tablet.cc:699] Row locks acquired
0811 06:17:16.589351 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.589398 (+ 47us) write_op.cc:270] Start()
0811 06:17:16.589436 (+ 38us) write_op.cc:276] Timestamp: P: 1786429036589370 usec, L: 0
0811 06:17:16.589441 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.589638 (+ 197us) log.cc:842] Serialized 728 byte log entry
0811 06:17:16.593727 (+ 4089us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.593895 (+ 168us) write_op.cc:301] APPLY: starting
0811 06:17:16.593914 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.593985 (+ 71us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.594021 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.594092 (+ 71us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.594128 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.594133 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:16.594217 (+ 84us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.594277 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.594300 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:16.594306 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":470,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":855,"prepare.run_wall_time_us":855,"raft.queue_time_us":995,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"replication_time_us":4239}]]}
I20260811 06:17:16.603380 11655 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_feebdfd01f0f465fb0b3022ca1daf517" } new_table_name: "default.Table_b1633ab525bf4d3381d65de52f568771" modify_external_catalogs: true
I20260811 06:17:16.606103 14483 ts_tablet_manager.cc:1939] T e18f96539b76422ab3ae65bdfe2cf74d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.608875 14483 tablet_replica.cc:330] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.608923 11362 tablet_bootstrap.cc:654] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.610175 14483 raft_consensus.cc:2229] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.610973 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet e18f96539b76422ab3ae65bdfe2cf74d (table default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]) successfully deleted
W20260811 06:17:16.615489 11655 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23ca4a89d00242ea98c5b964df27082f consensus state has no leader
I20260811 06:17:16.616817 12944 raft_consensus.cc:482] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.616993 12944 raft_consensus.cc:504] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.617621 12944 leader_election.cc:288] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.620205 14666 tablet.cc:1722] T 369a031402a24a6a91f0c7ba8a5f288a P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:16.620697 11365 tablet_bootstrap.cc:492] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.620842 11365 ts_tablet_manager.cc:1397] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.026s
I20260811 06:17:16.621675 12944 raft_consensus.cc:482] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.621985 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.622228 10663 raft_consensus.cc:2379] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:16.622186 12944 raft_consensus.cc:504] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.622792 12944 leader_election.cc:288] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.623548 11362 tablet_bootstrap.cc:492] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.623689 11362 ts_tablet_manager.cc:1397] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20260811 06:17:16.621524 11365 raft_consensus.cc:348] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.623834 11365 raft_consensus.cc:374] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.623914 11365 raft_consensus.cc:729] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.624414 11362 raft_consensus.cc:348] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.624639 11362 raft_consensus.cc:374] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.624524 11365 consensus_queue.cc:260] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.624719 11362 raft_consensus.cc:729] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.624862 14483 raft_consensus.cc:2258] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.625890 10663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.630717 11365 ts_tablet_manager.cc:1428] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260811 06:17:16.631039 11365 tablet_bootstrap.cc:492] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.592893 11046 leader_election.cc:302] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:16.638814 11046 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 45951.9us
I20260811 06:17:16.639448 14343 raft_consensus.cc:2781] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:16.575881 14484 log.cc:1196] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:16.602946 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.641960 14484 ts_tablet_manager.cc:1939] T fdc323cf778548ae86f45f0fd8bd4a89 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:16.643167 14484 tablet_replica.cc:330] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
W20260811 06:17:16.603902 11047 consensus_peers.cc:487] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.643654 14484 raft_consensus.cc:2229] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.643970 14484 raft_consensus.cc:2258] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.623579 11656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 3210614ebacf45c89d63413c51c8f923
I20260811 06:17:16.644929 11656 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 189) took 1071 ms. Trace:
I20260811 06:17:16.632436 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 5195c4d7b09d45b8873575e1f67a5cb3
I20260811 06:17:16.645412 11683 catalog_manager.cc:6565] ReplaceTablet: tablet 5195c4d7b09d45b8873575e1f67a5cb3 deleted and replaced by tablet 7513bf5f22f84121a77702b1b09e6199
I20260811 06:17:16.645562 11683 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 183) took 2796 ms. Trace:
I20260811 06:17:16.645643 11683 rpcz_store.cc:276] 0811 06:17:13.848679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.487629 (+2638950us) service_pool.cc:227] Handling call
0811 06:17:16.645510 (+157881us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.626852 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.626964 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.626970 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.626972 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.627076 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.627089 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.627093 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.627171 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:16.627174 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.627205 (+ 31us) write_op.cc:270] Start()
0811 06:17:16.627233 (+ 28us) write_op.cc:276] Timestamp: P: 1786429036627178 usec, L: 0
0811 06:17:16.627237 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.627412 (+ 175us) log.cc:842] Serialized 625 byte log entry
0811 06:17:16.631181 (+ 3769us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.631352 (+ 171us) write_op.cc:301] APPLY: starting
0811 06:17:16.631368 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.631414 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.631451 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.631578 (+ 127us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.631638 (+ 60us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.631644 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.631739 (+ 95us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.631811 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.631834 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:16.631842 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.631949 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.631952 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":660,"apply.run_wall_time_us":659,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":659,"raft.queue_time_us":139,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":207,"replication_time_us":3918}]]}
I20260811 06:17:16.646538 11683 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_248c738c20484140804c4244faa27ca4" } new_table_name: "default.Table_99affff9b5fe49d48a5012cba18e007b" modify_external_catalogs: true
I20260811 06:17:16.648434 11656 rpcz_store.cc:276] 0811 06:17:15.573506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.574475 (+1000969us) service_pool.cc:227] Handling call
0811 06:17:16.574999 (+ 524us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.575908 (+ 909us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.575980 (+ 72us) catalog_manager.cc:2761] Locking tablets
0811 06:17:16.616788 (+ 40808us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:16.623368 (+ 6580us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:16.623469 (+ 101us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:16.623519 (+ 50us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:16.644863 (+ 21344us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.617775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.617891 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.617897 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.617900 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.618031 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.618047 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.618053 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.618162 (+ 109us) tablet.cc:699] Row locks acquired
0811 06:17:16.618165 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.618199 (+ 34us) write_op.cc:270] Start()
0811 06:17:16.618232 (+ 33us) write_op.cc:276] Timestamp: P: 1786429036618172 usec, L: 0
0811 06:17:16.618237 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.618412 (+ 175us) log.cc:842] Serialized 728 byte log entry
0811 06:17:16.622078 (+ 3666us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.622245 (+ 167us) write_op.cc:301] APPLY: starting
0811 06:17:16.622261 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.622304 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.622339 (+ 35us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.622418 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.622457 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.622464 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.622548 (+ 84us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.622610 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.622633 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:16.622640 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.622695 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.622699 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":508,"apply.run_wall_time_us":508,"num_ops":2,"prepare.queue_time_us":174,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":764,"raft.queue_time_us":288,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"replication_time_us":3809}]]}
I20260811 06:17:16.649173 14483 ts_tablet_manager.cc:1905] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.650112 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_2d172324032f4a89805a6dfb19f8db45" } new_table_name: "default.Table_d8f75079304e472b90776fdc30412ed8" modify_external_catalogs: true
I20260811 06:17:16.649628 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet fdc323cf778548ae86f45f0fd8bd4a89 (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]) successfully deleted
I20260811 06:17:16.654865 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 3210614ebacf45c89d63413c51c8f923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.654968 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7513bf5f22f84121a77702b1b09e6199) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.660406 11365 tablet_bootstrap.cc:654] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.660615 11683 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 consensus state has no leader
I20260811 06:17:16.662074 14483 ts_tablet_manager.cc:1918] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:16.661962 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_9b872cb70c63459191dcbfadffebf4fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.662771 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b872cb70c63459191dcbfadffebf4fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.662942 14480 ts_tablet_manager.cc:1918] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:16.663291 14483 log.cc:1196] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/40c31ffb11484783bca9263c947f37da
I20260811 06:17:16.663486 14480 log.cc:1196] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/40c31ffb11484783bca9263c947f37da
I20260811 06:17:16.663866 14483 ts_tablet_manager.cc:1939] T 40c31ffb11484783bca9263c947f37da P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:16.664175 14480 ts_tablet_manager.cc:1939] T 40c31ffb11484783bca9263c947f37da P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.666507 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]) successfully deleted
I20260811 06:17:16.666821 14483 tablet_replica.cc:330] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.667723 14483 raft_consensus.cc:2229] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.668212 14483 raft_consensus.cc:2258] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.670017 14483 ts_tablet_manager.cc:1905] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:16.670265 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because the tablet was not found. No further retry: Not found: Tablet not found: 516e3c37321f4c7b9f3373164682a0ff
W20260811 06:17:16.671231 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because the tablet was not found. No further retry: Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
W20260811 06:17:16.672201 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3b5bb21784e34ad7addf144e0b10a444 because the tablet was not found. No further retry: Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
I20260811 06:17:16.670943 11365 tablet_bootstrap.cc:492] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.672430 11365 ts_tablet_manager.cc:1397] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20260811 06:17:16.673112 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 3210614ebacf45c89d63413c51c8f923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.673297 14679 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.673448 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]) successfully deleted
W20260811 06:17:16.673734 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
I20260811 06:17:16.673187 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7513bf5f22f84121a77702b1b09e6199) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:16.673997 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:16.674113 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because the tablet was not found. No further retry: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
W20260811 06:17:16.674819 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because the tablet was not found. No further retry: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:16.673116 11365 raft_consensus.cc:348] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.677930 11365 raft_consensus.cc:374] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.678017 11365 raft_consensus.cc:729] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.678227 11365 consensus_queue.cc:260] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.678509 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because the tablet was not found. No further retry: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
W20260811 06:17:16.679142 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
I20260811 06:17:16.680727 11365 ts_tablet_manager.cc:1428] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260811 06:17:16.681358 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:16.681612 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because the tablet was not found. No further retry: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
W20260811 06:17:16.681906 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 12971f852ea943b78d967f7672680cad because the tablet was not found. No further retry: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
I20260811 06:17:16.682044 11365 tablet_bootstrap.cc:492] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:16.682119 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
W20260811 06:17:16.682771 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
I20260811 06:17:16.684211 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_27ada88143e9469bae543e38a46a44b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.684881 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27ada88143e9469bae543e38a46a44b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.685329 11365 tablet_bootstrap.cc:654] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.693918 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d87403c480a745898b0a0d9cc9dad59f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.694684 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d87403c480a745898b0a0d9cc9dad59f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.695181 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
I20260811 06:17:16.695703 14679 tablet.cc:1722] T 369a031402a24a6a91f0c7ba8a5f288a P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:16.696051 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:16.700107 11365 tablet_bootstrap.cc:492] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.700261 11365 ts_tablet_manager.cc:1397] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
W20260811 06:17:16.701061 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:16.701063 11365 raft_consensus.cc:348] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.701290 11365 raft_consensus.cc:374] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.701360 11365 raft_consensus.cc:729] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.701555 11365 consensus_queue.cc:260] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.701925 14408 raft_consensus.cc:482] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.702041 14408 raft_consensus.cc:504] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.702634 14408 leader_election.cc:288] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:16.702662 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because the tablet was not found. No further retry: Not found: Tablet not found: dc4a4e8bfe3b43aeb0c1617dcb29e685
W20260811 06:17:16.703294 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because the tablet was not found. No further retry: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
W20260811 06:17:16.704123 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
I20260811 06:17:16.704070 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:16.704247 11365 ts_tablet_manager.cc:1428] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260811 06:17:16.704610 10555 leader_election.cc:341] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.704704 11365 tablet_bootstrap.cc:492] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.706197 11365 tablet_bootstrap.cc:654] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.706162 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:16.706964 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
I20260811 06:17:16.699138 14483 ts_tablet_manager.cc:1918] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.707643 14483 log.cc:1196] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/1649493bd0924ee48fd5044d7288932d
I20260811 06:17:16.708356 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_6471535da4514085be860663c7c99e53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.708828 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fa71e5477644e0a0d7c40ecc55928b already in progress: creating tablet
I20260811 06:17:16.709049 14483 ts_tablet_manager.cc:1939] T 1649493bd0924ee48fd5044d7288932d P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:16.709090 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6471535da4514085be860663c7c99e53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.709733 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
W20260811 06:17:16.710527 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
I20260811 06:17:16.711665 14483 tablet_replica.cc:330] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:16.712855 14483 raft_consensus.cc:2229] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:16.713002 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
I20260811 06:17:16.713109 14483 raft_consensus.cc:2258] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.713842 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
I20260811 06:17:16.713891 14483 ts_tablet_manager.cc:1905] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.715822 14408 raft_consensus.cc:482] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.715957 14408 raft_consensus.cc:504] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.716565 14408 leader_election.cc:288] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:16.717217 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02bb2819d9cc4880803ef959c131b9ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:16.717344 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
I20260811 06:17:16.717446 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_db6e8fb7be4b48d282a221b3b30c493e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.718101 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db6e8fb7be4b48d282a221b3b30c493e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.719200 10555 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.721956 14666 tablet.cc:1722] T 370d971f8ef14131afc5b54dbdbaae98 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.725055 14679 tablet.cc:1722] T 370d971f8ef14131afc5b54dbdbaae98 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.726550 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:16.729600 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_cde36e31078247c79cb9f20de6401754"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.730314 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cde36e31078247c79cb9f20de6401754 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.731501 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
W20260811 06:17:16.732225 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
I20260811 06:17:16.650781 14352 consensus_queue.cc:1035] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.651669 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75094a86738d42fca39d57f8d90e8af9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.653653 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1271c4ab028d4d45acfee370f13a02d3" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:16.655791 11047 consensus_peers.cc:487] T 7821b08482ed49ea8e90155805a88ae5 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:16.735795 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 80620.2us
I20260811 06:17:16.736735 14484 ts_tablet_manager.cc:1905] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.737187 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 3210614ebacf45c89d63413c51c8f923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.669276 14343 raft_consensus.cc:686] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:16.696238 14684 tablet.cc:1722] T 369a031402a24a6a91f0c7ba8a5f288a P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:16.729051 11361 ts_tablet_manager.cc:1397] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.256s user 0.009s sys 0.001s
I20260811 06:17:16.737746 14343 consensus_queue.cc:237] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.737972 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
I20260811 06:17:16.739063 10813 leader_election.cc:302] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.739514 14402 raft_consensus.cc:3037] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:16.741004 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00a72f178f74ca59cc073fe78c99373 already in progress: creating tablet
I20260811 06:17:16.741930 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7513bf5f22f84121a77702b1b09e6199) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.746790 14402 raft_consensus.cc:2726] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:16.752322 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:16.753264 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
I20260811 06:17:16.754197 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]). Expected version 1 got 0
I20260811 06:17:16.754552 11663 catalog_manager.cc:5495] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
W20260811 06:17:16.754879 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:16.755081 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:16.755618 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]). Expected version 1 got 0
I20260811 06:17:16.755859 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
W20260811 06:17:16.756043 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e4171d257dd6453a9159c59ae713b2e0 because the tablet was not found. No further retry: Not found: Tablet not found: e4171d257dd6453a9159c59ae713b2e0
I20260811 06:17:16.756084 11663 catalog_manager.cc:5495] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:16.756588 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:16.756552 14665 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.756759 11663 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
W20260811 06:17:16.757138 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because the tablet was not found. No further retry: Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
I20260811 06:17:16.756999 11663 catalog_manager.cc:5495] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.757864 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 1649493bd0924ee48fd5044d7288932d (table default.Table_7ab95b8d63814510887b9a7442b5e329 [id=8802e425bc034a05bc1c58f2b777c039]) successfully deleted
I20260811 06:17:16.758383 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:16.758548 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8e721083b8b2428bbea6b9e87a4a6e14 because the tablet was not found. No further retry: Not found: Tablet not found: 8e721083b8b2428bbea6b9e87a4a6e14
I20260811 06:17:16.757516 11663 catalog_manager.cc:5495] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
W20260811 06:17:16.759541 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 152f7db9fc6241c8abfdafd3adc30d47 because the tablet was not found. No further retry: Not found: Tablet not found: 152f7db9fc6241c8abfdafd3adc30d47
I20260811 06:17:16.762660 10813 leader_election.cc:302] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.763206 14402 raft_consensus.cc:2726] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:16.764187 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a04766ede03342efb594aaf081e112af because the tablet was not found. No further retry: Not found: Tablet not found: a04766ede03342efb594aaf081e112af
W20260811 06:17:16.764258 11047 consensus_peers.cc:487] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.764897 14666 tablet.cc:1722] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.765268 14348 consensus_queue.cc:1035] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:16.766042 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because the tablet was not found. No further retry: Not found: Tablet not found: 32407c8872464da2b1470a8ae21c86fd
W20260811 06:17:16.766366 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:16.766672 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because the tablet was not found. No further retry: Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
I20260811 06:17:16.767148 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02bb2819d9cc4880803ef959c131b9ac" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:16.779253 11361 raft_consensus.cc:348] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.779511 11361 raft_consensus.cc:374] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.779606 11361 raft_consensus.cc:729] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.779819 11361 consensus_queue.cc:260] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.780659 11361 ts_tablet_manager.cc:1428] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:16.781068 11361 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.783067 11361 tablet_bootstrap.cc:654] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.791565 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
W20260811 06:17:16.792869 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because the tablet was not found. No further retry: Not found: Tablet not found: 5e990aa374204f2b95c08b04121176bc
I20260811 06:17:16.773204 11683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_939503f4b27040539b307fd35ab86781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.774542 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet a0c8b46163af4623b93af79302871941
I20260811 06:17:16.793896 11676 catalog_manager.cc:6565] ReplaceTablet: tablet a0c8b46163af4623b93af79302871941 deleted and replaced by tablet 9efc03bb295f45acabf65c33d6a4edf5
I20260811 06:17:16.794047 11676 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 186) took 2682 ms. Trace:
I20260811 06:17:16.794138 11676 rpcz_store.cc:276] 0811 06:17:14.111217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.499086 (+2387869us) service_pool.cc:227] Handling call
0811 06:17:16.793984 (+294898us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.747593 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.747726 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.747734 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:16.747736 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.747861 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.747877 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.747882 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.747973 (+ 91us) tablet.cc:699] Row locks acquired
0811 06:17:16.747976 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.748015 (+ 39us) write_op.cc:270] Start()
0811 06:17:16.748052 (+ 37us) write_op.cc:276] Timestamp: P: 1786429036747976 usec, L: 0
0811 06:17:16.748057 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.748281 (+ 224us) log.cc:842] Serialized 625 byte log entry
0811 06:17:16.773419 (+ 25138us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.773698 (+ 279us) write_op.cc:301] APPLY: starting
0811 06:17:16.773746 (+ 48us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.773795 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.773833 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.773984 (+ 151us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.774056 (+ 72us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.774063 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.774155 (+ 92us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.774225 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.774245 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:16.774252 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.774661 (+ 409us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.774666 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":200,"apply.run_cpu_time_us":697,"apply.run_wall_time_us":1028,"num_ops":2,"prepare.queue_time_us":1209,"prepare.run_cpu_time_us":812,"prepare.run_wall_time_us":1273,"raft.queue_time_us":50,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":25335}]]}
I20260811 06:17:16.775480 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet b5bf05ee95b244b88b943cc1d37f8839
I20260811 06:17:16.785095 11663 catalog_manager.cc:5495] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
W20260811 06:17:16.795899 10564 leader_election.cc:341] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.796027 11684 catalog_manager.cc:6565] ReplaceTablet: tablet b5bf05ee95b244b88b943cc1d37f8839 deleted and replaced by tablet 6d5cfa63a633440897f09979413197ce
I20260811 06:17:16.796041 10564 leader_election.cc:302] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.796195 11684 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 187) took 2530 ms. Trace:
W20260811 06:17:16.796429 10564 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.796535 10564 leader_election.cc:302] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.796279 11684 rpcz_store.cc:276] 0811 06:17:14.266053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.531306 (+2265253us) service_pool.cc:227] Handling call
0811 06:17:16.796130 (+264824us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.748882 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.748986 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.748992 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.748995 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:16.749097 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.749107 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.749112 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.749209 (+ 97us) tablet.cc:699] Row locks acquired
0811 06:17:16.749211 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.749244 (+ 33us) write_op.cc:270] Start()
0811 06:17:16.749278 (+ 34us) write_op.cc:276] Timestamp: P: 1786429036749205 usec, L: 0
0811 06:17:16.749282 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.749453 (+ 171us) log.cc:842] Serialized 625 byte log entry
0811 06:17:16.773513 (+ 24060us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.774760 (+ 1247us) write_op.cc:301] APPLY: starting
0811 06:17:16.774772 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.774810 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.774841 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.774973 (+ 132us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.775057 (+ 84us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.775062 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:16.775134 (+ 72us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.775200 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.775217 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:16.775223 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.775584 (+ 361us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.775589 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1216,"apply.run_cpu_time_us":560,"apply.run_wall_time_us":876,"num_ops":2,"prepare.queue_time_us":1551,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":1079,"raft.queue_time_us":35,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":24214,"threads_started":1}]]}
I20260811 06:17:16.796844 14408 raft_consensus.cc:2726] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.797008 14408 raft_consensus.cc:2726] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.797279 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c8b46163af4623b93af79302871941 with delete_type TABLET_DATA_DELETED (replaced by tablet 9efc03bb295f45acabf65c33d6a4edf5) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.797502 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d5cfa63a633440897f09979413197ce) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.795996 11663 catalog_manager.cc:5495] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:16.803318 11365 tablet_bootstrap.cc:492] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.803478 11365 ts_tablet_manager.cc:1397] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.099s user 0.005s sys 0.002s
I20260811 06:17:16.804170 11365 raft_consensus.cc:348] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.804394 11365 raft_consensus.cc:374] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.804451 11365 raft_consensus.cc:729] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.804664 11365 consensus_queue.cc:260] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.805243 11365 ts_tablet_manager.cc:1428] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260811 06:17:16.805567 11683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_939503f4b27040539b307fd35ab86781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.807088 11365 tablet_bootstrap.cc:492] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:16.807485 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because the tablet was not found. No further retry: Not found: Tablet not found: fdc323cf778548ae86f45f0fd8bd4a89
W20260811 06:17:16.808239 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
I20260811 06:17:16.808562 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_91e089da3589454b961bdf81e917e846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.808983 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 02bb2819d9cc4880803ef959c131b9ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02bb2819d9cc4880803ef959c131b9ac already in progress: creating tablet
W20260811 06:17:16.809146 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91e089da3589454b961bdf81e917e846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.809060 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_618cd19f8b01475da6b296a3c7074d66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:16.809583 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_618cd19f8b01475da6b296a3c7074d66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:16.810467 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0f4d1035d5b0435a8a3611e5e15c1547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4d1035d5b0435a8a3611e5e15c1547 already in progress: creating tablet
W20260811 06:17:16.813313 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3210614ebacf45c89d63413c51c8f923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3210614ebacf45c89d63413c51c8f923 already in progress: creating tablet
W20260811 06:17:16.813669 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5195c4d7b09d45b8873575e1f67a5cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5195c4d7b09d45b8873575e1f67a5cb3 already in progress: creating tablet
I20260811 06:17:16.814085 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_5b2224fe7b7748ab881cef80a4f0a01e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:16.814314 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c8b46163af4623b93af79302871941 with delete_type TABLET_DATA_DELETED (replaced by tablet 9efc03bb295f45acabf65c33d6a4edf5) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.814895 14483 ts_tablet_manager.cc:1918] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.815047 14483 log.cc:1196] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/79f307f50e044435be880079219170d8
W20260811 06:17:16.814981 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a0c8b46163af4623b93af79302871941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0c8b46163af4623b93af79302871941 already in progress: creating tablet
I20260811 06:17:16.815367 14483 ts_tablet_manager.cc:1939] T 79f307f50e044435be880079219170d8 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:16.815569 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b5bf05ee95b244b88b943cc1d37f8839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bf05ee95b244b88b943cc1d37f8839 already in progress: creating tablet
I20260811 06:17:16.815691 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet dcfab8bff5bd4a6cb7ea85dae3a48888
W20260811 06:17:16.815198 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b2224fe7b7748ab881cef80a4f0a01e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:16.816159 11670 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 184) took 2932 ms. Trace:
I20260811 06:17:16.816310 11670 rpcz_store.cc:276] 0811 06:17:13.883729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.493452 (+2609723us) service_pool.cc:227] Handling call
0811 06:17:16.494112 (+ 660us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.494261 (+ 149us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.494322 (+ 61us) catalog_manager.cc:2761] Locking tablets
0811 06:17:16.752768 (+258446us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:16.815472 (+ 62704us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:16.815565 (+ 93us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:16.815619 (+ 54us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:16.816116 (+ 497us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.754870 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.755006 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.755012 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:16.755014 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.755144 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.755157 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.755162 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.755280 (+ 118us) tablet.cc:699] Row locks acquired
0811 06:17:16.755283 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:16.755325 (+ 42us) write_op.cc:270] Start()
0811 06:17:16.755368 (+ 43us) write_op.cc:276] Timestamp: P: 1786429036755284 usec, L: 0
0811 06:17:16.755372 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.755600 (+ 228us) log.cc:842] Serialized 728 byte log entry
0811 06:17:16.808055 (+ 52455us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.811037 (+ 2982us) write_op.cc:301] APPLY: starting
0811 06:17:16.811055 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.811097 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.814466 (+ 3369us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.814548 (+ 82us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.814585 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.814591 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.814678 (+ 87us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.815342 (+ 664us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.815363 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.815370 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2924,"num_ops":2,"prepare.queue_time_us":1266,"prepare.run_cpu_time_us":852,"prepare.run_wall_time_us":1331,"raft.queue_time_us":41,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":52660}]]}
I20260811 06:17:16.817059 11670 master_service.cc:946] ReplaceTablet: received request to replace tablet d6063a34ee55495584ed5623215a130f from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:16.827382 11679 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 604cba8a4978479cbb15307aeb45a634 consensus state has no leader
I20260811 06:17:16.828217 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.828504 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet e329d808c59c4f66bbc515d751255e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.829042 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:10 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.829474 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b5bb21784e34ad7addf144e0b10a444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.830178 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet a183d0915a5a48c2a26994d47f6fe266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.830637 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet ae1118c96cff4ea387f3d0ee94bef79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.831074 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 8741294bc33e454a9c4ef1717ccef80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:54 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.831367 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 12971f852ea943b78d967f7672680cad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:08 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.831796 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 585f92fc5b3d41bd97df525380fcab9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832314 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 516e3c37321f4c7b9f3373164682a0ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832532 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832741 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832881 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832926 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 10211a4e95464e9e9e2b2e70d23086a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833155 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c997501cefd4e6b9e5824e5403dd39b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833323 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833516 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc323cf778548ae86f45f0fd8bd4a89 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b815bc117cf46db8250f33e5fec861d) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833577 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833671 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833781 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.833818 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.834170 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.834245 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.834563 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.832338 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 05867781f7954fb280cc83b2a13d0d61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.829077 11362 consensus_queue.cc:260] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.788987 14100 consensus_queue.cc:1035] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.792912 14684 tablet.cc:1722] T 370d971f8ef14131afc5b54dbdbaae98 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:16.793493 14677 consensus_queue.cc:1035] T eede55349694488b9899ec56a80c8d5b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:16.795416 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c8b46163af4623b93af79302871941 with delete_type TABLET_DATA_DELETED (replaced by tablet 9efc03bb295f45acabf65c33d6a4edf5) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.796600 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d5cfa63a633440897f09979413197ce) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:16.818234 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:16.833083 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfab8bff5bd4a6cb7ea85dae3a48888 already in progress: creating tablet
I20260811 06:17:16.816296 11365 tablet_bootstrap.cc:654] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.855607 11362 ts_tablet_manager.cc:1428] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.232s user 0.020s sys 0.000s
W20260811 06:17:16.847311 11653 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2707979dce35428aa7145e9b34959989 consensus state has no leader
I20260811 06:17:16.856930 11362 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:16.854161 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 99) took 1130 ms (client timeout 1000 ms). Trace:
W20260811 06:17:16.858404 11679 rpcz_store.cc:269] 0811 06:17:15.723227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.811476 (+ 88249us) service_pool.cc:227] Handling call
0811 06:17:16.854088 (+1042612us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.289820 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.289968 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.289975 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.289977 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.290088 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.290104 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.290109 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:16.290180 (+ 71us) tablet.cc:699] Row locks acquired
0811 06:17:16.290182 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.290221 (+ 39us) write_op.cc:270] Start()
0811 06:17:16.290255 (+ 34us) write_op.cc:276] Timestamp: P: 1786429036290174 usec, L: 0
0811 06:17:16.290259 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.290452 (+ 193us) log.cc:842] Serialized 530 byte log entry
0811 06:17:16.308706 (+ 18254us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.308858 (+ 152us) write_op.cc:301] APPLY: starting
0811 06:17:16.308877 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.308919 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.308946 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.309008 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.309044 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:16.309051 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:16.309145 (+ 94us) log.cc:842] Serialized 23 byte log entry
0811 06:17:16.309220 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.309244 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:16.309251 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.309337 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.309341 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33339,"reported_tablets":228,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":538,"num_ops":1,"prepare.queue_time_us":682,"prepare.run_cpu_time_us":738,"prepare.run_wall_time_us":738,"raft.queue_time_us":67,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":18418}]]}
I20260811 06:17:16.819326 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d5cfa63a633440897f09979413197ce) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.860090 14480 tablet_replica.cc:330] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:16.828496 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:16.857798 11653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 98) took 2215 ms (client timeout 1000 ms). Trace:
W20260811 06:17:16.861469 11653 rpcz_store.cc:269] 0811 06:17:14.642401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.299230 (+656829us) service_pool.cc:227] Handling call
0811 06:17:16.857731 (+1558501us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.002260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.002354 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.002358 (+ 4us) write_op.cc:435] Acquired schema lock
0811 06:17:16.002360 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.002515 (+ 155us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.002527 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.002532 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:16.002634 (+ 102us) tablet.cc:699] Row locks acquired
0811 06:17:16.002636 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.002670 (+ 34us) write_op.cc:270] Start()
0811 06:17:16.002699 (+ 29us) write_op.cc:276] Timestamp: P: 1786429036002653 usec, L: 0
0811 06:17:16.002703 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.002904 (+ 201us) log.cc:842] Serialized 907 byte log entry
0811 06:17:16.008017 (+ 5113us) op_driver.cc:444] REPLICATION: finished
0811 06:17:16.009610 (+ 1593us) write_op.cc:301] APPLY: starting
0811 06:17:16.009628 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:16.009680 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:16.009707 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:16.009796 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:16.009829 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:16.009835 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:16.009909 (+ 74us) log.cc:842] Serialized 29 byte log entry
0811 06:17:16.009970 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.009991 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:16.009997 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:16.010053 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:16.010056 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41471,"reported_tablets":232,"child_traces":[["op",{"apply.queue_time_us":1525,"apply.run_cpu_time_us":506,"apply.run_wall_time_us":507,"num_ops":2,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":740,"prepare.run_wall_time_us":739,"raft.queue_time_us":418,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":5291}]]}
I20260811 06:17:16.863848 11653 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1eecfa20d58747f69101093c3f4c9443" } new_table_name: "default.Table_d868a0d8395f43fba4fd9381aaf5e93e" modify_external_catalogs: true
I20260811 06:17:16.865351 11362 tablet_bootstrap.cc:654] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.855671 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e329d808c59c4f66bbc515d751255e96 because the tablet was not found. No further retry: Not found: Tablet not found: e329d808c59c4f66bbc515d751255e96
I20260811 06:17:16.864296 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 79f307f50e044435be880079219170d8 (table default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]) successfully deleted
W20260811 06:17:16.865844 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because the tablet was not found. No further retry: Not found: Tablet not found: c2527862e75b42aa9091456b0f5f994e
W20260811 06:17:16.866175 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because the tablet was not found. No further retry: Not found: Tablet not found: e00a72f178f74ca59cc073fe78c99373
W20260811 06:17:16.866484 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:16.866816 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet dc4a4e8bfe3b43aeb0c1617dcb29e685 because the tablet was not found. No further retry: Not found: Tablet not found: dc4a4e8bfe3b43aeb0c1617dcb29e685
W20260811 06:17:16.867053 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3b5bb21784e34ad7addf144e0b10a444 because the tablet was not found. No further retry: Not found: Tablet not found: 3b5bb21784e34ad7addf144e0b10a444
W20260811 06:17:16.867290 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because the tablet was not found. No further retry: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
W20260811 06:17:16.867537 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because the tablet was not found. No further retry: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
W20260811 06:17:16.867961 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because the tablet was not found. No further retry: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:16.868768 14480 raft_consensus.cc:2229] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.868980 14480 raft_consensus.cc:2258] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.869249 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 12971f852ea943b78d967f7672680cad because the tablet was not found. No further retry: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
I20260811 06:17:16.875308 14480 ts_tablet_manager.cc:1905] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:16.875566 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 585f92fc5b3d41bd97df525380fcab9f because the tablet was not found. No further retry: Not found: Tablet not found: 585f92fc5b3d41bd97df525380fcab9f
I20260811 06:17:16.879091 11365 tablet_bootstrap.cc:492] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:16.874868 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:16.879256 11365 ts_tablet_manager.cc:1397] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.002s
W20260811 06:17:16.879586 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because the tablet was not found. No further retry: Not found: Tablet not found: c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:16.879886 11365 raft_consensus.cc:348] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.880124 11365 raft_consensus.cc:374] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260811 06:17:16.880034 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because the tablet was not found. No further retry: Not found: Tablet not found: d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:16.880182 11365 raft_consensus.cc:729] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.880366 11365 consensus_queue.cc:260] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.880512 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f6f682f675c344b6b5955e834f94091f because the tablet was not found. No further retry: Not found: Tablet not found: f6f682f675c344b6b5955e834f94091f
W20260811 06:17:16.880846 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 152f7db9fc6241c8abfdafd3adc30d47 because the tablet was not found. No further retry: Not found: Tablet not found: 152f7db9fc6241c8abfdafd3adc30d47
W20260811 06:17:16.881125 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45fc206d95a244e395d19328ae289485 because the tablet was not found. No further retry: Not found: Tablet not found: 45fc206d95a244e395d19328ae289485
W20260811 06:17:16.881393 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
I20260811 06:17:16.881950 11365 ts_tablet_manager.cc:1428] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:16.886021 11365 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.887737 11365 tablet_bootstrap.cc:654] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.881695 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 516e3c37321f4c7b9f3373164682a0ff because the tablet was not found. No further retry: Not found: Tablet not found: 516e3c37321f4c7b9f3373164682a0ff
W20260811 06:17:16.888792 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e18f96539b76422ab3ae65bdfe2cf74d because the tablet was not found. No further retry: Not found: Tablet not found: e18f96539b76422ab3ae65bdfe2cf74d
W20260811 06:17:16.889067 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f48707b4fb746f49eaaf91b5b81e814 already in progress: creating tablet
W20260811 06:17:16.889328 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 40c31ffb11484783bca9263c947f37da because the tablet was not found. No further retry: Not found: Tablet not found: 40c31ffb11484783bca9263c947f37da
W20260811 06:17:16.889596 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
W20260811 06:17:16.890230 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 8c997501cefd4e6b9e5824e5403dd39b because the tablet was not found. No further retry: Not found: Tablet not found: 8c997501cefd4e6b9e5824e5403dd39b
W20260811 06:17:16.890528 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2d9627d9f88466ba499aa175151f46a already in progress: creating tablet
I20260811 06:17:16.835738 14484 ts_tablet_manager.cc:1918] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.890744 14484 log.cc:1196] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/8c997501cefd4e6b9e5824e5403dd39b
W20260811 06:17:16.890918 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because the tablet was not found. No further retry: Not found: Tablet not found: fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:16.891160 14484 ts_tablet_manager.cc:1939] T 8c997501cefd4e6b9e5824e5403dd39b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:16.891209 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
W20260811 06:17:16.891558 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
W20260811 06:17:16.891811 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
W20260811 06:17:16.892093 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
I20260811 06:17:16.892719 14480 ts_tablet_manager.cc:1918] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:16.900511 10609 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.908535 11365 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.909740 11365 ts_tablet_manager.cc:1397] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.001s
I20260811 06:17:16.910424 11365 raft_consensus.cc:348] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.910652 11365 raft_consensus.cc:374] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.910712 11365 raft_consensus.cc:729] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.911018 11365 consensus_queue.cc:260] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.912580 11365 ts_tablet_manager.cc:1428] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260811 06:17:16.892742 10858 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.913786 11365 tablet_bootstrap.cc:492] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.893272 10884 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.893769 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.894007 10860 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.913977 14480 log.cc:1196] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:16.897815 10866 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.901244 10867 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.901818 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.901940 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.902220 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.902639 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.902842 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.903069 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.903370 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.903470 11362 tablet_bootstrap.cc:492] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.903857 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.904762 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 035eee1d37c94471a7cd697fb0fbb951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.905164 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e990aa374204f2b95c08b04121176bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:00 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.895700 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.914759 11362 ts_tablet_manager.cc:1397] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260811 06:17:16.915195 11365 tablet_bootstrap.cc:654] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.915529 11362 raft_consensus.cc:348] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.915757 11362 raft_consensus.cc:374] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.915822 11362 raft_consensus.cc:729] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.916042 11362 consensus_queue.cc:260] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.916407 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet a04766ede03342efb594aaf081e112af with delete_type TABLET_DATA_DELETED (replaced by tablet b23c8754701444db93ceb1131a98b1dc) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.919162 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 152f7db9fc6241c8abfdafd3adc30d47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:16.919519 11362 ts_tablet_manager.cc:1428] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:16.919945 11362 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.921824 10607 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.922201 10606 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.922748 10623 tablet_service.cc:1514] Processing DeleteTablet for tablet e18f96539b76422ab3ae65bdfe2cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.923552 10632 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.923979 10634 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.924455 10615 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.926317 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.927119 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.927448 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:16.927781 11046 consensus_peers.cc:487] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40c31ffb11484783bca9263c947f37da. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:16.927940 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.928112 14480 ts_tablet_manager.cc:1939] T d9fa71e5477644e0a0d7c40ecc55928b P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:16.928783 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.928828 11361 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:16.929030 11361 ts_tablet_manager.cc:1397] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.148s user 0.005s sys 0.000s
W20260811 06:17:16.930176 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1f48707b4fb746f49eaaf91b5b81e814 because the tablet was not found. No further retry: Not found: Tablet not found: 1f48707b4fb746f49eaaf91b5b81e814
I20260811 06:17:16.929361 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet d9fa71e5477644e0a0d7c40ecc55928b (table default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]) successfully deleted
W20260811 06:17:16.930703 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:16.931094 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:16.931495 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because the tablet was not found. No further retry: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
W20260811 06:17:16.931773 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:16.932061 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:16.932982 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
I20260811 06:17:16.933588 14467 raft_consensus.cc:482] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.933748 14467 raft_consensus.cc:504] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.934345 14467 leader_election.cc:288] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:16.934479 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 100) took 861 ms (client timeout 1000 ms). Trace:
I20260811 06:17:16.935336 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.935400 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.935705 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 4209fc7d2efb415e8794fb33e7f2e5ac with delete_type TABLET_DATA_DELETED (replaced by tablet f1cebe398a2245d18b185ab4967ee563) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:16.937455 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:16.938683 10555 leader_election.cc:341] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:16.939236 11672 rpcz_store.cc:269] 0811 06:17:16.073138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.089976 (+ 16838us) service_pool.cc:227] Handling call
0811 06:17:16.934439 (+844463us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":227,"reported_tablets":215}
I20260811 06:17:16.935685 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:16.939854 10564 leader_election.cc:341] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:16.939970 10564 leader_election.cc:302] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:16.940179 14467 raft_consensus.cc:2726] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:16.940220 11365 tablet_bootstrap.cc:492] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.940330 11365 ts_tablet_manager.cc:1397] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260811 06:17:16.940448 11362 tablet_bootstrap.cc:654] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.940981 11365 raft_consensus.cc:348] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.941188 11365 raft_consensus.cc:374] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.941248 11365 raft_consensus.cc:729] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.941442 11365 consensus_queue.cc:260] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.942028 11365 ts_tablet_manager.cc:1428] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:16.942371 11365 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.943890 11365 tablet_bootstrap.cc:654] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:16.942700 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
W20260811 06:17:16.951705 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1649493bd0924ee48fd5044d7288932d already in progress: creating tablet
W20260811 06:17:16.952128 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:16.952399 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
W20260811 06:17:16.952670 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:16.952905 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:16.953226 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 32407c8872464da2b1470a8ae21c86fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32407c8872464da2b1470a8ae21c86fd already in progress: creating tablet
W20260811 06:17:16.953472 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 45fc206d95a244e395d19328ae289485 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fc206d95a244e395d19328ae289485 already in progress: creating tablet
W20260811 06:17:16.953744 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2527862e75b42aa9091456b0f5f994e already in progress: creating tablet
W20260811 06:17:16.953979 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e00a72f178f74ca59cc073fe78c99373 already in progress: creating tablet
W20260811 06:17:16.954269 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f6f682f675c344b6b5955e834f94091f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6f682f675c344b6b5955e834f94091f already in progress: creating tablet
W20260811 06:17:16.954543 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 7bcc463affbb4154877624aec28435bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc463affbb4154877624aec28435bc already in progress: creating tablet
W20260811 06:17:16.954814 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
W20260811 06:17:16.955072 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 035eee1d37c94471a7cd697fb0fbb951 because the tablet was not found. No further retry: Not found: Tablet not found: 035eee1d37c94471a7cd697fb0fbb951
W20260811 06:17:16.955765 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 5e990aa374204f2b95c08b04121176bc because the tablet was not found. No further retry: Not found: Tablet not found: 5e990aa374204f2b95c08b04121176bc
W20260811 06:17:16.956024 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
I20260811 06:17:16.959223 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 8c997501cefd4e6b9e5824e5403dd39b (table default.Table_b054c9a152034800800171e9f8d77579 [id=c205623a492a43eca2dd2d80b9dc42d4]) successfully deleted
I20260811 06:17:16.959338 14484 tablet_replica.cc:330] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:16.955461 11672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31" } modify_external_catalogs: true
I20260811 06:17:16.959565 14484 raft_consensus.cc:2229] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:16.959651 11672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31" } modify_external_catalogs: true
W20260811 06:17:16.960127 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a04766ede03342efb594aaf081e112af because the tablet was not found. No further retry: Not found: Tablet not found: a04766ede03342efb594aaf081e112af
W20260811 06:17:16.960992 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 152f7db9fc6241c8abfdafd3adc30d47 because the tablet was not found. No further retry: Not found: Tablet not found: 152f7db9fc6241c8abfdafd3adc30d47
I20260811 06:17:16.960754 11361 raft_consensus.cc:348] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.961980 11361 raft_consensus.cc:374] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.962564 11361 raft_consensus.cc:729] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.962611 11362 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.962477 14484 raft_consensus.cc:2258] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:16.962764 11362 ts_tablet_manager.cc:1397] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.000s
I20260811 06:17:16.963416 11362 raft_consensus.cc:348] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.963640 11362 raft_consensus.cc:374] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.963692 11362 raft_consensus.cc:729] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.963872 11362 consensus_queue.cc:260] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.964394 11362 ts_tablet_manager.cc:1428] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:16.964637 11362 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.967442 11362 tablet_bootstrap.cc:654] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.970263 11361 consensus_queue.cc:260] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:16.973567 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:16.974125 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 085179a610734942b9dd050ce9cf56d4 already in progress: creating tablet
W20260811 06:17:16.974541 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f already in progress: creating tablet
W20260811 06:17:16.974954 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 60c3a381b6744b8d989d644f2b643958 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60c3a381b6744b8d989d644f2b643958 already in progress: creating tablet
I20260811 06:17:16.975442 14483 tablet_replica.cc:330] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:16.975492 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 7bcc463affbb4154877624aec28435bc because the tablet was not found. No further retry: Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc
I20260811 06:17:16.975701 14483 raft_consensus.cc:2229] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260811 06:17:16.975711 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 10211a4e95464e9e9e2b2e70d23086a5 because the tablet was not found. No further retry: Not found: Tablet not found: 10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:16.975857 14483 raft_consensus.cc:2258] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:16.975903 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:16.976136 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fdc323cf778548ae86f45f0fd8bd4a89 because the tablet was not found. No further retry: Not found: Tablet not found: fdc323cf778548ae86f45f0fd8bd4a89
I20260811 06:17:16.976419 14483 ts_tablet_manager.cc:1905] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.978613 11365 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:16.978960 11365 ts_tablet_manager.cc:1397] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20260811 06:17:16.979791 11365 raft_consensus.cc:348] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.980176 11365 raft_consensus.cc:374] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.980273 11365 raft_consensus.cc:729] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.980533 11365 consensus_queue.cc:260] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.981426 11365 ts_tablet_manager.cc:1428] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:16.982391 11365 tablet_bootstrap.cc:492] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:16.983253 11362 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:16.983407 11362 ts_tablet_manager.cc:1397] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260811 06:17:16.984061 11362 raft_consensus.cc:348] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.984287 11362 raft_consensus.cc:374] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:16.984341 11362 raft_consensus.cc:729] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:16.984524 11362 consensus_queue.cc:260] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.984184 14484 ts_tablet_manager.cc:1905] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:16.985045 11362 ts_tablet_manager.cc:1428] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:16.985324 11361 ts_tablet_manager.cc:1428] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260811 06:17:16.985791 11362 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:16.987365 11362 tablet_bootstrap.cc:654] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.987689 11361 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:16.989593 11365 tablet_bootstrap.cc:654] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.992035 11361 tablet_bootstrap.cc:654] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:16.995639 14402 raft_consensus.cc:482] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:16.995787 14402 raft_consensus.cc:504] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:16.996366 14402 leader_election.cc:288] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:16.997200 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.999713 14467 consensus_queue.cc:1035] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.002251 14483 ts_tablet_manager.cc:1918] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.006685 14402 raft_consensus.cc:482] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.006850 14402 raft_consensus.cc:504] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.007486 14402 leader_election.cc:288] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.009434 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:16.996989 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576a3e27d5424e4b999a05beb898d4bb" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.013661 14467 raft_consensus.cc:482] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.013877 14467 raft_consensus.cc:504] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.008351 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99ecc0c0f0e5450abacd9da8fe5a19a7" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.014521 14467 leader_election.cc:288] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.015486 10813 leader_election.cc:302] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.015496 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.016374 10813 leader_election.cc:302] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.016784 14697 raft_consensus.cc:2726] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.016980 14697 raft_consensus.cc:2726] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:17.017315 10564 leader_election.cc:341] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.018389 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.020170 11362 tablet_bootstrap.cc:492] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.020535 11362 ts_tablet_manager.cc:1397] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260811 06:17:17.021245 11362 raft_consensus.cc:348] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.021755 11362 raft_consensus.cc:374] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.021865 11362 raft_consensus.cc:729] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.022118 11362 consensus_queue.cc:260] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.022714 11362 ts_tablet_manager.cc:1428] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260811 06:17:17.024053 10555 leader_election.cc:341] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.024197 10555 leader_election.cc:302] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.031103 11362 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.031124 14467 raft_consensus.cc:2726] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.031365 14483 log.cc:1196] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/02bb2819d9cc4880803ef959c131b9ac
I20260811 06:17:17.033389 14483 ts_tablet_manager.cc:1939] T 02bb2819d9cc4880803ef959c131b9ac P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:17.041441 11362 tablet_bootstrap.cc:654] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.042954 14467 raft_consensus.cc:482] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.043115 14467 raft_consensus.cc:504] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.043622 14483 tablet_replica.cc:330] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:17.043758 14467 leader_election.cc:288] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.043853 14483 raft_consensus.cc:2229] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.046689 14483 raft_consensus.cc:2258] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.047101 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.047749 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 02bb2819d9cc4880803ef959c131b9ac (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]) successfully deleted
W20260811 06:17:17.048111 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 0f4d1035d5b0435a8a3611e5e15c1547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4d1035d5b0435a8a3611e5e15c1547 already in progress: creating tablet
I20260811 06:17:17.048557 14289 raft_consensus.cc:482] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.048693 14289 raft_consensus.cc:504] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.049266 14289 leader_election.cc:288] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.049168 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.050328 11656 master_service.cc:946] ReplaceTablet: received request to replace tablet 446112faf4374fa29fea8bb40666856e from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:17.051079 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet d6063a34ee55495584ed5623215a130f
I20260811 06:17:17.051044 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.051558 11670 catalog_manager.cc:6565] ReplaceTablet: tablet d6063a34ee55495584ed5623215a130f deleted and replaced by tablet b9855da8111345808ecda0277b6e8dca
W20260811 06:17:17.051541 11047 leader_election.cc:341] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.052328 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet d6063a34ee55495584ed5623215a130f with delete_type TABLET_DATA_DELETED (replaced by tablet b9855da8111345808ecda0277b6e8dca) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:17.052953 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet d6063a34ee55495584ed5623215a130f with delete_type TABLET_DATA_DELETED (replaced by tablet b9855da8111345808ecda0277b6e8dca) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.053208 14480 tablet_replica.cc:330] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:17.053434 14480 raft_consensus.cc:2229] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:17.053818 14480 raft_consensus.cc:2258] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.054430 14480 ts_tablet_manager.cc:1905] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.060617 14480 ts_tablet_manager.cc:1918] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:17.060825 14480 log.cc:1196] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/d6063a34ee55495584ed5623215a130f
I20260811 06:17:17.060745 11676 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9" } modify_external_catalogs: true
I20260811 06:17:17.061067 11676 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9" } modify_external_catalogs: true
I20260811 06:17:17.061280 14480 ts_tablet_manager.cc:1939] T d6063a34ee55495584ed5623215a130f P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:17.061960 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]) successfully deleted
I20260811 06:17:17.062350 11684 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_83f26821254345f388647eb918ca0a2b" } new_table_name: "default.Table_e17d8af91df54ff382547bea08d954d2" modify_external_catalogs: true
I20260811 06:17:17.063788 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1e647362a1ce49cdbb427dbbbd25e3cf" } modify_external_catalogs: true
I20260811 06:17:17.064004 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_1e647362a1ce49cdbb427dbbbd25e3cf" } modify_external_catalogs: true
I20260811 06:17:17.064908 11670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_8121b021912d44ca88b933509ff2698b" } modify_external_catalogs: true
I20260811 06:17:17.065102 11670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_8121b021912d44ca88b933509ff2698b" } modify_external_catalogs: true
W20260811 06:17:17.048676 10564 leader_election.cc:341] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.066854 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet d6063a34ee55495584ed5623215a130f with delete_type TABLET_DATA_DELETED (replaced by tablet b9855da8111345808ecda0277b6e8dca) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:17.067083 10555 leader_election.cc:341] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.067190 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.067390 10655 raft_consensus.cc:2454] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.067449 10555 leader_election.cc:302] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.067983 14687 raft_consensus.cc:2726] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.068113 11046 leader_election.cc:302] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:17.068526 14289 raft_consensus.cc:2781] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.068605 14289 raft_consensus.cc:482] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.068686 14289 raft_consensus.cc:3037] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.071288 14289 raft_consensus.cc:504] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.072220 14289 leader_election.cc:288] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.073684 14483 ts_tablet_manager.cc:1905] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.075002 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.076555 10655 raft_consensus.cc:3037] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.077013 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
W20260811 06:17:17.077800 11047 leader_election.cc:341] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:17.078717 10555 consensus_peers.cc:487] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.080061 10655 raft_consensus.cc:2454] T cce9f8fd074348ffb60abcc086ac0519 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.080590 11046 leader_election.cc:302] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:17.081121 14289 raft_consensus.cc:2781] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.081249 14289 raft_consensus.cc:686] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.081465 14289 consensus_queue.cc:237] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:17.082329 11047 consensus_peers.cc:487] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.085000 14352 consensus_queue.cc:1035] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.091027 14289 raft_consensus.cc:482] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.091264 14289 raft_consensus.cc:504] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.092437 14289 leader_election.cc:288] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.092422 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.092649 10655 raft_consensus.cc:2454] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.093001 11046 leader_election.cc:302] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.093420 14289 raft_consensus.cc:2781] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.093569 14289 raft_consensus.cc:482] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.093523 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.093688 14289 raft_consensus.cc:3037] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.097160 14289 raft_consensus.cc:504] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.098387 14289 leader_election.cc:288] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.098858 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
W20260811 06:17:17.098970 11047 leader_election.cc:341] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.099066 10655 raft_consensus.cc:3037] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.100154 11362 tablet_bootstrap.cc:492] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.100348 11362 ts_tablet_manager.cc:1397] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20260811 06:17:17.101042 11362 raft_consensus.cc:348] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.101251 11362 raft_consensus.cc:374] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.101310 11362 raft_consensus.cc:729] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.101811 11362 consensus_queue.cc:260] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.101960 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dd4a21086934bd9a64d74075ab41fbe" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.102432 10655 raft_consensus.cc:2454] T 6dd4a21086934bd9a64d74075ab41fbe P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.103291 11362 ts_tablet_manager.cc:1428] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:17.103827 11046 leader_election.cc:302] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.104254 11362 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.104239 14352 raft_consensus.cc:2781] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.104357 14352 raft_consensus.cc:686] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.104580 14352 consensus_queue.cc:237] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.106741 14483 ts_tablet_manager.cc:1918] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.106948 14483 log.cc:1196] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/3210614ebacf45c89d63413c51c8f923
W20260811 06:17:17.107002 11047 leader_election.cc:341] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.107383 14483 ts_tablet_manager.cc:1939] T 3210614ebacf45c89d63413c51c8f923 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:17.107673 11362 tablet_bootstrap.cc:654] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.108493 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 3210614ebacf45c89d63413c51c8f923 (table default.Table_684e178eb9f141b7961759410506cbcc [id=0783c2552e6d4befb1cad31a4a641743]) successfully deleted
W20260811 06:17:17.108861 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 5195c4d7b09d45b8873575e1f67a5cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5195c4d7b09d45b8873575e1f67a5cb3 already in progress: creating tablet
W20260811 06:17:17.109088 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a0c8b46163af4623b93af79302871941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0c8b46163af4623b93af79302871941 already in progress: creating tablet
W20260811 06:17:17.113077 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet b5bf05ee95b244b88b943cc1d37f8839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bf05ee95b244b88b943cc1d37f8839 already in progress: creating tablet
W20260811 06:17:17.113771 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfab8bff5bd4a6cb7ea85dae3a48888 already in progress: creating tablet
I20260811 06:17:17.114477 10918 raft_consensus.cc:3037] T 99ecc0c0f0e5450abacd9da8fe5a19a7 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:17.114500 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 40c31ffb11484783bca9263c947f37da because the tablet was not found. No further retry: Not found: Tablet not found: 40c31ffb11484783bca9263c947f37da
I20260811 06:17:17.114856 14483 tablet_replica.cc:330] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:17.115085 14483 raft_consensus.cc:2229] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.115237 14483 raft_consensus.cc:2258] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.116022 14483 ts_tablet_manager.cc:1905] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.118825 11362 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.119279 11362 ts_tablet_manager.cc:1397] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.002s
I20260811 06:17:17.120100 11362 raft_consensus.cc:348] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.120414 11362 raft_consensus.cc:374] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.120523 11362 raft_consensus.cc:729] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.120836 11362 consensus_queue.cc:260] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.125198 11362 ts_tablet_manager.cc:1428] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:17:17.126366 11362 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.128095 11362 tablet_bootstrap.cc:654] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.135303 11361 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.136721 10923 raft_consensus.cc:3037] T 1271c4ab028d4d45acfee370f13a02d3 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.138293 14483 ts_tablet_manager.cc:1918] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.151388 14676 tablet.cc:1722] T 485e465a43c14fc8ad3a70c6e3ee7628 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:17.152299 14483 log.cc:1196] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/61671753b0964b3987bd3f33226857b7
I20260811 06:17:17.158175 14483 ts_tablet_manager.cc:1939] T 61671753b0964b3987bd3f33226857b7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:17.159905 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 61671753b0964b3987bd3f33226857b7 (table default.Table_aafb83d805da497abbe1d6787dcfab64 [id=d18203f4ce134a19a0ee001fa51bab77]) successfully deleted
W20260811 06:17:17.163733 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 45fc206d95a244e395d19328ae289485 because the tablet was not found. No further retry: Not found: Tablet not found: 45fc206d95a244e395d19328ae289485
W20260811 06:17:17.165632 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e18f96539b76422ab3ae65bdfe2cf74d because the tablet was not found. No further retry: Not found: Tablet not found: e18f96539b76422ab3ae65bdfe2cf74d
I20260811 06:17:17.143060 14677 consensus_queue.cc:1035] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260811 06:17:17.167268 10872 tablet_service.cc:1467] Processing CreateTablet for tablet ec871ba9fc0248cc96469a2058784cf8 (DEFAULT_TABLE table=default.Table_48d9c06727ce47bea11ed7220289a258 [id=e3ec51d12062433c89245cb0db328997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.167727 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec871ba9fc0248cc96469a2058784cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.150759 14665 tablet.cc:1722] T 485e465a43c14fc8ad3a70c6e3ee7628 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:17.178189 11046 consensus_peers.cc:487] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4209fc7d2efb415e8794fb33e7f2e5ac. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.189066 11098 tablet_service.cc:1467] Processing CreateTablet for tablet ec871ba9fc0248cc96469a2058784cf8 (DEFAULT_TABLE table=default.Table_48d9c06727ce47bea11ed7220289a258 [id=e3ec51d12062433c89245cb0db328997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.189580 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec871ba9fc0248cc96469a2058784cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.194011 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1 (DEFAULT_TABLE table=default.Table_63f05d0e9aaa4fb5a48aa59062a3a456 [id=ff3ffe9a794a4461992606531aedcd32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.194535 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.196635 10604 tablet_service.cc:1467] Processing CreateTablet for tablet ec871ba9fc0248cc96469a2058784cf8 (DEFAULT_TABLE table=default.Table_48d9c06727ce47bea11ed7220289a258 [id=e3ec51d12062433c89245cb0db328997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.197067 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec871ba9fc0248cc96469a2058784cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.199527 14677 consensus_queue.cc:1035] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.200047 14677 consensus_queue.cc:1035] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.201990 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1 (DEFAULT_TABLE table=default.Table_63f05d0e9aaa4fb5a48aa59062a3a456 [id=ff3ffe9a794a4461992606531aedcd32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.203034 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.206453 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1 (DEFAULT_TABLE table=default.Table_63f05d0e9aaa4fb5a48aa59062a3a456 [id=ff3ffe9a794a4461992606531aedcd32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.206897 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cc85a4f8e2e4e4bace0008cc0b8f3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.135615 11361 ts_tablet_manager.cc:1397] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.148s user 0.002s sys 0.002s
I20260811 06:17:17.210855 11361 raft_consensus.cc:348] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.211244 11361 raft_consensus.cc:374] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.211377 11361 raft_consensus.cc:729] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.222118 11656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 446112faf4374fa29fea8bb40666856e
I20260811 06:17:17.223026 11656 catalog_manager.cc:6565] ReplaceTablet: tablet 446112faf4374fa29fea8bb40666856e deleted and replaced by tablet 7fe1d650abe7432f990b0639377b2694
I20260811 06:17:17.225086 14483 tablet_replica.cc:330] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
W20260811 06:17:17.225085 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
W20260811 06:17:17.225440 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 1649493bd0924ee48fd5044d7288932d because the tablet was not found. No further retry: Not found: Tablet not found: 1649493bd0924ee48fd5044d7288932d
I20260811 06:17:17.225485 14483 raft_consensus.cc:2229] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.225849 14483 raft_consensus.cc:2258] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:17.225849 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet fd91e4f85cc64de9a13c598a3695f8a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd91e4f85cc64de9a13c598a3695f8a1 already in progress: creating tablet
W20260811 06:17:17.226150 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 814b7a212b164b4f8551ece59f57fafd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 814b7a212b164b4f8551ece59f57fafd already in progress: creating tablet
W20260811 06:17:17.226539 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2df64ad168f341be899eba30e55b7f44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df64ad168f341be899eba30e55b7f44 already in progress: creating tablet
W20260811 06:17:17.226850 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2d9627d9f88466ba499aa175151f46a because the tablet was not found. No further retry: Not found: Tablet not found: c2d9627d9f88466ba499aa175151f46a
W20260811 06:17:17.227217 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 79f307f50e044435be880079219170d8 because the tablet was not found. No further retry: Not found: Tablet not found: 79f307f50e044435be880079219170d8
W20260811 06:17:17.227535 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet c2527862e75b42aa9091456b0f5f994e because the tablet was not found. No further retry: Not found: Tablet not found: c2527862e75b42aa9091456b0f5f994e
W20260811 06:17:17.227913 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet e00a72f178f74ca59cc073fe78c99373 because the tablet was not found. No further retry: Not found: Tablet not found: e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:17.229357 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 446112faf4374fa29fea8bb40666856e with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe1d650abe7432f990b0639377b2694) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.229643 14484 ts_tablet_manager.cc:1918] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.229880 14484 log.cc:1196] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/5e990aa374204f2b95c08b04121176bc
I20260811 06:17:17.230368 14484 ts_tablet_manager.cc:1939] T 5e990aa374204f2b95c08b04121176bc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:17.230502 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 446112faf4374fa29fea8bb40666856e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446112faf4374fa29fea8bb40666856e already in progress: creating tablet
W20260811 06:17:17.230751 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 314a569c95414c04b8b505ca471caa6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 314a569c95414c04b8b505ca471caa6b already in progress: creating tablet
I20260811 06:17:17.232373 11655 catalog_manager.cc:5495] T 1c03ffd4a98a49258a0c0d72aa6fb6eb P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } }
I20260811 06:17:17.233951 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:17.234314 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:17.234859 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:17.235342 11655 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:17.236428 11655 catalog_manager.cc:5495] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65). New cstate: current_term: 1 leader_uuid: "24d29113b2454d9c93e23db3e3dac801" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
W20260811 06:17:17.235981 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4209fc7d2efb415e8794fb33e7f2e5ac because the tablet was not found. No further retry: Not found: Tablet not found: 4209fc7d2efb415e8794fb33e7f2e5ac
I20260811 06:17:17.247378 11365 tablet_bootstrap.cc:492] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:17.247653 11365 ts_tablet_manager.cc:1397] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.266s user 0.003s sys 0.003s
I20260811 06:17:17.248767 11365 raft_consensus.cc:348] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.249830 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 446112faf4374fa29fea8bb40666856e with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe1d650abe7432f990b0639377b2694) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:17.251657 11365 raft_consensus.cc:374] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.251915 11365 raft_consensus.cc:729] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.252252 14666 tablet.cc:1722] T 485e465a43c14fc8ad3a70c6e3ee7628 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:17.252985 11365 consensus_queue.cc:260] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.264600 11365 ts_tablet_manager.cc:1428] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260811 06:17:17.266592 14455 raft_consensus.cc:482] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.266753 14455 raft_consensus.cc:504] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.267347 14455 leader_election.cc:288] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.236163 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 446112faf4374fa29fea8bb40666856e with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe1d650abe7432f990b0639377b2694) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:17.240370 13740 consensus_queue.cc:1035] T a8513fc279dc44f48c45e9dda40e5398 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.250882 14343 consensus_queue.cc:1035] T fb5484b422a843b7810dd3b68a178ffd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.269312 14343 raft_consensus.cc:482] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.269493 14343 raft_consensus.cc:504] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.270161 14343 leader_election.cc:288] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.277884 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:17.279565 11047 leader_election.cc:341] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.211709 11361 consensus_queue.cc:260] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
W20260811 06:17:17.282933 11047 consensus_peers.cc:487] T a33fc402d3084b458929d76b8fc22adb P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.284118 11361 ts_tablet_manager.cc:1428] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.074s user 0.001s sys 0.001s
I20260811 06:17:17.284585 11361 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.286451 11361 tablet_bootstrap.cc:654] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.282927 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.293516 10873 tablet_service.cc:1467] Processing CreateTablet for tablet b22aaedd8dde4a7babd189e7023e01b8 (DEFAULT_TABLE table=default.Table_7f87228ce650443f9095ff35a39e7bfc [id=547adbf627b240868828bfa2e817b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.293982 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b22aaedd8dde4a7babd189e7023e01b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.297449 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 474) took 1340 ms. Trace:
I20260811 06:17:17.297631 14484 rpcz_store.cc:276] 0811 06:17:15.957437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.957976 (+ 539us) service_pool.cc:227] Handling call
0811 06:17:16.959264 (+1001288us) ts_tablet_manager.cc:1145] Deleting tablet 5e990aa374204f2b95c08b04121176bc
0811 06:17:16.959277 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.094854 (+135577us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.229429 (+134575us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.297405 (+ 67976us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001169}
I20260811 06:17:17.298707 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 475) took 1341 ms. Trace:
I20260811 06:17:17.298880 14484 rpcz_store.cc:276] 0811 06:17:15.957505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.958127 (+ 622us) service_pool.cc:227] Handling call
0811 06:17:17.298155 (+1340028us) ts_tablet_manager.cc:1145] Deleting tablet 1a2e55d5e0244c299d837aed98f94aad
0811 06:17:17.298600 (+ 445us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.298688 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1339869}
I20260811 06:17:17.299618 14484 tablet_replica.cc:330] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.299875 14484 raft_consensus.cc:2229] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.300074 14484 raft_consensus.cc:2258] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.300729 14484 ts_tablet_manager.cc:1905] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.301735 11365 tablet_bootstrap.cc:492] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:17.268299 14483 ts_tablet_manager.cc:1905] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.271219 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "866460b8d10a4cd1aed8a7a4e5511b29" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.303392 10655 raft_consensus.cc:2379] T 866460b8d10a4cd1aed8a7a4e5511b29 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:17.280215 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.303700 10645 raft_consensus.cc:2454] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.304042 14455 raft_consensus.cc:482] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.304127 11046 leader_election.cc:302] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:17.304180 14455 raft_consensus.cc:504] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.304364 13740 raft_consensus.cc:2781] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.304451 13740 raft_consensus.cc:482] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.304512 13740 raft_consensus.cc:3037] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.304793 14455 leader_election.cc:288] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:17.305328 11046 consensus_peers.cc:487] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e18f96539b76422ab3ae65bdfe2cf74d. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.306288 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 5e990aa374204f2b95c08b04121176bc (table default.Table_c0c8c3cafad748299fdc39d29c90a58f [id=1e13f56f08c54ef48f288001ba00c7e8]) successfully deleted
W20260811 06:17:17.306751 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 1a2e55d5e0244c299d837aed98f94aad because the tablet was not found. No further retry: Not found: Tablet not found: 1a2e55d5e0244c299d837aed98f94aad
I20260811 06:17:17.307072 13740 raft_consensus.cc:504] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.307685 13740 leader_election.cc:288] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.308138 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.308363 10645 raft_consensus.cc:3037] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.310997 10645 raft_consensus.cc:2454] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.311283 11365 tablet_bootstrap.cc:654] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.311520 11046 leader_election.cc:302] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.311887 13740 raft_consensus.cc:2781] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.312083 13740 raft_consensus.cc:686] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.312244 10810 leader_election.cc:302] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.312650 14455 raft_consensus.cc:3037] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.312450 13740 consensus_queue.cc:237] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.315332 14455 raft_consensus.cc:2726] T 866460b8d10a4cd1aed8a7a4e5511b29 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.318205 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.315946 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.319382 10645 raft_consensus.cc:2454] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:17.320153 11362 tablet_bootstrap.cc:492] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.320307 11362 ts_tablet_manager.cc:1397] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.194s user 0.003s sys 0.003s
I20260811 06:17:17.320984 11362 raft_consensus.cc:348] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.321198 11362 raft_consensus.cc:374] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.321254 11362 raft_consensus.cc:729] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.321578 10810 leader_election.cc:302] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.321857 14455 raft_consensus.cc:2781] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.321949 14455 raft_consensus.cc:482] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.322021 14455 raft_consensus.cc:3037] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.322364 11361 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.323232 11361 ts_tablet_manager.cc:1397] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260811 06:17:17.324548 14455 raft_consensus.cc:504] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.325472 14455 leader_election.cc:288] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.326048 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.326329 10645 raft_consensus.cc:3037] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.329389 14343 consensus_queue.cc:1035] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.333698 10645 raft_consensus.cc:2454] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:17.334935 11361 raft_consensus.cc:348] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.335188 11361 raft_consensus.cc:374] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.335240 11361 raft_consensus.cc:729] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.336519 10810 leader_election.cc:302] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.336849 14697 raft_consensus.cc:2781] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.337002 14697 raft_consensus.cc:686] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:17.337247 14697 consensus_queue.cc:237] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.340955 14408 raft_consensus.cc:482] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.341147 14408 raft_consensus.cc:504] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.341789 14408 leader_election.cc:288] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.342273 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:17.342798 10564 leader_election.cc:341] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.333897 11365 tablet_bootstrap.cc:492] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:17.344374 11365 ts_tablet_manager.cc:1397] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260811 06:17:17.345901 11361 consensus_queue.cc:260] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.346956 10910 raft_consensus.cc:3037] T 1a7d05ec3851467dbf1ef9319b1c9462 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.347463 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:17.347922 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aacb1b4304d4c7f9f4630bf7fcbb0ab" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.352859 14484 ts_tablet_manager.cc:1918] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.353343 11656 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4530e0ff64ae41b8a453e4be20673822" } new_table_name: "default.Table_6c84470c4e8e4e0fa09d719f9cbc7f20" modify_external_catalogs: true
I20260811 06:17:17.356357 14483 ts_tablet_manager.cc:1918] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:17.356494 14483 log.cc:1196] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/d6063a34ee55495584ed5623215a130f
I20260811 06:17:17.356855 14483 ts_tablet_manager.cc:1939] T d6063a34ee55495584ed5623215a130f P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:17.358500 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]) successfully deleted
I20260811 06:17:17.345201 11365 raft_consensus.cc:348] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.366694 11365 raft_consensus.cc:374] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.367843 11365 raft_consensus.cc:729] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.368134 11365 consensus_queue.cc:260] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.370285 11365 ts_tablet_manager.cc:1428] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260811 06:17:17.372619 14697 raft_consensus.cc:482] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.372828 14697 raft_consensus.cc:504] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.373478 14697 leader_election.cc:288] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.373926 11365 tablet_bootstrap.cc:492] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:17.375810 11365 tablet_bootstrap.cc:654] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.381950 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.382306 10655 raft_consensus.cc:2454] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:17.383064 10810 leader_election.cc:302] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.383433 14697 raft_consensus.cc:2781] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.383565 14697 raft_consensus.cc:482] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.383688 14697 raft_consensus.cc:3037] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:17.385303 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 446112faf4374fa29fea8bb40666856e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446112faf4374fa29fea8bb40666856e already in progress: creating tablet
I20260811 06:17:17.386725 14697 raft_consensus.cc:504] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.387653 14697 leader_election.cc:288] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.388473 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.388725 10645 raft_consensus.cc:3037] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.362648 11361 ts_tablet_manager.cc:1428] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260811 06:17:17.369648 11098 tablet_service.cc:1467] Processing CreateTablet for tablet b22aaedd8dde4a7babd189e7023e01b8 (DEFAULT_TABLE table=default.Table_7f87228ce650443f9095ff35a39e7bfc [id=547adbf627b240868828bfa2e817b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.390832 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b22aaedd8dde4a7babd189e7023e01b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.391716 10645 raft_consensus.cc:2454] T f1276a6c043948529b7537081e34b257 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:17.392606 10810 leader_election.cc:302] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.393216 14455 raft_consensus.cc:2781] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.393903 14455 raft_consensus.cc:686] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:17.394232 14455 consensus_queue.cc:237] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.397066 11361 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.399153 11361 tablet_bootstrap.cc:654] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.401886 14484 log.cc:1196] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/516e3c37321f4c7b9f3373164682a0ff
I20260811 06:17:17.402503 14484 ts_tablet_manager.cc:1939] T 516e3c37321f4c7b9f3373164682a0ff P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.405933 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 476) took 1447 ms. Trace:
I20260811 06:17:17.407135 14484 rpcz_store.cc:276] 0811 06:17:15.958610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.958666 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:17.299572 (+1340906us) ts_tablet_manager.cc:1145] Deleting tablet 516e3c37321f4c7b9f3373164682a0ff
0811 06:17:17.299582 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.349799 (+ 50217us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.352757 (+ 2958us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.405907 (+ 53150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1340757}
I20260811 06:17:17.407063 11361 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.414640 11361 ts_tablet_manager.cc:1397] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260811 06:17:17.415647 11361 raft_consensus.cc:348] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.415987 11361 raft_consensus.cc:374] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.416090 11361 raft_consensus.cc:729] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.416385 11361 consensus_queue.cc:260] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.417837 11361 ts_tablet_manager.cc:1428] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:17.418212 11361 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.419211 14484 tablet_replica.cc:330] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.419484 14484 raft_consensus.cc:2229] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.423833 11361 tablet_bootstrap.cc:654] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.424445 14484 raft_consensus.cc:2258] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.426146 14484 ts_tablet_manager.cc:1905] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.426877 14408 raft_consensus.cc:482] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.427032 14408 raft_consensus.cc:504] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.427636 14408 leader_election.cc:288] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.428200 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:17.428865 10564 leader_election.cc:341] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.432513 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 516e3c37321f4c7b9f3373164682a0ff (table default.Table_98dfdc335a9a4099a9eecb03b173c8af [id=e3a4a160df774098895b9e3c2690ef6f]) successfully deleted
I20260811 06:17:17.436995 11361 tablet_bootstrap.cc:492] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.437255 11361 ts_tablet_manager.cc:1397] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260811 06:17:17.438153 11361 raft_consensus.cc:348] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.438472 11361 raft_consensus.cc:374] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.438612 11361 raft_consensus.cc:729] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.438921 11361 consensus_queue.cc:260] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:17.441174 11588 consensus_peers.cc:487] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 -> Peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Couldn't send request to peer 29fb239be50c4171bdbc75e064555197. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260811 06:17:17.441828 11361 ts_tablet_manager.cc:1428] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:17.442248 11361 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.444779 11361 tablet_bootstrap.cc:654] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.453274 10620 tablet_service.cc:1467] Processing CreateTablet for tablet b22aaedd8dde4a7babd189e7023e01b8 (DEFAULT_TABLE table=default.Table_7f87228ce650443f9095ff35a39e7bfc [id=547adbf627b240868828bfa2e817b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.453874 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b22aaedd8dde4a7babd189e7023e01b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.455287 14484 ts_tablet_manager.cc:1918] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.458267 14484 log.cc:1196] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/a04766ede03342efb594aaf081e112af
W20260811 06:17:17.458500 10813 leader_election.cc:341] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.458560 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.458806 14484 ts_tablet_manager.cc:1939] T a04766ede03342efb594aaf081e112af P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:17.458873 10813 leader_election.cc:341] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.459678 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 477) took 1500 ms. Trace:
I20260811 06:17:17.460186 10910 raft_consensus.cc:3037] T 576a3e27d5424e4b999a05beb898d4bb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.460234 14484 rpcz_store.cc:276] 0811 06:17:15.958949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.959113 (+ 164us) service_pool.cc:227] Handling call
0811 06:17:17.419162 (+1460049us) ts_tablet_manager.cc:1145] Deleting tablet a04766ede03342efb594aaf081e112af
0811 06:17:17.419173 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.434835 (+ 15662us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.455178 (+ 20343us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.459653 (+ 4475us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459909}
I20260811 06:17:17.460637 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 478) took 1501 ms. Trace:
I20260811 06:17:17.460713 14484 rpcz_store.cc:276] 0811 06:17:15.959077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:15.959295 (+ 218us) service_pool.cc:227] Handling call
0811 06:17:17.460533 (+1501238us) ts_tablet_manager.cc:1145] Deleting tablet 8741294bc33e454a9c4ef1717ccef80f
0811 06:17:17.460545 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.460620 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1501124}
I20260811 06:17:17.461225 14484 tablet_replica.cc:330] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.461184 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet a04766ede03342efb594aaf081e112af (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]) successfully deleted
I20260811 06:17:17.461443 14484 raft_consensus.cc:2229] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
W20260811 06:17:17.461637 11047 leader_election.cc:341] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.461753 14484 raft_consensus.cc:2258] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.462172 13740 consensus_queue.cc:1035] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.462914 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.463106 11159 raft_consensus.cc:2454] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:17.463187 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 8741294bc33e454a9c4ef1717ccef80f because the tablet was not found. No further retry: Not found: Tablet not found: 8741294bc33e454a9c4ef1717ccef80f
I20260811 06:17:17.463369 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1276a6c043948529b7537081e34b257" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:17.463514 11158 raft_consensus.cc:3037] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.466850 11158 raft_consensus.cc:2454] T f1276a6c043948529b7537081e34b257 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:17.468312 14484 ts_tablet_manager.cc:1905] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.469560 11361 tablet_bootstrap.cc:492] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.472396 11361 ts_tablet_manager.cc:1397] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260811 06:17:17.473188 11361 raft_consensus.cc:348] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.473961 11361 raft_consensus.cc:374] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.474071 11361 raft_consensus.cc:729] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.474370 11361 consensus_queue.cc:260] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.478469 11361 ts_tablet_manager.cc:1428] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:17.478856 11361 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.480518 11361 tablet_bootstrap.cc:654] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:17.481372 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 604cba8a4978479cbb15307aeb45a634 consensus state has no leader
W20260811 06:17:17.485320 10555 leader_election.cc:341] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.485460 10555 leader_election.cc:302] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.485661 14408 raft_consensus.cc:2726] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.487540 10873 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5a77737d04f59a327b911f5ed53dd (DEFAULT_TABLE table=default.Table_fc4a1a0d46f1451ebd5ae01ad358ff90 [id=fcee6663af43483cb6c08a25c8466ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.488106 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5a77737d04f59a327b911f5ed53dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.496776 14484 ts_tablet_manager.cc:1918] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:17.496922 14484 log.cc:1196] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/4209fc7d2efb415e8794fb33e7f2e5ac
I20260811 06:17:17.497296 14484 ts_tablet_manager.cc:1939] T 4209fc7d2efb415e8794fb33e7f2e5ac P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.498276 11362 consensus_queue.cc:260] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.501186 11361 tablet_bootstrap.cc:492] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.501325 11361 ts_tablet_manager.cc:1397] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260811 06:17:17.502117 11361 raft_consensus.cc:348] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.502326 11361 raft_consensus.cc:374] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.502373 11361 raft_consensus.cc:729] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.502589 11361 consensus_queue.cc:260] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.503273 11361 ts_tablet_manager.cc:1428] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:17.503551 11361 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.504825 11365 tablet_bootstrap.cc:492] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:17.505046 11365 ts_tablet_manager.cc:1397] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.131s user 0.004s sys 0.000s
I20260811 06:17:17.505926 11365 raft_consensus.cc:348] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.506227 11365 raft_consensus.cc:374] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.506330 11365 raft_consensus.cc:729] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.506620 11365 consensus_queue.cc:260] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.508297 11361 tablet_bootstrap.cc:654] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.509815 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 479) took 1175 ms. Trace:
I20260811 06:17:17.513700 14484 rpcz_store.cc:276] 0811 06:17:16.333944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.334020 (+ 76us) service_pool.cc:227] Handling call
0811 06:17:17.461179 (+1127159us) ts_tablet_manager.cc:1145] Deleting tablet 4209fc7d2efb415e8794fb33e7f2e5ac
0811 06:17:17.461189 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.488153 (+ 26964us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.496659 (+ 8506us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.509789 (+ 13130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126651}
I20260811 06:17:17.514318 14484 tablet_replica.cc:330] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.514609 14484 raft_consensus.cc:2229] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.514938 14484 raft_consensus.cc:2258] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.515599 14484 ts_tablet_manager.cc:1905] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.516268 10868 tablet_service.cc:1467] Processing CreateTablet for tablet cf23bb73afce4c0984e61aaef6d15d43 (DEFAULT_TABLE table=default.Table_34ed67520b7e43ed919366773d11e54e [id=819d448fdd03404d9e09a13883da7c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.516708 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf23bb73afce4c0984e61aaef6d15d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.518095 13740 raft_consensus.cc:482] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.518220 13740 raft_consensus.cc:504] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.518815 13740 leader_election.cc:288] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:17.525480 11046 leader_election.cc:341] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f6f682f675c344b6b5955e834f94091f
I20260811 06:17:17.525947 13740 raft_consensus.cc:482] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.526113 11362 ts_tablet_manager.cc:1428] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.206s user 0.001s sys 0.001s
I20260811 06:17:17.526084 13740 raft_consensus.cc:504] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.526633 13740 leader_election.cc:288] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:17.527851 11046 leader_election.cc:341] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c2527862e75b42aa9091456b0f5f994e
I20260811 06:17:17.528326 11362 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.530885 11362 tablet_bootstrap.cc:654] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.532609 13740 consensus_queue.cc:1035] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.533854 11361 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.534057 11361 ts_tablet_manager.cc:1397] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.002s
I20260811 06:17:17.535676 10602 tablet_service.cc:1467] Processing CreateTablet for tablet cf23bb73afce4c0984e61aaef6d15d43 (DEFAULT_TABLE table=default.Table_34ed67520b7e43ed919366773d11e54e [id=819d448fdd03404d9e09a13883da7c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.535158 11361 raft_consensus.cc:348] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.536289 11361 raft_consensus.cc:374] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.536427 11361 raft_consensus.cc:729] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.536746 11361 consensus_queue.cc:260] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.538192 10868 tablet_service.cc:1467] Processing CreateTablet for tablet f1cebe398a2245d18b185ab4967ee563 (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.538662 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1cebe398a2245d18b185ab4967ee563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.540563 11361 ts_tablet_manager.cc:1428] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260811 06:17:17.540928 11361 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.544539 10872 tablet_service.cc:1467] Processing CreateTablet for tablet f641e74b14d840feb20bf5881ee57864 (DEFAULT_TABLE table=default.Table_be815b4de0f84b5c9d50ed9794cf6acc [id=2ea1469ca13c4a85a075073293e41699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.544982 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f641e74b14d840feb20bf5881ee57864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.544201 13740 consensus_queue.cc:1035] T 1a7d05ec3851467dbf1ef9319b1c9462 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.548287 11361 tablet_bootstrap.cc:654] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.552696 14484 ts_tablet_manager.cc:1918] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.553220 14484 log.cc:1196] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e329d808c59c4f66bbc515d751255e96
I20260811 06:17:17.553740 14484 ts_tablet_manager.cc:1939] T e329d808c59c4f66bbc515d751255e96 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:17.554380 10037 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 78147.2us
I20260811 06:17:17.555763 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 484) took 1058 ms. Trace:
I20260811 06:17:17.555857 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 4209fc7d2efb415e8794fb33e7f2e5ac (table default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]) successfully deleted
I20260811 06:17:17.556077 14484 rpcz_store.cc:276] 0811 06:17:16.497132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.497535 (+ 403us) service_pool.cc:227] Handling call
0811 06:17:17.514257 (+1016722us) ts_tablet_manager.cc:1145] Deleting tablet e329d808c59c4f66bbc515d751255e96
0811 06:17:17.514272 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.531140 (+ 16868us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.552601 (+ 21461us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.555741 (+ 3140us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016502}
I20260811 06:17:17.556914 11098 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5a77737d04f59a327b911f5ed53dd (DEFAULT_TABLE table=default.Table_fc4a1a0d46f1451ebd5ae01ad358ff90 [id=fcee6663af43483cb6c08a25c8466ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.558353 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5a77737d04f59a327b911f5ed53dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.558440 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.557292 11094 tablet_service.cc:1467] Processing CreateTablet for tablet cf23bb73afce4c0984e61aaef6d15d43 (DEFAULT_TABLE table=default.Table_34ed67520b7e43ed919366773d11e54e [id=819d448fdd03404d9e09a13883da7c64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.562460 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:17.562592 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf23bb73afce4c0984e61aaef6d15d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.562763 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:17.563472 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:17.564977 11365 ts_tablet_manager.cc:1428] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260811 06:17:17.565483 11365 tablet_bootstrap.cc:492] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:17.557668 11106 tablet_service.cc:1467] Processing CreateTablet for tablet f641e74b14d840feb20bf5881ee57864 (DEFAULT_TABLE table=default.Table_be815b4de0f84b5c9d50ed9794cf6acc [id=2ea1469ca13c4a85a075073293e41699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.566269 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f641e74b14d840feb20bf5881ee57864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.567569 11365 tablet_bootstrap.cc:654] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.570335 10604 tablet_service.cc:1467] Processing CreateTablet for tablet e2c5a77737d04f59a327b911f5ed53dd (DEFAULT_TABLE table=default.Table_fc4a1a0d46f1451ebd5ae01ad358ff90 [id=fcee6663af43483cb6c08a25c8466ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.570485 10613 tablet_service.cc:1467] Processing CreateTablet for tablet f641e74b14d840feb20bf5881ee57864 (DEFAULT_TABLE table=default.Table_be815b4de0f84b5c9d50ed9794cf6acc [id=2ea1469ca13c4a85a075073293e41699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.570719 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c5a77737d04f59a327b911f5ed53dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.570940 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f641e74b14d840feb20bf5881ee57864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.571138 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf23bb73afce4c0984e61aaef6d15d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.585569 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 485) took 1088 ms. Trace:
I20260811 06:17:17.585834 14484 rpcz_store.cc:276] 0811 06:17:16.497200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.497784 (+ 584us) service_pool.cc:227] Handling call
0811 06:17:17.585450 (+1087666us) ts_tablet_manager.cc:1145] Deleting tablet 12971f852ea943b78d967f7672680cad
0811 06:17:17.585460 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.585547 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087493}
I20260811 06:17:17.586278 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 486) took 1089 ms. Trace:
I20260811 06:17:17.586427 14484 rpcz_store.cc:276] 0811 06:17:16.497265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.498000 (+ 735us) service_pool.cc:227] Handling call
0811 06:17:17.586193 (+1088193us) ts_tablet_manager.cc:1145] Deleting tablet a183d0915a5a48c2a26994d47f6fe266
0811 06:17:17.586203 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.586264 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088049}
I20260811 06:17:17.586743 14484 tablet_replica.cc:330] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.587016 14484 raft_consensus.cc:2229] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.587368 14484 raft_consensus.cc:2258] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.588147 14484 ts_tablet_manager.cc:1905] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.592870 11361 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.593091 11361 ts_tablet_manager.cc:1397] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.002s
I20260811 06:17:17.593598 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 52db1da6e52041c7bee61749c26f6f08 (DEFAULT_TABLE table=default.Table_70c04617779f409ebcd0de067b766d8e [id=737f51fa77054d678d3c70f279776757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.594050 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52db1da6e52041c7bee61749c26f6f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.594134 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 909139ae7dbf4c809d52cd46ca56410b (DEFAULT_TABLE table=default.Table_324a200ace884f2bbede37c5207d7f93 [id=9f568665bd2b4ccfb0fcac36ffecc9f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.594512 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909139ae7dbf4c809d52cd46ca56410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.598163 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 52db1da6e52041c7bee61749c26f6f08 (DEFAULT_TABLE table=default.Table_70c04617779f409ebcd0de067b766d8e [id=737f51fa77054d678d3c70f279776757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.598816 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52db1da6e52041c7bee61749c26f6f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.599709 11361 raft_consensus.cc:348] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.601125 11361 raft_consensus.cc:374] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.601254 11361 raft_consensus.cc:729] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.601577 11361 consensus_queue.cc:260] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.604686 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet e329d808c59c4f66bbc515d751255e96 (table default.Table_1a9d6599c53846eaa0d3b2a61f7e61c9 [id=c8f85c8efd454d8d8b2ff7d3415856c2]) successfully deleted
W20260811 06:17:17.605180 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 12971f852ea943b78d967f7672680cad because the tablet was not found. No further retry: Not found: Tablet not found: 12971f852ea943b78d967f7672680cad
W20260811 06:17:17.605652 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a183d0915a5a48c2a26994d47f6fe266 because the tablet was not found. No further retry: Not found: Tablet not found: a183d0915a5a48c2a26994d47f6fe266
I20260811 06:17:17.608228 14352 consensus_queue.cc:1035] T 866460b8d10a4cd1aed8a7a4e5511b29 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:17.608671 10620 tablet_service.cc:1467] Processing CreateTablet for tablet f1cebe398a2245d18b185ab4967ee563 (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.608844 11094 tablet_service.cc:1467] Processing CreateTablet for tablet f1cebe398a2245d18b185ab4967ee563 (DEFAULT_TABLE table=default.Table_4ff56306486f476382e06c0bc8f15928 [id=c9cf31ae7ed9469e994e65311c6374f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.609223 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1cebe398a2245d18b185ab4967ee563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.609256 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1cebe398a2245d18b185ab4967ee563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.616605 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 52db1da6e52041c7bee61749c26f6f08 (DEFAULT_TABLE table=default.Table_70c04617779f409ebcd0de067b766d8e [id=737f51fa77054d678d3c70f279776757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.616999 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52db1da6e52041c7bee61749c26f6f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.617498 11362 tablet_bootstrap.cc:492] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.617643 11362 ts_tablet_manager.cc:1397] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.089s user 0.000s sys 0.003s
I20260811 06:17:17.618456 11362 raft_consensus.cc:348] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.618698 11362 raft_consensus.cc:374] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.618746 11362 raft_consensus.cc:729] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.622411 11362 consensus_queue.cc:260] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.628650 11362 ts_tablet_manager.cc:1428] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260811 06:17:17.629845 11362 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.631403 11362 tablet_bootstrap.cc:654] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.631953 11361 ts_tablet_manager.cc:1428] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260811 06:17:17.632534 11361 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.636888 14408 raft_consensus.cc:482] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.637045 14408 raft_consensus.cc:504] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.637810 14408 leader_election.cc:288] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.638666 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:17.639503 10564 leader_election.cc:341] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.640965 11361 tablet_bootstrap.cc:654] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.644569 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f682f675c344b6b5955e834f94091f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.644819 10923 raft_consensus.cc:2454] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.645287 14484 ts_tablet_manager.cc:1918] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.646894 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2527862e75b42aa9091456b0f5f994e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.647135 10923 raft_consensus.cc:2454] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.647935 14484 log.cc:1196] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/10211a4e95464e9e9e2b2e70d23086a5
I20260811 06:17:17.648562 14484 ts_tablet_manager.cc:1939] T 10211a4e95464e9e9e2b2e70d23086a5 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.649281 11361 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.649507 11361 ts_tablet_manager.cc:1397] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260811 06:17:17.650398 11361 raft_consensus.cc:348] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.650715 11361 raft_consensus.cc:374] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.650815 11361 raft_consensus.cc:729] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.650542 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 487) took 1153 ms. Trace:
I20260811 06:17:17.651072 11361 consensus_queue.cc:260] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.651531 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 909139ae7dbf4c809d52cd46ca56410b (DEFAULT_TABLE table=default.Table_324a200ace884f2bbede37c5207d7f93 [id=9f568665bd2b4ccfb0fcac36ffecc9f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.651973 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909139ae7dbf4c809d52cd46ca56410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.655877 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:17.656817 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 23ca4a89d00242ea98c5b964df27082f (table default.Table_b1633ab525bf4d3381d65de52f568771 [id=776130ee53724d72ba83b985a42f9b54]). Expected version 1 got 0
I20260811 06:17:17.657367 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:17.651962 11361 ts_tablet_manager.cc:1428] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:17.658531 11361 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:17.660049 10555 leader_election.cc:341] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.660195 10555 leader_election.cc:302] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.660240 11361 tablet_bootstrap.cc:654] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.660856 14408 raft_consensus.cc:2726] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.651156 14484 rpcz_store.cc:276] 0811 06:17:16.497329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.498171 (+ 842us) service_pool.cc:227] Handling call
0811 06:17:17.586700 (+1088529us) ts_tablet_manager.cc:1145] Deleting tablet 10211a4e95464e9e9e2b2e70d23086a5
0811 06:17:17.586709 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.638904 (+ 52195us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.645169 (+ 6265us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.650518 (+ 5349us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088423}
I20260811 06:17:17.662240 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 488) took 1164 ms. Trace:
I20260811 06:17:17.662647 11361 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.662755 14484 rpcz_store.cc:276] 0811 06:17:16.497419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.498303 (+ 884us) service_pool.cc:227] Handling call
0811 06:17:17.662111 (+1163808us) ts_tablet_manager.cc:1145] Deleting tablet 05867781f7954fb280cc83b2a13d0d61
0811 06:17:17.662124 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.662220 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163683}
I20260811 06:17:17.662948 11361 ts_tablet_manager.cc:1397] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260811 06:17:17.664004 11361 raft_consensus.cc:348] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.664288 11361 raft_consensus.cc:374] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.664392 11361 raft_consensus.cc:729] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.664618 11361 consensus_queue.cc:260] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.665623 11361 ts_tablet_manager.cc:1428] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:17.666078 11361 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.668273 11361 tablet_bootstrap.cc:654] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.675670 11365 tablet_bootstrap.cc:492] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:17.675838 11365 ts_tablet_manager.cc:1397] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.000s
I20260811 06:17:17.676369 14484 tablet_replica.cc:330] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.677140 14484 raft_consensus.cc:2229] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.677048 11365 raft_consensus.cc:348] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.677270 11365 raft_consensus.cc:374] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.677327 11365 raft_consensus.cc:729] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.677589 11365 consensus_queue.cc:260] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.678169 14484 raft_consensus.cc:2258] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.678236 11365 ts_tablet_manager.cc:1428] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:17.678903 11365 tablet_bootstrap.cc:492] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:17.679734 14484 ts_tablet_manager.cc:1905] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.682708 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 10211a4e95464e9e9e2b2e70d23086a5 (table default.Table_80c64d7a49ca45e3bfad0438b70ed13d [id=0d87a935d35c48b893db83a9ec292628]) successfully deleted
W20260811 06:17:17.683488 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 05867781f7954fb280cc83b2a13d0d61 because the tablet was not found. No further retry: Not found: Tablet not found: 05867781f7954fb280cc83b2a13d0d61
I20260811 06:17:17.684787 11047 leader_election.cc:302] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:17.685319 13740 raft_consensus.cc:2781] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.685410 13740 raft_consensus.cc:482] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.685472 13740 raft_consensus.cc:3037] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.685655 11047 leader_election.cc:302] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:17.685997 14100 raft_consensus.cc:2781] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.686074 14100 raft_consensus.cc:482] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.686125 14100 raft_consensus.cc:3037] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.688261 13740 raft_consensus.cc:504] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.689008 14100 raft_consensus.cc:504] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.689471 14100 leader_election.cc:288] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.689535 13740 leader_election.cc:288] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:17.689956 11047 consensus_peers.cc:487] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e18f96539b76422ab3ae65bdfe2cf74d. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:17.690965 11046 leader_election.cc:341] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: f6f682f675c344b6b5955e834f94091f
W20260811 06:17:17.691196 11046 leader_election.cc:341] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c2527862e75b42aa9091456b0f5f994e
I20260811 06:17:17.691550 14455 raft_consensus.cc:482] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.691718 14455 raft_consensus.cc:504] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.691923 11361 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.692049 11361 ts_tablet_manager.cc:1397] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20260811 06:17:17.692369 14455 leader_election.cc:288] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.693075 11361 raft_consensus.cc:348] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.693135 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.693445 10645 raft_consensus.cc:2454] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:17.693338 11361 raft_consensus.cc:374] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.693697 11361 raft_consensus.cc:729] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.693918 11361 consensus_queue.cc:260] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.694628 10810 leader_election.cc:302] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.694679 11361 ts_tablet_manager.cc:1428] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:17.694950 11361 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.695080 14455 raft_consensus.cc:2781] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.695170 14455 raft_consensus.cc:482] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.695240 14455 raft_consensus.cc:3037] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.697980 14455 raft_consensus.cc:504] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.699795 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.700034 10645 raft_consensus.cc:3037] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.700714 11361 tablet_bootstrap.cc:654] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.703181 10645 raft_consensus.cc:2454] T 1a0278945378465ea9d61180b5f539dd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:17.705562 10810 leader_election.cc:302] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:17.705885 14697 raft_consensus.cc:2781] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.706017 14697 raft_consensus.cc:686] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:17.706243 14697 consensus_queue.cc:237] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.706228 14455 leader_election.cc:288] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:17.712291 14484 ts_tablet_manager.cc:1918] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:17.712443 14484 log.cc:1196] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:17.712770 14484 ts_tablet_manager.cc:1939] T d9fa71e5477644e0a0d7c40ecc55928b P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.717329 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (table default.Table_99affff9b5fe49d48a5012cba18e007b [id=4477e6c360934e079e00533d56a91c11]). Expected version 1 got 0
I20260811 06:17:17.713745 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 489) took 1216 ms. Trace:
I20260811 06:17:17.718034 14484 rpcz_store.cc:276] 0811 06:17:16.497489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.498447 (+ 958us) service_pool.cc:227] Handling call
0811 06:17:17.676314 (+1177867us) ts_tablet_manager.cc:1145] Deleting tablet d9fa71e5477644e0a0d7c40ecc55928b
0811 06:17:17.676329 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.683891 (+ 7562us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.712163 (+ 28272us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.713705 (+ 1542us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177694}
I20260811 06:17:17.718465 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 483) took 1221 ms. Trace:
I20260811 06:17:17.718650 14484 rpcz_store.cc:276] 0811 06:17:16.497052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.499396 (+ 2344us) service_pool.cc:227] Handling call
0811 06:17:17.718345 (+1218949us) ts_tablet_manager.cc:1145] Deleting tablet ae1118c96cff4ea387f3d0ee94bef79b
0811 06:17:17.718357 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.718446 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218762}
I20260811 06:17:17.718987 14484 tablet_replica.cc:330] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.719234 14484 raft_consensus.cc:2229] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:17.719683 14484 raft_consensus.cc:2258] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.720710 14484 ts_tablet_manager.cc:1905] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.722806 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:17.734472 10555 leader_election.cc:341] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.734650 10555 leader_election.cc:302] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.734884 14408 raft_consensus.cc:2726] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.736581 14484 ts_tablet_manager.cc:1918] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:17.737452 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:17.738827 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_83f26821254345f388647eb918ca0a2b [id=d2255732f19f4b84828294798d33b5fc]). Expected version 1 got 0
I20260811 06:17:17.739445 14484 log.cc:1196] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e18f96539b76422ab3ae65bdfe2cf74d
I20260811 06:17:17.739809 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:17.739903 14484 ts_tablet_manager.cc:1939] T e18f96539b76422ab3ae65bdfe2cf74d P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.740779 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:17.740840 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 490) took 1240 ms. Trace:
I20260811 06:17:17.740931 14484 rpcz_store.cc:276] 0811 06:17:16.500352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.505622 (+ 5270us) service_pool.cc:227] Handling call
0811 06:17:17.718944 (+1213322us) ts_tablet_manager.cc:1145] Deleting tablet e18f96539b76422ab3ae65bdfe2cf74d
0811 06:17:17.718954 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.728002 (+ 9048us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.736445 (+ 8443us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.740815 (+ 4370us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1213092}
I20260811 06:17:17.741289 14484 tablet_replica.cc:330] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.741441 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:17.741519 14484 raft_consensus.cc:2229] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:17.741964 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:17.742679 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1168c63178174571907981d4a6ac165f (table default.Table_e8aa31ae81824fd699449a5bfe4ba023 [id=485faa9398f8447398dbdc64b6ef2167]). Expected version 1 got 0
I20260811 06:17:17.743116 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:17.743729 14677 raft_consensus.cc:482] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.743881 14677 raft_consensus.cc:504] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.744565 14677 leader_election.cc:288] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.745230 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.745512 10645 raft_consensus.cc:2454] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.745605 14484 raft_consensus.cc:2258] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.746099 11046 leader_election.cc:302] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.748039 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet d9fa71e5477644e0a0d7c40ecc55928b (table default.Table_5b5d84668c4a4af0af5832368bb75e15 [id=57544266c7ff4f32b6b047eb2d6720cf]) successfully deleted
I20260811 06:17:17.746363 14677 raft_consensus.cc:2781] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.748299 14677 raft_consensus.cc:482] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.748366 14677 raft_consensus.cc:3037] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:17.748831 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet ae1118c96cff4ea387f3d0ee94bef79b because the tablet was not found. No further retry: Not found: Tablet not found: ae1118c96cff4ea387f3d0ee94bef79b
I20260811 06:17:17.749428 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet e18f96539b76422ab3ae65bdfe2cf74d (table default.Table_5d578b33478a413dac2573d652e6b411 [id=4c4df3abba7045f98d7cf16a4c0a934d]) successfully deleted
W20260811 06:17:17.750818 11047 consensus_peers.cc:487] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.751086 14677 raft_consensus.cc:504] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.751663 14677 leader_election.cc:288] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.746958 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.752337 11159 raft_consensus.cc:2454] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:17.752518 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.747172 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a0278945378465ea9d61180b5f539dd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:17.747624 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 909139ae7dbf4c809d52cd46ca56410b (DEFAULT_TABLE table=default.Table_324a200ace884f2bbede37c5207d7f93 [id=9f568665bd2b4ccfb0fcac36ffecc9f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:17.752751 10645 raft_consensus.cc:3037] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.752837 11158 raft_consensus.cc:3037] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.753065 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909139ae7dbf4c809d52cd46ca56410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:17.755650 10645 raft_consensus.cc:2454] T 511f08c3d4d642368805b6a89743b367 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.755823 11158 raft_consensus.cc:2454] T 1a0278945378465ea9d61180b5f539dd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:17.756196 11046 leader_election.cc:302] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.756556 14677 raft_consensus.cc:2781] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.756693 14677 raft_consensus.cc:686] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.756940 14677 consensus_queue.cc:237] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.746282 14484 ts_tablet_manager.cc:1905] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.762821 11365 tablet_bootstrap.cc:654] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.772405 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2527862e75b42aa9091456b0f5f994e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.772657 10923 raft_consensus.cc:3037] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.775049 11362 tablet_bootstrap.cc:492] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.775198 11362 ts_tablet_manager.cc:1397] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.145s user 0.018s sys 0.027s
I20260811 06:17:17.776103 11362 raft_consensus.cc:348] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.776309 11362 raft_consensus.cc:374] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.776372 11362 raft_consensus.cc:729] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.776440 10923 raft_consensus.cc:2454] T c2527862e75b42aa9091456b0f5f994e P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.776608 11362 consensus_queue.cc:260] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.777184 11362 ts_tablet_manager.cc:1428] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:17.781944 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f682f675c344b6b5955e834f94091f" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.782156 10923 raft_consensus.cc:3037] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.785228 10923 raft_consensus.cc:2454] T f6f682f675c344b6b5955e834f94091f P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.785650 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.786177 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 485e465a43c14fc8ad3a70c6e3ee7628 (table default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd]). Expected version 1 got 0
I20260811 06:17:17.787011 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:17.787611 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:17.787988 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:17.791098 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511f08c3d4d642368805b6a89743b367" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.794322 11361 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.794555 11361 ts_tablet_manager.cc:1397] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.100s user 0.021s sys 0.008s
I20260811 06:17:17.795264 11361 raft_consensus.cc:348] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.795555 11361 raft_consensus.cc:374] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.795643 11361 raft_consensus.cc:729] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.795935 11362 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.795936 11361 consensus_queue.cc:260] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.798996 11047 leader_election.cc:302] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:17.799949 14100 raft_consensus.cc:2781] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.800097 14100 raft_consensus.cc:686] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.800253 11361 ts_tablet_manager.cc:1428] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260811 06:17:17.800307 14100 consensus_queue.cc:237] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:17.800534 11361 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.805228 14677 raft_consensus.cc:482] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.805429 14677 raft_consensus.cc:504] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.806792 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.807129 10645 raft_consensus.cc:2379] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:17.807799 14677 leader_election.cc:288] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.808422 11361 tablet_bootstrap.cc:654] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.808593 11362 tablet_bootstrap.cc:654] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.809607 11047 leader_election.cc:302] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:17.818833 14408 raft_consensus.cc:482] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.819058 14408 raft_consensus.cc:504] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.819568 14100 raft_consensus.cc:2781] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.819886 14408 leader_election.cc:288] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.820083 14100 raft_consensus.cc:686] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.820413 14100 consensus_queue.cc:237] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.820878 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.821002 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:17.770653 14484 ts_tablet_manager.cc:1918] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:17.821316 14484 log.cc:1196] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/40c31ffb11484783bca9263c947f37da
W20260811 06:17:17.821615 11047 leader_election.cc:341] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:17.821878 10564 leader_election.cc:341] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:17.822337 10555 leader_election.cc:341] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:17.822376 11047 leader_election.cc:341] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.822450 10555 leader_election.cc:302] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:17.822789 14408 raft_consensus.cc:2726] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.823225 14484 ts_tablet_manager.cc:1939] T 40c31ffb11484783bca9263c947f37da P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:17.824134 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:17.824728 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]). Expected version 1 got 0
I20260811 06:17:17.824899 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:17.825212 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 491) took 1314 ms. Trace:
I20260811 06:17:17.825496 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:17.825666 14484 rpcz_store.cc:276] 0811 06:17:16.510842 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.511887 (+ 1045us) service_pool.cc:227] Handling call
0811 06:17:17.741227 (+1229340us) ts_tablet_manager.cc:1145] Deleting tablet 40c31ffb11484783bca9263c947f37da
0811 06:17:17.741239 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.767258 (+ 26019us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.770545 (+ 3287us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:17.825189 (+ 54644us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229128}
I20260811 06:17:17.826198 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:17.826423 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:17.826696 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:17.826959 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 493) took 1243 ms. Trace:
I20260811 06:17:17.827206 14484 rpcz_store.cc:276] 0811 06:17:16.583814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.583880 (+ 66us) service_pool.cc:227] Handling call
0811 06:17:17.826462 (+1242582us) ts_tablet_manager.cc:1145] Deleting tablet 02bb2819d9cc4880803ef959c131b9ac
0811 06:17:17.826474 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.826937 (+ 463us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1242318}
I20260811 06:17:17.828506 14100 raft_consensus.cc:482] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.828639 14100 raft_consensus.cc:504] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.829569 14100 leader_election.cc:288] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.829950 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:17.830225 10645 raft_consensus.cc:2454] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:17.830417 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f3fa8872f8b4a5e9b09da26f8bba721" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.831375 11046 leader_election.cc:302] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.832139 14100 raft_consensus.cc:2781] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:17.832293 14100 raft_consensus.cc:482] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:17.832423 14100 raft_consensus.cc:3037] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.832908 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 40c31ffb11484783bca9263c947f37da (table default.Table_74b425e2198e46b0933c2694cd644a24 [id=60dc9ff63a44445687155bcf4f239507]) successfully deleted
W20260811 06:17:17.833596 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 02bb2819d9cc4880803ef959c131b9ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02bb2819d9cc4880803ef959c131b9ac already in progress: creating tablet
I20260811 06:17:17.834357 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 494) took 1231 ms. Trace:
I20260811 06:17:17.834471 14484 rpcz_store.cc:276] 0811 06:17:16.602775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.602847 (+ 72us) service_pool.cc:227] Handling call
0811 06:17:17.827723 (+1224876us) ts_tablet_manager.cc:1145] Deleting tablet 0f4d1035d5b0435a8a3611e5e15c1547
0811 06:17:17.827889 (+ 166us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.834040 (+ 6151us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1186107}
I20260811 06:17:17.834821 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 495) took 1097 ms. Trace:
I20260811 06:17:17.834400 11047 leader_election.cc:302] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:17.834918 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.835206 13740 raft_consensus.cc:3037] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.836897 14100 raft_consensus.cc:504] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.838604 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:17.838864 10645 raft_consensus.cc:3037] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:17.838958 13740 raft_consensus.cc:2726] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.843539 10645 raft_consensus.cc:2454] T a2f8100e334a4fd1b3c9b059e3bdef3e P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:17.843981 11046 leader_election.cc:302] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:17.844321 14677 raft_consensus.cc:2781] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:17.844431 14677 raft_consensus.cc:686] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:17.844645 14677 consensus_queue.cc:237] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.847450 14352 raft_consensus.cc:482] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:17.847584 14352 raft_consensus.cc:504] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.847856 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:17.848170 14352 leader_election.cc:288] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:17.849259 11046 leader_election.cc:341] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:17.853552 14100 leader_election.cc:288] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:17.864982 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:17.866218 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:17.867730 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (table default.Table_177834d7b9304f4da015488acfeb6ef9 [id=1e63357b8e1e4c769761f84a22125a85]). Expected version 1 got 0
I20260811 06:17:17.868281 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:17.868898 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
W20260811 06:17:17.870152 11047 leader_election.cc:341] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.872429 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32407c8872464da2b1470a8ae21c86fd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:17.872973 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f8100e334a4fd1b3c9b059e3bdef3e" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:17.834901 14484 rpcz_store.cc:276] 0811 06:17:16.737031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.737089 (+ 58us) service_pool.cc:227] Handling call
0811 06:17:17.834718 (+1097629us) ts_tablet_manager.cc:1145] Deleting tablet 3210614ebacf45c89d63413c51c8f923
0811 06:17:17.834729 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.834808 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097394}
I20260811 06:17:17.873447 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 496) took 1136 ms. Trace:
I20260811 06:17:17.873548 14484 rpcz_store.cc:276] 0811 06:17:16.737135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.741818 (+ 4683us) service_pool.cc:227] Handling call
0811 06:17:17.873301 (+1131483us) ts_tablet_manager.cc:1145] Deleting tablet 5195c4d7b09d45b8873575e1f67a5cb3
0811 06:17:17.873312 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.873415 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131246}
I20260811 06:17:17.873873 11361 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:17.873934 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 497) took 1078 ms. Trace:
I20260811 06:17:17.874025 11361 ts_tablet_manager.cc:1397] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.074s user 0.021s sys 0.022s
W20260811 06:17:17.874301 11047 leader_election.cc:341] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.874409 11047 leader_election.cc:302] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:17.874789 11047 leader_election.cc:341] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:17.874756 14677 raft_consensus.cc:2726] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:17.875149 11361 raft_consensus.cc:348] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.875339 11361 raft_consensus.cc:374] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.875380 11361 raft_consensus.cc:729] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.873996 14484 rpcz_store.cc:276] 0811 06:17:16.795272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.795326 (+ 54us) service_pool.cc:227] Handling call
0811 06:17:17.873826 (+1078500us) ts_tablet_manager.cc:1145] Deleting tablet a0c8b46163af4623b93af79302871941
0811 06:17:17.873836 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.873920 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035986}
I20260811 06:17:17.876156 11361 consensus_queue.cc:260] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.876731 11361 ts_tablet_manager.cc:1428] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:17.875831 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 498) took 1079 ms. Trace:
I20260811 06:17:17.877686 14484 rpcz_store.cc:276] 0811 06:17:16.796466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.796522 (+ 56us) service_pool.cc:227] Handling call
0811 06:17:17.875734 (+1079212us) ts_tablet_manager.cc:1145] Deleting tablet b5bf05ee95b244b88b943cc1d37f8839
0811 06:17:17.875744 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.875817 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037816}
I20260811 06:17:17.880524 11361 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:17.882122 11679 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:17.882510 11361 tablet_bootstrap.cc:654] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:17.869735 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0f4d1035d5b0435a8a3611e5e15c1547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4d1035d5b0435a8a3611e5e15c1547 already in progress: creating tablet
W20260811 06:17:17.884020 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3210614ebacf45c89d63413c51c8f923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3210614ebacf45c89d63413c51c8f923 already in progress: creating tablet
W20260811 06:17:17.884383 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 5195c4d7b09d45b8873575e1f67a5cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5195c4d7b09d45b8873575e1f67a5cb3 already in progress: creating tablet
I20260811 06:17:17.884483 11362 tablet_bootstrap.cc:492] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.884613 11362 ts_tablet_manager.cc:1397] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.089s user 0.000s sys 0.033s
W20260811 06:17:17.884824 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet a0c8b46163af4623b93af79302871941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0c8b46163af4623b93af79302871941 already in progress: creating tablet
W20260811 06:17:17.885205 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet b5bf05ee95b244b88b943cc1d37f8839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bf05ee95b244b88b943cc1d37f8839 already in progress: creating tablet
I20260811 06:17:17.885443 11362 raft_consensus.cc:348] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.885679 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 3dfd6bc48bdd4e008f9e1aba35c3716f
I20260811 06:17:17.885675 11362 raft_consensus.cc:374] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.885797 11362 raft_consensus.cc:729] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.886035 11362 consensus_queue.cc:260] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.886438 11683 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 206) took 1186 ms. Trace:
I20260811 06:17:17.886799 11362 ts_tablet_manager.cc:1428] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:17.887135 11362 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.886673 11683 rpcz_store.cc:276] 0811 06:17:16.700228 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.013920 (+313692us) service_pool.cc:227] Handling call
0811 06:17:17.063717 (+ 49797us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:17.064131 (+ 414us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.064267 (+ 136us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:17.064318 (+ 51us) catalog_manager.cc:2761] Locking tablets
0811 06:17:17.151958 (+ 87640us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:17.221411 (+ 69453us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:17.221517 (+ 106us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:17.885489 (+663972us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:17.886322 (+ 833us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.152910 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.153048 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.153057 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:17.153075 (+ 18us) tablet.cc:660] Decoding operations
0811 06:17:17.153213 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.153231 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.153236 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:17.153367 (+ 131us) tablet.cc:699] Row locks acquired
0811 06:17:17.153370 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:17.153415 (+ 45us) write_op.cc:270] Start()
0811 06:17:17.153454 (+ 39us) write_op.cc:276] Timestamp: P: 1786429037153383 usec, L: 0
0811 06:17:17.153458 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.153689 (+ 231us) log.cc:842] Serialized 728 byte log entry
0811 06:17:17.218708 (+ 65019us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.219207 (+ 499us) write_op.cc:301] APPLY: starting
0811 06:17:17.219227 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.219277 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.219338 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.219416 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.219482 (+ 66us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:17.219488 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:17.219586 (+ 98us) log.cc:842] Serialized 29 byte log entry
0811 06:17:17.219665 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.219687 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:17.219694 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.219757 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.219760 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":113953664,"child_traces":[["op",{"apply.queue_time_us":430,"apply.run_cpu_time_us":616,"apply.run_wall_time_us":616,"num_ops":2,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":918,"prepare.run_wall_time_us":918,"raft.queue_time_us":140,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":65222}]]}
I20260811 06:17:17.894980 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:17.900460 11362 tablet_bootstrap.cc:654] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.901877 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.915448 11362 tablet_bootstrap.cc:492] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:17.915637 11362 ts_tablet_manager.cc:1397] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.003s
I20260811 06:17:17.922231 11672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet bc0ec3b040cd4a54a7919a15f8eb5da7
I20260811 06:17:17.922571 11362 raft_consensus.cc:348] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.922851 11362 raft_consensus.cc:374] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:17.924016 11362 raft_consensus.cc:729] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:17.924285 11362 consensus_queue.cc:260] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:17.928620 10923 raft_consensus.cc:3037] T eede55349694488b9899ec56a80c8d5b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:17.930001 11684 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30cffba93ad74e84812e5879b851119f consensus state has no leader
I20260811 06:17:17.930253 11655 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538] alter complete (version 2)
I20260811 06:17:17.931106 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 4124f64656614c91b7d9115c2efbecd1
I20260811 06:17:17.931638 11670 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 210) took 1071 ms. Trace:
I20260811 06:17:17.932927 11362 ts_tablet_manager.cc:1428] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20260811 06:17:17.932989 11656 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 211) took 1028 ms. Trace:
I20260811 06:17:17.933467 11362 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:17.934350 11653 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 204) took 1230 ms. Trace:
I20260811 06:17:17.935571 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 499) took 1117 ms. Trace:
I20260811 06:17:17.935676 14484 rpcz_store.cc:276] 0811 06:17:16.818090 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.818138 (+ 48us) service_pool.cc:227] Handling call
0811 06:17:17.878029 (+1059891us) ts_tablet_manager.cc:1145] Deleting tablet dcfab8bff5bd4a6cb7ea85dae3a48888
0811 06:17:17.935401 (+ 57372us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:17.935545 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040054}
I20260811 06:17:17.935321 11656 rpcz_store.cc:276] 0811 06:17:16.862249 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.223223 (+360974us) service_pool.cc:227] Handling call
0811 06:17:17.353257 (+130034us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:17.353600 (+ 343us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.353837 (+ 237us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:17.354067 (+ 230us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:17.354147 (+ 80us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:17.466327 (+112180us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:17.890496 (+424169us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.354786 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.354881 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.354887 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:17.354889 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:17.354993 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.355005 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.355010 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:17.355079 (+ 69us) tablet.cc:699] Row locks acquired
0811 06:17:17.355082 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:17.355122 (+ 40us) write_op.cc:270] Start()
0811 06:17:17.355162 (+ 40us) write_op.cc:276] Timestamp: P: 1786429037355070 usec, L: 0
0811 06:17:17.355166 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.355358 (+ 192us) log.cc:842] Serialized 405 byte log entry
0811 06:17:17.465210 (+109852us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.465333 (+ 123us) write_op.cc:301] APPLY: starting
0811 06:17:17.465353 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.465410 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.465437 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.465495 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.465531 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:17.465538 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:17.465627 (+ 89us) log.cc:842] Serialized 23 byte log entry
0811 06:17:17.465732 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.465756 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:17.465764 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.465839 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.465843 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":298148736,"child_traces":[["op",{"apply.queue_time_us":45,"apply.run_cpu_time_us":567,"apply.run_wall_time_us":567,"num_ops":1,"prepare.queue_time_us":153,"prepare.run_cpu_time_us":670,"prepare.run_wall_time_us":1047,"raft.queue_time_us":34,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":110004}]]}
I20260811 06:17:17.935953 14484 tablet_replica.cc:330] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:17.936177 14484 raft_consensus.cc:2229] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.936390 14484 raft_consensus.cc:2258] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.936971 11362 tablet_bootstrap.cc:654] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:17.936988 14484 ts_tablet_manager.cc:1905] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:17.934504 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dfd6bc48bdd4e008f9e1aba35c3716f already in progress: creating tablet
I20260811 06:17:17.938669 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.938972 14842 tablet_replica.cc:330] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:17.938988 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.939211 14842 raft_consensus.cc:2229] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.939453 14842 raft_consensus.cc:2258] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.939528 11672 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 205) took 1229 ms. Trace:
I20260811 06:17:17.940023 14842 ts_tablet_manager.cc:1905] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.940127 11098 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:17.939668 11672 rpcz_store.cc:276] 0811 06:17:16.697121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.955248 (+258127us) service_pool.cc:227] Handling call
0811 06:17:16.960241 (+ 4993us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.960390 (+ 149us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:16.961333 (+ 943us) catalog_manager.cc:2761] Locking tablets
0811 06:17:17.054559 (+ 93226us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:17.146421 (+ 91862us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:17.146519 (+ 98us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:17.890793 (+744274us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:17.926263 (+ 35470us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.058379 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.058541 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.058548 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:17.058551 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:17.058693 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.058708 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.058713 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:17.058852 (+ 139us) tablet.cc:699] Row locks acquired
0811 06:17:17.058854 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:17.058898 (+ 44us) write_op.cc:270] Start()
0811 06:17:17.058942 (+ 44us) write_op.cc:276] Timestamp: P: 1786429037058875 usec, L: 0
0811 06:17:17.058947 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.064016 (+ 5069us) log.cc:842] Serialized 793 byte log entry
0811 06:17:17.064210 (+ 194us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:17.144568 (+ 80358us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.144673 (+ 105us) write_op.cc:301] APPLY: starting
0811 06:17:17.144694 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.144746 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.144749 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.144893 (+ 144us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.144931 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:17.144937 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:17.145031 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:17.145126 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.145149 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:17.145157 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.145222 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.145225 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":40,"apply.run_cpu_time_us":613,"apply.run_wall_time_us":613,"num_ops":2,"prepare.queue_time_us":2958,"prepare.run_cpu_time_us":1193,"prepare.run_wall_time_us":5917,"raft.queue_time_us":599,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":85590,"spinlock_wait_cycles":11059072}]]}
I20260811 06:17:17.940706 11672 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4a2b60315e3c40e4bb277aab3d4e95a2" } new_table_name: "default.Table_31fd6432a5b74edd81e60d2fad7e5e00" modify_external_catalogs: true
W20260811 06:17:17.939563 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 94) took 1423 ms (client timeout 1000 ms). Trace:
I20260811 06:17:17.944305 11684 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 207) took 1197 ms. Trace:
I20260811 06:17:17.945070 11676 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 9f44d4df9df7407890790c80fc71f8cb
I20260811 06:17:17.945559 11676 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 208) took 1141 ms. Trace:
I20260811 06:17:17.945674 11676 rpcz_store.cc:276] 0811 06:17:16.804291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.048985 (+244694us) service_pool.cc:227] Handling call
0811 06:17:17.060640 (+ 11655us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:17.061206 (+ 566us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.061359 (+ 153us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:17.061474 (+ 115us) catalog_manager.cc:2761] Locking tablets
0811 06:17:17.162410 (+100936us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:17.221770 (+ 59360us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:17.221827 (+ 57us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:17.890900 (+669073us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:17.945520 (+ 54620us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.163154 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.163259 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.163265 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:17.163267 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:17.163385 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.163397 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.163401 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:17.163514 (+ 113us) tablet.cc:699] Row locks acquired
0811 06:17:17.163516 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:17.163558 (+ 42us) write_op.cc:270] Start()
0811 06:17:17.163594 (+ 36us) write_op.cc:276] Timestamp: P: 1786429037163526 usec, L: 0
0811 06:17:17.163598 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.163767 (+ 169us) log.cc:842] Serialized 759 byte log entry
0811 06:17:17.218859 (+ 55092us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.220908 (+ 2049us) write_op.cc:301] APPLY: starting
0811 06:17:17.220920 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.220952 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.220973 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.221024 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.221050 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:17.221056 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:17.221107 (+ 51us) log.cc:842] Serialized 29 byte log entry
0811 06:17:17.221194 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.221210 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:17.221216 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.221267 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.221270 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":26058496,"child_traces":[["op",{"apply.queue_time_us":1970,"apply.run_cpu_time_us":409,"apply.run_wall_time_us":410,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":714,"prepare.run_wall_time_us":771,"raft.queue_time_us":38,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":55247,"thread_start_us":132502,"threads_started":1}]]}
I20260811 06:17:17.946695 11676 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_7c8021776ed44b54afcf67dde1816fcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:17.947654 11676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c8021776ed44b54afcf67dde1816fcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:17.948575 14842 ts_tablet_manager.cc:1918] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:17.948704 14842 log.cc:1196] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/4124f64656614c91b7d9115c2efbecd1
I20260811 06:17:17.949126 14842 ts_tablet_manager.cc:1939] T 4124f64656614c91b7d9115c2efbecd1 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:17.949260 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dfd6bc48bdd4e008f9e1aba35c3716f already in progress: creating tablet
I20260811 06:17:17.950196 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:17.950299 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f44d4df9df7407890790c80fc71f8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:17.950484 14839 tablet_replica.cc:330] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:17.950690 14839 raft_consensus.cc:2229] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.950873 14839 raft_consensus.cc:2258] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.951499 14839 ts_tablet_manager.cc:1905] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.950847 11653 rpcz_store.cc:276] 0811 06:17:16.690346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.863649 (+173303us) service_pool.cc:227] Handling call
0811 06:17:16.865199 (+ 1550us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:16.868156 (+ 2957us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:16.868361 (+ 205us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:16.868457 (+ 96us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:17.060067 (+191610us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:17.920352 (+860285us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.869035 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.869134 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.869141 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:16.869143 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.869254 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.869266 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.869272 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:16.869343 (+ 71us) tablet.cc:699] Row locks acquired
0811 06:17:16.869345 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.869384 (+ 39us) write_op.cc:270] Start()
0811 06:17:16.869441 (+ 57us) write_op.cc:276] Timestamp: P: 1786429036869332 usec, L: 0
0811 06:17:16.869446 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.869658 (+ 212us) log.cc:842] Serialized 405 byte log entry
0811 06:17:17.054230 (+184572us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.054298 (+ 68us) write_op.cc:301] APPLY: starting
0811 06:17:17.054307 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.054338 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.059407 (+ 5069us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.059469 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.059506 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:17.059514 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:17.059613 (+ 99us) log.cc:842] Serialized 23 byte log entry
0811 06:17:17.059949 (+ 336us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.059968 (+ 19us) write_op.cc:454] Released schema lock
0811 06:17:17.059975 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.060159 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.060163 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":31,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":5914,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":766,"prepare.run_wall_time_us":792,"raft.queue_time_us":59,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":184745}]]}
I20260811 06:17:17.952317 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_d08ef9d8d7a4456f84eb7f8a0d3f7b05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:17.953087 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d08ef9d8d7a4456f84eb7f8a0d3f7b05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:17.954212 14842 tablet_replica.cc:330] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:17.954483 14842 raft_consensus.cc:2229] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.955241 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:17.958348 14842 raft_consensus.cc:2258] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.959098 14842 ts_tablet_manager.cc:1905] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.961548 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f44d4df9df7407890790c80fc71f8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:17.961745 14839 ts_tablet_manager.cc:1918] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:17.961889 14839 log.cc:1196] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/4124f64656614c91b7d9115c2efbecd1
I20260811 06:17:17.962261 14839 ts_tablet_manager.cc:1939] T 4124f64656614c91b7d9115c2efbecd1 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:17.963433 14839 tablet_replica.cc:330] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:17.963706 14839 raft_consensus.cc:2229] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:17.963958 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]) successfully deleted
I20260811 06:17:17.964005 14839 raft_consensus.cc:2258] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:17.964560 14839 ts_tablet_manager.cc:1905] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:17.944439 11684 rpcz_store.cc:276] 0811 06:17:16.733014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.014312 (+281298us) service_pool.cc:227] Handling call
0811 06:17:17.062281 (+ 47969us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:17.062580 (+ 299us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.062778 (+ 198us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:17.062995 (+ 217us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:17.063057 (+ 62us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:17.146808 (+ 83751us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:17.930187 (+783379us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.064317 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.064417 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.064422 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:17.064436 (+ 14us) tablet.cc:660] Decoding operations
0811 06:17:17.064536 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.064547 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.064551 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:17.064615 (+ 64us) tablet.cc:699] Row locks acquired
0811 06:17:17.064617 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:17.064655 (+ 38us) write_op.cc:270] Start()
0811 06:17:17.064688 (+ 33us) write_op.cc:276] Timestamp: P: 1786429037064633 usec, L: 0
0811 06:17:17.064691 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.065123 (+ 432us) log.cc:842] Serialized 405 byte log entry
0811 06:17:17.144655 (+ 79532us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.144839 (+ 184us) write_op.cc:301] APPLY: starting
0811 06:17:17.144851 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.144877 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.144903 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.144930 (+ 27us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.144949 (+ 19us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:17.144954 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:17.145030 (+ 76us) log.cc:842] Serialized 23 byte log entry
0811 06:17:17.146637 (+ 1607us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.146653 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:17.146659 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.146705 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.146709 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":109831040,"child_traces":[["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":1923,"mutex_wait_us":1532,"num_ops":1,"prepare.queue_time_us":816,"prepare.run_cpu_time_us":751,"prepare.run_wall_time_us":906,"raft.queue_time_us":63,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":79948,"spinlock_wait_cycles":489344}]]}
I20260811 06:17:17.968598 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]) successfully deleted
I20260811 06:17:17.932559 11670 rpcz_store.cc:276] 0811 06:17:16.860580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.051777 (+191197us) service_pool.cc:227] Handling call
0811 06:17:17.061867 (+ 10090us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:17.065211 (+ 3344us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.065350 (+ 139us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:17.065404 (+ 54us) catalog_manager.cc:2761] Locking tablets
0811 06:17:17.155176 (+ 89772us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:17.221562 (+ 66386us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:17.221631 (+ 69us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:17.889882 (+668251us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:17.931562 (+ 41680us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.156201 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.156339 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.156347 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:17.156350 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:17.156525 (+ 175us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.156539 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.156545 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:17.156671 (+ 126us) tablet.cc:699] Row locks acquired
0811 06:17:17.156674 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:17.156714 (+ 40us) write_op.cc:270] Start()
0811 06:17:17.156754 (+ 40us) write_op.cc:276] Timestamp: P: 1786429037156682 usec, L: 0
0811 06:17:17.156759 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.156954 (+ 195us) log.cc:842] Serialized 793 byte log entry
0811 06:17:17.218777 (+ 61823us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.219851 (+ 1074us) write_op.cc:301] APPLY: starting
0811 06:17:17.219863 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.219896 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.219917 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.219975 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.220003 (+ 28us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:17.220008 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:17.220074 (+ 66us) log.cc:842] Serialized 29 byte log entry
0811 06:17:17.220124 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.220140 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:17.220146 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.220201 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.220204 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":22549248,"child_traces":[["op",{"apply.queue_time_us":1045,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":859,"prepare.run_wall_time_us":860,"raft.queue_time_us":67,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":62004}]]}
W20260811 06:17:17.973013 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 9f44d4df9df7407890790c80fc71f8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f44d4df9df7407890790c80fc71f8cb already in progress: creating tablet
I20260811 06:17:17.977111 14842 ts_tablet_manager.cc:1918] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:17.977227 14842 log.cc:1196] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/bc0ec3b040cd4a54a7919a15f8eb5da7
I20260811 06:17:17.977542 14842 ts_tablet_manager.cc:1939] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:17.978168 11670 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_fa6e7eb493bf4dbb86702a219a388acb" } new_table_name: "default.Table_08562ae83b774258bf17856350ad14af" modify_external_catalogs: true
I20260811 06:17:17.979804 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_3fe9be20185245808f90c1d489877dd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:17.980113 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:17.980448 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fe9be20185245808f90c1d489877dd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:17.980775 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:17.981400 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f44d4df9df7407890790c80fc71f8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:17.964701 11663 rpcz_store.cc:269] 0811 06:17:16.503963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.519130 (+ 15167us) service_pool.cc:227] Handling call
0811 06:17:17.927476 (+1408346us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:16.824468 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:16.824550 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:16.824555 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:16.824557 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:16.824749 (+ 192us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:16.824758 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:16.824763 (+ 5us) tablet.cc:683] Acquiring locks for 6 operations
0811 06:17:16.824893 (+ 130us) tablet.cc:699] Row locks acquired
0811 06:17:16.824895 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:16.824926 (+ 31us) write_op.cc:270] Start()
0811 06:17:16.824953 (+ 27us) write_op.cc:276] Timestamp: P: 1786429036824882 usec, L: 0
0811 06:17:16.824957 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:16.825120 (+ 163us) log.cc:842] Serialized 2416 byte log entry
0811 06:17:17.053256 (+228136us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.053336 (+ 80us) write_op.cc:301] APPLY: starting
0811 06:17:17.053348 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.053415 (+ 67us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.053445 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.053564 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.053600 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0811 06:17:17.053607 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:17.053732 (+ 125us) log.cc:842] Serialized 53 byte log entry
0811 06:17:17.054012 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.054036 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:17.054043 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.054094 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.054097 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52923,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":600,"apply.run_wall_time_us":805,"num_ops":6,"prepare.queue_time_us":35,"prepare.run_cpu_time_us":741,"prepare.run_wall_time_us":872,"raft.queue_time_us":36,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":21,"replication_time_us":228274}]]}
W20260811 06:17:17.985527 11047 consensus_peers.cc:487] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:17.986537 11047 consensus_peers.cc:487] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:17.986696 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 2d6280a32b6c49f5886fa1ff8745b740 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:17.989552 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfab8bff5bd4a6cb7ea85dae3a48888 already in progress: creating tablet
I20260811 06:17:18.009090 14484 ts_tablet_manager.cc:1918] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 06:17:18.050033 11365 tablet_bootstrap.cc:492] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:18.051942 11365 ts_tablet_manager.cc:1397] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.373s user 0.025s sys 0.005s
I20260811 06:17:18.058125 11365 raft_consensus.cc:348] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.063783 11365 raft_consensus.cc:374] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.063942 11365 raft_consensus.cc:729] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.064209 11365 consensus_queue.cc:260] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.064917 11365 ts_tablet_manager.cc:1428] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:18.069916 14839 ts_tablet_manager.cc:1918] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.070740 14870 tablet.cc:1722] T 54249325b2fa462bbc476ea609ec5389 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.016474 14677 raft_consensus.cc:482] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.071009 14677 raft_consensus.cc:504] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.071771 14677 leader_election.cc:288] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.037150 14352 raft_consensus.cc:482] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.071970 14352 raft_consensus.cc:504] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.072448 14352 leader_election.cc:288] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.073887 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.074165 10659 raft_consensus.cc:2454] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.074594 11046 leader_election.cc:302] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.074859 14352 raft_consensus.cc:2781] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.074932 14352 raft_consensus.cc:482] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.074990 14352 raft_consensus.cc:3037] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.077514 14889 tablet.cc:1722] T c03f18c65ada4b0b86534d29cd363d9a P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.077960 14677 raft_consensus.cc:482] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.078085 14677 raft_consensus.cc:504] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.078687 14677 leader_election.cc:288] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.079324 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.079638 10645 raft_consensus.cc:2454] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.079769 14352 raft_consensus.cc:504] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.080348 14352 leader_election.cc:288] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:18.080905 11046 leader_election.cc:341] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc
I20260811 06:17:18.081488 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:18.081805 10654 raft_consensus.cc:3037] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.081918 11046 leader_election.cc:302] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.082234 14352 raft_consensus.cc:2781] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.082345 14352 raft_consensus.cc:482] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.082440 14352 raft_consensus.cc:3037] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.085162 14352 raft_consensus.cc:504] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.086265 14352 leader_election.cc:288] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.086580 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:18.086827 10645 raft_consensus.cc:3037] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.087284 14880 tablet.cc:1722] T c03f18c65ada4b0b86534d29cd363d9a P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.089625 10645 raft_consensus.cc:2454] T e7a707e7a6394e7a916001c0278a97bd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.090176 11046 leader_election.cc:302] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.090798 14677 raft_consensus.cc:2781] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.090914 14677 raft_consensus.cc:686] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.091125 14677 consensus_queue.cc:237] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.092952 14884 raft_consensus.cc:482] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.093079 14884 raft_consensus.cc:504] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.094599 14884 leader_election.cc:288] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:18.095216 11046 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 45fc206d95a244e395d19328ae289485
I20260811 06:17:18.063136 14872 tablet.cc:1722] T 54249325b2fa462bbc476ea609ec5389 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.098856 10654 raft_consensus.cc:2454] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.070273 14868 tablet.cc:1722] T c03f18c65ada4b0b86534d29cd363d9a P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.099682 11046 leader_election.cc:302] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.100217 14100 raft_consensus.cc:2781] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.100379 14100 raft_consensus.cc:686] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.100594 11361 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:17:18.100505 11588 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.124:45045, user_credentials={real_user=slave}} blocked reactor thread for 59264.5us
I20260811 06:17:18.100724 11361 ts_tablet_manager.cc:1397] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.220s user 0.032s sys 0.054s
I20260811 06:17:18.100844 14100 consensus_queue.cc:237] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.101265 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]) successfully deleted
I20260811 06:17:18.101548 11361 raft_consensus.cc:348] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.101763 11361 raft_consensus.cc:374] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.101821 11361 raft_consensus.cc:729] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.101999 11361 consensus_queue.cc:260] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:18.102180 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9f44d4df9df7407890790c80fc71f8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f44d4df9df7407890790c80fc71f8cb already in progress: creating tablet
I20260811 06:17:18.101961 11362 tablet_bootstrap.cc:492] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.103766 11362 ts_tablet_manager.cc:1397] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.170s user 0.014s sys 0.049s
I20260811 06:17:18.103886 11361 ts_tablet_manager.cc:1428] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:18.104568 11362 raft_consensus.cc:348] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.104768 11362 raft_consensus.cc:374] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.104832 11362 raft_consensus.cc:729] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.105028 11362 consensus_queue.cc:260] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.105576 11362 ts_tablet_manager.cc:1428] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:18.105875 11362 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.099998 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.104168 11361 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.107427 11362 tablet_bootstrap.cc:654] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.108186 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.108593 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.109355 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45fc206d95a244e395d19328ae289485" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.110057 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcc463affbb4154877624aec28435bc" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.110906 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.070829 14839 log.cc:1196] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/bc0ec3b040cd4a54a7919a15f8eb5da7
I20260811 06:17:18.117241 14839 ts_tablet_manager.cc:1939] T bc0ec3b040cd4a54a7919a15f8eb5da7 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:18.118255 11047 leader_election.cc:341] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.098673 14882 consensus_queue.cc:1035] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:18.118798 11047 leader_election.cc:341] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:18.119148 11047 leader_election.cc:341] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:18.119468 11047 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.119601 11047 leader_election.cc:302] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:18.121822 11365 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:18.126048 14893 tablet.cc:1722] T 54249325b2fa462bbc476ea609ec5389 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.132656 11365 tablet_bootstrap.cc:654] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:18.135689 11007 tablet.cc:2369] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:17:18.151188 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]) successfully deleted
I20260811 06:17:18.120750 14484 log.cc:1196] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/d6063a34ee55495584ed5623215a130f
I20260811 06:17:18.123085 11361 tablet_bootstrap.cc:654] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:18.152277 11047 leader_election.cc:341] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.152415 11047 leader_election.cc:302] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:18.152702 14343 raft_consensus.cc:2726] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:18.152755 11047 leader_election.cc:341] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.152969 14343 raft_consensus.cc:2726] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.153446 11362 tablet_bootstrap.cc:492] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.153656 11362 ts_tablet_manager.cc:1397] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.048s user 0.014s sys 0.013s
I20260811 06:17:18.153759 14343 raft_consensus.cc:482] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.153937 14343 raft_consensus.cc:504] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.154301 14677 raft_consensus.cc:482] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.154683 14343 leader_election.cc:288] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.154912 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.155128 10654 raft_consensus.cc:2454] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.128634 14884 raft_consensus.cc:482] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.155614 11046 leader_election.cc:302] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.155563 14884 raft_consensus.cc:504] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.155915 14343 raft_consensus.cc:2781] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.156028 14343 raft_consensus.cc:482] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.156136 14343 raft_consensus.cc:3037] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:18.156675 11046 leader_election.cc:341] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:18.157166 14484 ts_tablet_manager.cc:1939] T d6063a34ee55495584ed5623215a130f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:18.158496 14484 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41374 (request call id 503) took 1106 ms. Trace:
I20260811 06:17:18.159794 14484 rpcz_store.cc:276] 0811 06:17:17.052198 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.052249 (+ 51us) service_pool.cc:227] Handling call
0811 06:17:17.935905 (+883656us) ts_tablet_manager.cc:1145] Deleting tablet d6063a34ee55495584ed5623215a130f
0811 06:17:17.935916 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0811 06:17:18.005887 (+ 69971us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:18.008987 (+ 3100us) tablet_metadata.cc:641] Metadata flushed
0811 06:17:18.158459 (+149472us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":883422}
I20260811 06:17:18.160146 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.160112 11362 raft_consensus.cc:348] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.160593 11362 raft_consensus.cc:374] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.160709 11362 raft_consensus.cc:729] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.160888 14484 tablet_replica.cc:330] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:18.161134 14484 raft_consensus.cc:2229] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:18.161103 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d9627d9f88466ba499aa175151f46a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.161399 10923 raft_consensus.cc:2454] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.161468 14484 raft_consensus.cc:2258] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:18.161878 11362 consensus_queue.cc:260] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.162122 14484 ts_tablet_manager.cc:1905] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:18.163654 11362 ts_tablet_manager.cc:1428] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260811 06:17:18.164786 11362 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.159094 14343 raft_consensus.cc:504] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.166184 14882 consensus_queue.cc:1035] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.154484 14677 raft_consensus.cc:504] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.166728 14343 leader_election.cc:288] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.167289 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:18.167495 10659 raft_consensus.cc:3037] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.167508 14677 leader_election.cc:288] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.158818 14884 leader_election.cc:288] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.170758 11362 tablet_bootstrap.cc:654] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.171541 10659 raft_consensus.cc:2454] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.172016 11046 leader_election.cc:302] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.172348 14100 raft_consensus.cc:2781] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.172523 14100 raft_consensus.cc:686] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.172931 14100 consensus_queue.cc:237] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.173094 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.173312 10655 raft_consensus.cc:2454] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.173743 11046 leader_election.cc:302] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.174577 14884 raft_consensus.cc:2781] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.174679 14884 raft_consensus.cc:482] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.174758 14884 raft_consensus.cc:3037] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.179561 14884 raft_consensus.cc:504] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.180799 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:18.181032 10655 raft_consensus.cc:3037] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.182199 14884 leader_election.cc:288] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.183794 10655 raft_consensus.cc:2454] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.184180 11046 leader_election.cc:302] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.184435 14884 raft_consensus.cc:2781] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.184669 14884 raft_consensus.cc:686] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.184886 14884 consensus_queue.cc:237] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.187822 11676 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 213) took 1292 ms. Trace:
I20260811 06:17:18.188180 11676 rpcz_store.cc:276] 0811 06:17:16.895058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.946432 (+1051374us) service_pool.cc:227] Handling call
0811 06:17:17.947807 (+ 1375us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:17.948346 (+ 539us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.187468 (+239122us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.187604 (+ 136us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.187717 (+ 113us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.094826 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.094994 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.095001 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.095003 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.095126 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.095141 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.095146 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.095240 (+ 94us) tablet.cc:699] Row locks acquired
0811 06:17:18.095243 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.095288 (+ 45us) write_op.cc:270] Start()
0811 06:17:18.095342 (+ 54us) write_op.cc:276] Timestamp: P: 1786429038095264 usec, L: 0
0811 06:17:18.095346 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.175398 (+ 80052us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.176028 (+ 630us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:18.179242 (+ 3214us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.185958 (+ 6716us) write_op.cc:301] APPLY: starting
0811 06:17:18.185983 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.186040 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.186042 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.186177 (+ 135us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.186217 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.186224 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.186313 (+ 89us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.187221 (+ 908us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.187242 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:18.187250 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":6554,"num_ops":2,"prepare.queue_time_us":145999,"prepare.run_cpu_time_us":1633,"prepare.run_wall_time_us":88906,"raft.queue_time_us":112,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":234,"replication_time_us":83869,"spinlock_wait_cycles":183556992}]]}
W20260811 06:17:18.192219 14515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 06:17:18.193924 11047 consensus_peers.cc:487] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4124f64656614c91b7d9115c2efbecd1. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:18.194798 11047 leader_election.cc:341] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.195717 11047 leader_election.cc:302] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:18.197609 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet d6063a34ee55495584ed5623215a130f (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]) successfully deleted
I20260811 06:17:18.198084 14884 raft_consensus.cc:2781] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.198176 14884 raft_consensus.cc:482] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 06:17:18.198144 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 446112faf4374fa29fea8bb40666856e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 446112faf4374fa29fea8bb40666856e already in progress: creating tablet
I20260811 06:17:18.198239 14884 raft_consensus.cc:3037] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:18.198521 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dfd6bc48bdd4e008f9e1aba35c3716f already in progress: creating tablet
I20260811 06:17:18.198936 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.199343 14408 raft_consensus.cc:482] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.199513 14408 raft_consensus.cc:504] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.200302 14408 leader_election.cc:288] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.201084 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:18.201669 10564 leader_election.cc:341] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.202394 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:18.203131 10555 leader_election.cc:341] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.203245 10555 leader_election.cc:302] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:18.204052 14408 raft_consensus.cc:2726] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.207872 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.214521 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.228366 10923 raft_consensus.cc:3037] T a8513fc279dc44f48c45e9dda40e5398 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.236501 11365 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:18.236670 11365 ts_tablet_manager.cc:1397] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.003s
I20260811 06:17:18.237320 11365 raft_consensus.cc:348] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.237561 11365 raft_consensus.cc:374] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.237614 11365 raft_consensus.cc:729] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.240072 14408 raft_consensus.cc:482] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.240226 14408 raft_consensus.cc:504] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.240902 14408 leader_election.cc:288] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.242929 11653 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 214) took 1333 ms. Trace:
I20260811 06:17:18.243170 11653 rpcz_store.cc:276] 0811 06:17:16.909601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.951951 (+1042350us) service_pool.cc:227] Handling call
0811 06:17:17.953183 (+ 1232us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:17.962587 (+ 9404us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.242630 (+280043us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.242756 (+ 126us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.242860 (+ 104us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.210882 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.211026 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.211033 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.211035 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.211143 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.211156 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.211160 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.211256 (+ 96us) tablet.cc:699] Row locks acquired
0811 06:17:18.211258 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:18.211300 (+ 42us) write_op.cc:270] Start()
0811 06:17:18.211341 (+ 41us) write_op.cc:276] Timestamp: P: 1786429038211268 usec, L: 0
0811 06:17:18.211345 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.213440 (+ 2095us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.218745 (+ 5305us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.230403 (+ 11658us) write_op.cc:301] APPLY: starting
0811 06:17:18.230438 (+ 35us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.230489 (+ 51us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.230547 (+ 58us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.230689 (+ 142us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.230731 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.230737 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.230825 (+ 88us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.234880 (+ 4055us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.234904 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:18.234912 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":11567,"num_ops":2,"prepare.queue_time_us":247808,"prepare.run_cpu_time_us":976,"prepare.run_wall_time_us":21073,"raft.queue_time_us":329,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":2848,"replication_time_us":7374}]]}
I20260811 06:17:18.246912 14455 raft_consensus.cc:482] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.247056 14455 raft_consensus.cc:504] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.247727 14455 leader_election.cc:288] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.250200 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_e62617e4966e4dfb8e603f9884650338"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:18.250921 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e62617e4966e4dfb8e603f9884650338 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.252153 11365 consensus_queue.cc:260] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.211756 11361 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.253625 11361 ts_tablet_manager.cc:1397] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.150s user 0.005s sys 0.007s
I20260811 06:17:18.241775 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:18.252074 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:18.254462 11361 raft_consensus.cc:348] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.254683 11361 raft_consensus.cc:374] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.254738 11361 raft_consensus.cc:729] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.254925 11361 consensus_queue.cc:260] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.255445 11361 ts_tablet_manager.cc:1428] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260811 06:17:18.255692 10564 leader_election.cc:341] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.256112 11361 tablet_bootstrap.cc:492] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.258900 11361 tablet_bootstrap.cc:654] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.262655 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 215) took 1343 ms. Trace:
I20260811 06:17:18.262918 11684 rpcz_store.cc:276] 0811 06:17:16.919133 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.967939 (+1048806us) service_pool.cc:227] Handling call
0811 06:17:17.980552 (+ 12613us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:17.981111 (+ 559us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.262198 (+281087us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.262329 (+ 131us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.262439 (+ 110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.231990 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.232119 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.232125 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:18.232128 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.232234 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.232246 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.232251 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.232337 (+ 86us) tablet.cc:699] Row locks acquired
0811 06:17:18.232340 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.232378 (+ 38us) write_op.cc:270] Start()
0811 06:17:18.232416 (+ 38us) write_op.cc:276] Timestamp: P: 1786429038232343 usec, L: 0
0811 06:17:18.232421 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.232633 (+ 212us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.257196 (+ 24563us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.260672 (+ 3476us) write_op.cc:301] APPLY: starting
0811 06:17:18.260692 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.260740 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.260767 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.261213 (+ 446us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.261247 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.261254 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.261339 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.261775 (+ 436us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.261799 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:18.261807 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.262534 (+ 727us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.262542 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3404,"apply.run_cpu_time_us":686,"apply.run_wall_time_us":1942,"num_ops":2,"prepare.queue_time_us":250355,"prepare.run_cpu_time_us":823,"prepare.run_wall_time_us":20662,"raft.queue_time_us":1709,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":1135,"replication_time_us":24751}]]}
W20260811 06:17:18.252193 11047 leader_election.cc:341] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.214893 14484 ts_tablet_manager.cc:1918] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.264461 14484 log.cc:1196] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/bc0ec3b040cd4a54a7919a15f8eb5da7
W20260811 06:17:18.264513 11047 leader_election.cc:341] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.264837 14484 ts_tablet_manager.cc:1939] T bc0ec3b040cd4a54a7919a15f8eb5da7 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:18.265105 11361 tablet_bootstrap.cc:492] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.201696 14884 raft_consensus.cc:504] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.265224 11361 ts_tablet_manager.cc:1397] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.004s
W20260811 06:17:18.266506 11046 leader_election.cc:341] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:18.267498 14484 tablet_replica.cc:330] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:18.267740 14484 raft_consensus.cc:2229] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:18.268040 14484 raft_consensus.cc:2258] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:18.268620 14484 ts_tablet_manager.cc:1905] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:18.268893 11365 ts_tablet_manager.cc:1428] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.032s user 0.000s sys 0.002s
I20260811 06:17:18.271677 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_2a087e426bd44e0985b5a33be4080232"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:18.272464 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a087e426bd44e0985b5a33be4080232 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.276396 14484 ts_tablet_manager.cc:1918] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.276523 14484 log.cc:1196] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/4124f64656614c91b7d9115c2efbecd1
I20260811 06:17:18.276854 14484 ts_tablet_manager.cc:1939] T 4124f64656614c91b7d9115c2efbecd1 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:18.277231 11365 tablet_bootstrap.cc:492] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:18.278115 11361 raft_consensus.cc:348] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.278347 11361 raft_consensus.cc:374] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.278398 11361 raft_consensus.cc:729] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.278579 11361 consensus_queue.cc:260] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:18.276363 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 73232.2us
I20260811 06:17:18.279174 11361 ts_tablet_manager.cc:1428] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
W20260811 06:17:18.278909 10749 tablet.cc:2369] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 06:17:18.280295 11047 leader_election.cc:341] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.283243 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:18.285910 11239 tablet.cc:2369] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 06:17:18.289306 11361 tablet_bootstrap.cc:492] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.290975 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:18.291381 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:18.291801 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 54249325b2fa462bbc476ea609ec5389 (table default.Table_d868a0d8395f43fba4fd9381aaf5e93e [id=dcd0a85bedc24ef4b83da3f0786e87ff]). Expected version 1 got 0
I20260811 06:17:18.292302 11361 tablet_bootstrap.cc:654] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.292608 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet c03f18c65ada4b0b86534d29cd363d9a (table default.Table_6c84470c4e8e4e0fa09d719f9cbc7f20 [id=3c39ffa2022447068fcc6f6f551a38a6]). Expected version 1 got 0
I20260811 06:17:18.294071 14884 leader_election.cc:288] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:18.295459 14515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260811 06:17:18.295531 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet bc0ec3b040cd4a54a7919a15f8eb5da7 (table default.Table_1a6aa5fa9fc24805a8ec222ef4b3ba31 [id=9d3929f0ec5f42f5ad0826765a4c6a6d]) successfully deleted
I20260811 06:17:18.295782 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 4124f64656614c91b7d9115c2efbecd1 (table default.Table_8121b021912d44ca88b933509ff2698b [id=0fb1742233f640a8a51ca49d6be5191c]) successfully deleted
I20260811 06:17:18.295910 10916 raft_consensus.cc:3037] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:18.296134 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 9f44d4df9df7407890790c80fc71f8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f44d4df9df7407890790c80fc71f8cb already in progress: creating tablet
W20260811 06:17:18.296187 14515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 06:17:18.296995 10620 tablet_service.cc:1467] Processing CreateTablet for tablet f8f589f09a0a4146ae410aea66d35c42 (DEFAULT_TABLE table=default.Table_5b2224fe7b7748ab881cef80a4f0a01e [id=c875484f8e7349acaf5d1990cc44632a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.297407 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f589f09a0a4146ae410aea66d35c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.298970 14455 consensus_queue.cc:1035] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.299722 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2d9627d9f88466ba499aa175151f46a" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.299926 10913 raft_consensus.cc:3037] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.305097 14100 consensus_queue.cc:1035] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.305501 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 94d0937f8e2c4409a15db1b6582033e7 (DEFAULT_TABLE table=default.Table_618cd19f8b01475da6b296a3c7074d66 [id=b2ed3de03e9e45d48065a4ab7b7010bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.305995 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d0937f8e2c4409a15db1b6582033e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.306777 11098 tablet_service.cc:1467] Processing CreateTablet for tablet f8f589f09a0a4146ae410aea66d35c42 (DEFAULT_TABLE table=default.Table_5b2224fe7b7748ab881cef80a4f0a01e [id=c875484f8e7349acaf5d1990cc44632a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.307185 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f589f09a0a4146ae410aea66d35c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.308220 10913 raft_consensus.cc:2454] T c2d9627d9f88466ba499aa175151f46a P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.310021 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 94d0937f8e2c4409a15db1b6582033e7 (DEFAULT_TABLE table=default.Table_618cd19f8b01475da6b296a3c7074d66 [id=b2ed3de03e9e45d48065a4ab7b7010bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.310421 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d0937f8e2c4409a15db1b6582033e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.311550 11047 leader_election.cc:302] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:18.311813 10872 tablet_service.cc:1467] Processing CreateTablet for tablet f8f589f09a0a4146ae410aea66d35c42 (DEFAULT_TABLE table=default.Table_5b2224fe7b7748ab881cef80a4f0a01e [id=c875484f8e7349acaf5d1990cc44632a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.312402 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f589f09a0a4146ae410aea66d35c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.312533 14100 raft_consensus.cc:2781] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.312650 14100 raft_consensus.cc:686] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.312865 14100 consensus_queue.cc:237] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.323367 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 94d0937f8e2c4409a15db1b6582033e7 (DEFAULT_TABLE table=default.Table_618cd19f8b01475da6b296a3c7074d66 [id=b2ed3de03e9e45d48065a4ab7b7010bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.323917 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d0937f8e2c4409a15db1b6582033e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.293371 11683 catalog_manager.cc:5495] T b7409453e6e34172870dbb9fb3c5ac44 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:18.334165 10913 raft_consensus.cc:3037] T a33fc402d3084b458929d76b8fc22adb P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.334394 11683 catalog_manager.cc:5495] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:18.346076 11361 tablet_bootstrap.cc:492] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.346239 11361 ts_tablet_manager.cc:1397] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.057s user 0.016s sys 0.011s
I20260811 06:17:18.346982 11361 raft_consensus.cc:348] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.347190 11361 raft_consensus.cc:374] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.347214 14343 consensus_queue.cc:1035] T 6dd4a21086934bd9a64d74075ab41fbe P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.348171 11362 tablet_bootstrap.cc:492] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.348325 11362 ts_tablet_manager.cc:1397] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.184s user 0.020s sys 0.038s
I20260811 06:17:18.348974 11362 raft_consensus.cc:348] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.349181 11362 raft_consensus.cc:374] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.349248 11362 raft_consensus.cc:729] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.349437 11362 consensus_queue.cc:260] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.347244 11361 raft_consensus.cc:729] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.350201 11361 consensus_queue.cc:260] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.350248 10868 tablet_service.cc:1467] Processing CreateTablet for tablet adaecbeaf12041da8e441f85f13a9da0 (DEFAULT_TABLE table=default.Table_91e089da3589454b961bdf81e917e846 [id=925af5a7fb6d4803a5f79061639e7981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.350692 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adaecbeaf12041da8e441f85f13a9da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.350819 11361 ts_tablet_manager.cc:1428] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:18.351172 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:18.353389 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:18.353886 11683 catalog_manager.cc:5495] T cce9f8fd074348ffb60abcc086ac0519 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:18.355041 11683 catalog_manager.cc:5495] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:18.355643 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:18.356107 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:18.356798 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:18.359266 11362 ts_tablet_manager.cc:1428] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260811 06:17:18.359562 11362 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.361114 11362 tablet_bootstrap.cc:654] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.362177 11094 tablet_service.cc:1467] Processing CreateTablet for tablet adaecbeaf12041da8e441f85f13a9da0 (DEFAULT_TABLE table=default.Table_91e089da3589454b961bdf81e917e846 [id=925af5a7fb6d4803a5f79061639e7981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.362614 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adaecbeaf12041da8e441f85f13a9da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.362715 11361 tablet_bootstrap.cc:492] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.364060 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4e13ab26f4bee9f277a9a305c58a9 (DEFAULT_TABLE table=default.Table_cde36e31078247c79cb9f20de6401754 [id=75d9d9a6bd924a459de6e2f1ac0d35f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.364482 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 965fc4d8af3c4a5eb20ce387885ddf26 (DEFAULT_TABLE table=default.Table_6471535da4514085be860663c7c99e53 [id=44bfc568caa44cdfb37a49f428a746bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.364827 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4e13ab26f4bee9f277a9a305c58a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.365687 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965fc4d8af3c4a5eb20ce387885ddf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.365998 11110 tablet_service.cc:1467] Processing CreateTablet for tablet b0d128d3feca4296a226ad50f3e12da0 (DEFAULT_TABLE table=default.Table_db6e8fb7be4b48d282a221b3b30c493e [id=d577ec61288941e2b127a0c076bc1274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.366376 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d128d3feca4296a226ad50f3e12da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.366333 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 965fc4d8af3c4a5eb20ce387885ddf26 (DEFAULT_TABLE table=default.Table_6471535da4514085be860663c7c99e53 [id=44bfc568caa44cdfb37a49f428a746bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.366740 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965fc4d8af3c4a5eb20ce387885ddf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.370095 10859 tablet_service.cc:1467] Processing CreateTablet for tablet b0d128d3feca4296a226ad50f3e12da0 (DEFAULT_TABLE table=default.Table_db6e8fb7be4b48d282a221b3b30c493e [id=d577ec61288941e2b127a0c076bc1274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.370636 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d128d3feca4296a226ad50f3e12da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.370594 11096 tablet_service.cc:1467] Processing CreateTablet for tablet e423eaf2a23a497f937059f9b6c471d4 (DEFAULT_TABLE table=default.Table_27ada88143e9469bae543e38a46a44b9 [id=79f1078632484f2e847e2be40a8bb333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.370939 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e423eaf2a23a497f937059f9b6c471d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.373123 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 965fc4d8af3c4a5eb20ce387885ddf26 (DEFAULT_TABLE table=default.Table_6471535da4514085be860663c7c99e53 [id=44bfc568caa44cdfb37a49f428a746bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.373500 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965fc4d8af3c4a5eb20ce387885ddf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.377892 10881 tablet_service.cc:1467] Processing CreateTablet for tablet b9855da8111345808ecda0277b6e8dca (DEFAULT_TABLE table=default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.378297 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9855da8111345808ecda0277b6e8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.380869 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4e13ab26f4bee9f277a9a305c58a9 (DEFAULT_TABLE table=default.Table_cde36e31078247c79cb9f20de6401754 [id=75d9d9a6bd924a459de6e2f1ac0d35f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.381304 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4e13ab26f4bee9f277a9a305c58a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.381361 10659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cce9f8fd074348ffb60abcc086ac0519" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
W20260811 06:17:18.382143 10555 leader_election.cc:341] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.382270 10555 leader_election.cc:302] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:18.383773 10608 tablet_service.cc:1467] Processing CreateTablet for tablet b0d128d3feca4296a226ad50f3e12da0 (DEFAULT_TABLE table=default.Table_db6e8fb7be4b48d282a221b3b30c493e [id=d577ec61288941e2b127a0c076bc1274]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.387624 10620 tablet_service.cc:1467] Processing CreateTablet for tablet e423eaf2a23a497f937059f9b6c471d4 (DEFAULT_TABLE table=default.Table_27ada88143e9469bae543e38a46a44b9 [id=79f1078632484f2e847e2be40a8bb333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.387941 10859 tablet_service.cc:1467] Processing CreateTablet for tablet e423eaf2a23a497f937059f9b6c471d4 (DEFAULT_TABLE table=default.Table_27ada88143e9469bae543e38a46a44b9 [id=79f1078632484f2e847e2be40a8bb333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.388231 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0d128d3feca4296a226ad50f3e12da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.388347 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e423eaf2a23a497f937059f9b6c471d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.388805 11361 tablet_bootstrap.cc:654] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.391701 11362 tablet_bootstrap.cc:492] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.391832 11362 ts_tablet_manager.cc:1397] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260811 06:17:18.392467 11362 raft_consensus.cc:348] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.392664 11362 raft_consensus.cc:374] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.392709 11362 raft_consensus.cc:729] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.392901 11362 consensus_queue.cc:260] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.393129 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 9bb4e13ab26f4bee9f277a9a305c58a9 (DEFAULT_TABLE table=default.Table_cde36e31078247c79cb9f20de6401754 [id=75d9d9a6bd924a459de6e2f1ac0d35f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.393491 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bb4e13ab26f4bee9f277a9a305c58a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:18.394582 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 44431us
I20260811 06:17:18.394845 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e423eaf2a23a497f937059f9b6c471d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.400971 11361 tablet_bootstrap.cc:492] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.401115 11361 ts_tablet_manager.cc:1397] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.002s
I20260811 06:17:18.402225 11361 raft_consensus.cc:348] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.402575 11361 raft_consensus.cc:374] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.402635 11361 raft_consensus.cc:729] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.402845 11361 consensus_queue.cc:260] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.403839 11362 ts_tablet_manager.cc:1428] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260811 06:17:18.405017 11362 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.405009 10604 tablet_service.cc:1467] Processing CreateTablet for tablet adaecbeaf12041da8e441f85f13a9da0 (DEFAULT_TABLE table=default.Table_91e089da3589454b961bdf81e917e846 [id=925af5a7fb6d4803a5f79061639e7981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.405551 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adaecbeaf12041da8e441f85f13a9da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.408042 11362 tablet_bootstrap.cc:654] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.416446 11361 ts_tablet_manager.cc:1428] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260811 06:17:18.417093 14880 tablet.cc:1722] T 0cec2c3e143a4834a07aef7a31340d9c P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:18.418145 11361 tablet_bootstrap.cc:492] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.421087 11361 tablet_bootstrap.cc:654] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.423717 14872 tablet.cc:1722] T 0cec2c3e143a4834a07aef7a31340d9c P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:18.431597 11365 tablet_bootstrap.cc:654] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.432400 14914 raft_consensus.cc:2726] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.434512 11361 tablet_bootstrap.cc:492] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.435398 11361 ts_tablet_manager.cc:1397] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
W20260811 06:17:18.440368 14515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 06:17:18.440655 14515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 06:17:18.440824 14515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 06:17:18.441022 14515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 06:17:18.443508 11361 raft_consensus.cc:348] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.444849 11361 raft_consensus.cc:374] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.445242 11361 raft_consensus.cc:729] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:18.446144 10555 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 63998.3us
I20260811 06:17:18.446338 11361 consensus_queue.cc:260] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.456221 11361 ts_tablet_manager.cc:1428] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260811 06:17:18.458254 11361 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.465219 14914 raft_consensus.cc:482] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.465428 14914 raft_consensus.cc:504] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.466156 14914 leader_election.cc:288] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.466801 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:18.467686 10564 leader_election.cc:341] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.469599 11361 tablet_bootstrap.cc:654] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.469691 14455 consensus_queue.cc:1035] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.473424 14343 raft_consensus.cc:482] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.473626 14343 raft_consensus.cc:504] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.474347 14343 leader_election.cc:288] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.475219 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f48707b4fb746f49eaaf91b5b81e814" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:18.475164 11046 leader_election.cc:341] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1f48707b4fb746f49eaaf91b5b81e814
W20260811 06:17:18.475835 11047 leader_election.cc:341] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.475947 11047 leader_election.cc:302] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:18.476164 14343 raft_consensus.cc:2726] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.485347 11361 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.485513 11361 ts_tablet_manager.cc:1397] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.000s
I20260811 06:17:18.486334 11361 raft_consensus.cc:348] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.486588 11361 raft_consensus.cc:374] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.486651 11361 raft_consensus.cc:729] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
W20260811 06:17:18.486865 11601 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 62814.3us
I20260811 06:17:18.488545 11653 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 218) took 1514 ms. Trace:
W20260811 06:17:18.488969 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 82434.4us
I20260811 06:17:18.486831 11361 consensus_queue.cc:260] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:18.489990 11584 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.203.65:37755, user_credentials={real_user=slave}} blocked reactor thread for 56513.8us
I20260811 06:17:18.490051 10810 leader_election.cc:302] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:18.490370 11361 ts_tablet_manager.cc:1428] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260811 06:17:18.490382 11584 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6dd4a21086934bd9a64d74075ab41fbe consensus state has no leader
I20260811 06:17:18.490659 11361 tablet_bootstrap.cc:492] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.490674 14935 raft_consensus.cc:2726] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.491451 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 219) took 1500 ms. Trace:
I20260811 06:17:18.491602 11684 rpcz_store.cc:276] 0811 06:17:16.985686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.263745 (+1278059us) service_pool.cc:227] Handling call
0811 06:17:18.271399 (+ 7654us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8b313 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:18.272571 (+ 1172us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.273173 (+ 602us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.484161 (+210988us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.485751 (+ 1590us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.485865 (+ 114us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.303877 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.304006 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.304013 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.304015 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.304123 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.304136 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.304141 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.304229 (+ 88us) tablet.cc:699] Row locks acquired
0811 06:17:18.304232 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.304659 (+ 427us) write_op.cc:270] Start()
0811 06:17:18.304707 (+ 48us) write_op.cc:276] Timestamp: P: 1786429038304230 usec, L: 0
0811 06:17:18.304712 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.358765 (+ 54053us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.358970 (+ 205us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:18.397864 (+ 38894us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.483284 (+ 85420us) write_op.cc:301] APPLY: starting
0811 06:17:18.483308 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.483361 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.483364 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.483502 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.483543 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.483548 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:18.483649 (+ 101us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.483722 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.483747 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:18.483755 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.483820 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.483824 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":16633088,"child_traces":[["op",{"apply.queue_time_us":964,"apply.run_cpu_time_us":624,"apply.run_wall_time_us":623,"num_ops":2,"prepare.queue_time_us":30209,"prepare.run_cpu_time_us":1349,"prepare.run_wall_time_us":55368,"raft.queue_time_us":57,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":476,"replication_time_us":93115,"spinlock_wait_cycles":124092032}]]}
I20260811 06:17:18.492666 11361 tablet_bootstrap.cc:654] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.492578 11684 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d87403c480a745898b0a0d9cc9dad59f" } modify_external_catalogs: true
I20260811 06:17:18.492785 11684 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_d87403c480a745898b0a0d9cc9dad59f" } modify_external_catalogs: true
I20260811 06:17:18.494277 11653 rpcz_store.cc:276] 0811 06:17:16.974333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.243772 (+1269439us) service_pool.cc:227] Handling call
0811 06:17:18.250072 (+ 6300us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8b313 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:18.251026 (+ 954us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.251578 (+ 552us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.488281 (+236703us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.488390 (+ 109us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.488485 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.275089 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.275238 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.275246 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:18.275249 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.275344 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.275357 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.275362 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.275494 (+ 132us) tablet.cc:699] Row locks acquired
0811 06:17:18.275497 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.275535 (+ 38us) write_op.cc:270] Start()
0811 06:17:18.275570 (+ 35us) write_op.cc:276] Timestamp: P: 1786429038275496 usec, L: 0
0811 06:17:18.275574 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.275722 (+ 148us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.283823 (+ 8101us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.369306 (+ 85483us) write_op.cc:301] APPLY: starting
0811 06:17:18.369328 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.369428 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.487478 (+118050us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.487645 (+ 167us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.487684 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.487691 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.487850 (+ 159us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.488166 (+ 316us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.488190 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:18.488198 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.488766 (+ 568us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.488771 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":13659008,"child_traces":[["op",{"apply.queue_time_us":85398,"apply.run_cpu_time_us":1024,"apply.run_wall_time_us":119548,"mutex_wait_us":27588,"num_ops":2,"prepare.queue_time_us":22844,"prepare.run_cpu_time_us":793,"prepare.run_wall_time_us":28741,"raft.queue_time_us":31509,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":74,"replication_time_us":8197}]]}
I20260811 06:17:18.494997 11653 master_service.cc:946] ReplaceTablet: received request to replace tablet f92a58686071449082f60d06b91b098c from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:18.496184 14515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.203.84:41527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.9.203.126:33303,127.9.203.125:35327,127.9.203.124:45045
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.203.124:45045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.9.203.124
--webserver_port=39467
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 05:07:47 UTC on ccycloud.quasar-kfibjw.root.comops.site
build id 4579725
ASAN enabled
I20260811 06:17:18.498208 14515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 06:17:18.503078 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 2d6280a32b6c49f5886fa1ff8745b740
I20260811 06:17:18.503746 11663 catalog_manager.cc:6565] ReplaceTablet: tablet 2d6280a32b6c49f5886fa1ff8745b740 deleted and replaced by tablet fba50687dcf7496cb0f527b633b14df7
I20260811 06:17:18.503892 11663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 217) took 1548 ms. Trace:
I20260811 06:17:18.504024 11663 rpcz_store.cc:276] 0811 06:17:16.955173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.984633 (+1029460us) service_pool.cc:227] Handling call
0811 06:17:18.503832 (+519199us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.360002 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.360154 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.360161 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.360163 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.360290 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.360303 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.360307 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.360523 (+ 216us) tablet.cc:699] Row locks acquired
0811 06:17:18.360527 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:18.360575 (+ 48us) write_op.cc:270] Start()
0811 06:17:18.360615 (+ 40us) write_op.cc:276] Timestamp: P: 1786429038360526 usec, L: 0
0811 06:17:18.360620 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.360819 (+ 199us) log.cc:842] Serialized 625 byte log entry
0811 06:17:18.501516 (+140697us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.502121 (+ 605us) write_op.cc:301] APPLY: starting
0811 06:17:18.502141 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.502190 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.502218 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.502356 (+ 138us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.502436 (+ 80us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.502443 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.502537 (+ 94us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.502607 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.502634 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:18.502641 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.502699 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.502703 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":542,"apply.run_cpu_time_us":665,"apply.run_wall_time_us":695,"num_ops":2,"prepare.queue_time_us":72419,"prepare.run_cpu_time_us":930,"prepare.run_wall_time_us":1045,"raft.queue_time_us":97,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":140866}]]}
I20260811 06:17:18.504873 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 0f3fa8872f8b4a5e9b09da26f8bba721 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:18.505543 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.505746 14935 consensus_queue.cc:1035] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.508044 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 with delete_type TABLET_DATA_DELETED (replaced by tablet fba50687dcf7496cb0f527b633b14df7) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:18.513708 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 2d6280a32b6c49f5886fa1ff8745b740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6280a32b6c49f5886fa1ff8745b740 already in progress: creating tablet
I20260811 06:17:18.516484 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 with delete_type TABLET_DATA_DELETED (replaced by tablet fba50687dcf7496cb0f527b633b14df7) from {username='slave'} at 127.0.0.1:36594
W20260811 06:17:18.517951 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 2d6280a32b6c49f5886fa1ff8745b740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6280a32b6c49f5886fa1ff8745b740 already in progress: creating tablet
I20260811 06:17:18.518539 14515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 06:17:18.518893 11653 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet f92a58686071449082f60d06b91b098c
I20260811 06:17:18.519345 11653 catalog_manager.cc:6565] ReplaceTablet: tablet f92a58686071449082f60d06b91b098c deleted and replaced by tablet 7af69017da384de8a28bcd184fe21894
I20260811 06:17:18.519536 11653 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 221) took 1483 ms. Trace:
I20260811 06:17:18.519642 11653 rpcz_store.cc:276] 0811 06:17:17.036428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.494909 (+1458481us) service_pool.cc:227] Handling call
0811 06:17:18.519425 (+ 24516us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.509059 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.509230 (+ 171us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.509237 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.509240 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.509365 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.509382 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.509387 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.509470 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:18.509473 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.509511 (+ 38us) write_op.cc:270] Start()
0811 06:17:18.509546 (+ 35us) write_op.cc:276] Timestamp: P: 1786429038509450 usec, L: 0
0811 06:17:18.509550 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.509812 (+ 262us) log.cc:842] Serialized 625 byte log entry
0811 06:17:18.517312 (+ 7500us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.517422 (+ 110us) write_op.cc:301] APPLY: starting
0811 06:17:18.517444 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.517509 (+ 65us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.517539 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.517664 (+ 125us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.517782 (+ 118us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.517789 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.518003 (+ 214us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.518540 (+ 537us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.518567 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:18.518575 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":34,"num_ops":2,"prepare.queue_time_us":12901,"prepare.run_cpu_time_us":878,"prepare.run_wall_time_us":879,"raft.queue_time_us":411,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":7738}]]}
I20260811 06:17:18.521257 11653 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_6d83a06b94ae443485f7abda5ed89ccc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:18.522109 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet f92a58686071449082f60d06b91b098c with delete_type TABLET_DATA_DELETED (replaced by tablet 7af69017da384de8a28bcd184fe21894) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:18.522809 11653 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d83a06b94ae443485f7abda5ed89ccc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260811 06:17:18.523008 11601 catalog_manager.cc:4821] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet f92a58686071449082f60d06b91b098c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92a58686071449082f60d06b91b098c already in progress: creating tablet
I20260811 06:17:18.525235 11684 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 35f5ad51ed6f443ca24bc09500b1152c
I20260811 06:17:18.526342 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:18 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:18.527061 11684 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 220) took 1507 ms. Trace:
I20260811 06:17:18.527282 11684 rpcz_store.cc:276] 0811 06:17:17.019394 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.492323 (+1472929us) service_pool.cc:227] Handling call
0811 06:17:18.492881 (+ 558us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:18.493149 (+ 268us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:18.493208 (+ 59us) catalog_manager.cc:2761] Locking tablets
0811 06:17:18.493348 (+ 140us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:18.524979 (+ 31631us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:18.525071 (+ 92us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:18.525118 (+ 47us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:18.527000 (+ 1882us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.515041 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.515166 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.515173 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.515176 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.515338 (+ 162us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.515353 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.515358 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.515500 (+ 142us) tablet.cc:699] Row locks acquired
0811 06:17:18.515503 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.515548 (+ 45us) write_op.cc:270] Start()
0811 06:17:18.515584 (+ 36us) write_op.cc:276] Timestamp: P: 1786429038515484 usec, L: 0
0811 06:17:18.515588 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.515816 (+ 228us) log.cc:842] Serialized 728 byte log entry
0811 06:17:18.523529 (+ 7713us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.523912 (+ 383us) write_op.cc:301] APPLY: starting
0811 06:17:18.523944 (+ 32us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.523993 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.524054 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.524129 (+ 75us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.524169 (+ 40us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:18.524175 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.524265 (+ 90us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.524338 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.524362 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:18.524370 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.524427 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.524430 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":322,"apply.run_cpu_time_us":576,"apply.run_wall_time_us":575,"num_ops":2,"prepare.queue_time_us":358,"prepare.run_cpu_time_us":891,"prepare.run_wall_time_us":1259,"raft.queue_time_us":93,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":7908}]]}
I20260811 06:17:18.529065 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:18 UTC) from {username='slave'} at 127.0.0.1:41374
W20260811 06:17:18.529855 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 35f5ad51ed6f443ca24bc09500b1152c because the tablet was not found. No further retry: Not found: Tablet not found: 35f5ad51ed6f443ca24bc09500b1152c
I20260811 06:17:18.535004 14455 raft_consensus.cc:482] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.535158 14455 raft_consensus.cc:504] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.535987 14455 leader_election.cc:288] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.532768 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_a989b3d8fb2c4ee1b9cc15262f9b1990"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:18.537323 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcc463affbb4154877624aec28435bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:18.537596 11159 raft_consensus.cc:2454] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:18.541446 10813 leader_election.cc:302] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.541790 14455 raft_consensus.cc:2781] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.541877 14455 raft_consensus.cc:482] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.541960 14455 raft_consensus.cc:3037] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.544691 14455 raft_consensus.cc:504] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.549901 14455 leader_election.cc:288] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.552208 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet f92a58686071449082f60d06b91b098c with delete_type TABLET_DATA_DELETED (replaced by tablet 7af69017da384de8a28bcd184fe21894) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:18.552940 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcc463affbb4154877624aec28435bc" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
W20260811 06:17:18.553052 11584 catalog_manager.cc:4821] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet f92a58686071449082f60d06b91b098c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92a58686071449082f60d06b91b098c already in progress: creating tablet
I20260811 06:17:18.553181 11159 raft_consensus.cc:3037] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:18.555914 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a989b3d8fb2c4ee1b9cc15262f9b1990 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.556015 11159 raft_consensus.cc:2454] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
W20260811 06:17:18.560225 10555 leader_election.cc:341] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.560364 10555 leader_election.cc:302] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:18.560168 10813 leader_election.cc:302] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.560578 14914 raft_consensus.cc:2726] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.560987 14934 raft_consensus.cc:2781] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.562325 14934 raft_consensus.cc:686] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:18.562656 14934 consensus_queue.cc:237] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.562785 14889 tablet.cc:1722] T 0cec2c3e143a4834a07aef7a31340d9c P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260811 06:17:18.561345 10810 leader_election.cc:341] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc
W20260811 06:17:18.563751 10810 leader_election.cc:341] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc
I20260811 06:17:18.570132 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet f92a58686071449082f60d06b91b098c with delete_type TABLET_DATA_DELETED (replaced by tablet 7af69017da384de8a28bcd184fe21894) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:18.571728 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 with delete_type TABLET_DATA_DELETED (replaced by tablet fba50687dcf7496cb0f527b633b14df7) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:18.572088 11653 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 223) took 1353 ms. Trace:
I20260811 06:17:18.572300 11653 rpcz_store.cc:276] 0811 06:17:17.218094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.520227 (+1302133us) service_pool.cc:227] Handling call
0811 06:17:18.523012 (+ 2785us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.523668 (+ 656us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.571294 (+ 47626us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.571871 (+ 577us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.571986 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.524272 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.524397 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.524404 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.524406 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.524500 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.524515 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.524520 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.524608 (+ 88us) tablet.cc:699] Row locks acquired
0811 06:17:18.524611 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.524644 (+ 33us) write_op.cc:270] Start()
0811 06:17:18.524674 (+ 30us) write_op.cc:276] Timestamp: P: 1786429038524582 usec, L: 0
0811 06:17:18.524678 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.525251 (+ 573us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.568586 (+ 43335us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.568833 (+ 247us) write_op.cc:301] APPLY: starting
0811 06:17:18.568856 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.568904 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.568961 (+ 57us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.569126 (+ 165us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.569168 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.569174 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.569269 (+ 95us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.569561 (+ 292us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.569584 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:18.569591 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.569651 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.569654 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186,"apply.run_cpu_time_us":673,"apply.run_wall_time_us":882,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":749,"prepare.run_wall_time_us":1375,"raft.queue_time_us":64,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":43877}]]}
I20260811 06:17:18.577001 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 224) took 1358 ms. Trace:
I20260811 06:17:18.577366 11684 rpcz_store.cc:276] 0811 06:17:17.218191 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.532351 (+1314160us) service_pool.cc:227] Handling call
0811 06:17:18.556123 (+ 23772us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.556845 (+ 722us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.576566 (+ 19721us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.576573 (+ 7us) write_op.cc:454] Released schema lock
0811 06:17:18.576662 (+ 89us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.576787 (+ 125us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.576887 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.557480 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.557611 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.557617 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:18.557619 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.558078 (+ 459us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.558095 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.558102 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.558264 (+ 162us) tablet.cc:699] Row locks acquired
0811 06:17:18.558267 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.558309 (+ 42us) write_op.cc:270] Start()
0811 06:17:18.558362 (+ 53us) write_op.cc:276] Timestamp: P: 1786429038558293 usec, L: 0
0811 06:17:18.558367 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.558598 (+ 231us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.574306 (+ 15708us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.574399 (+ 93us) write_op.cc:301] APPLY: starting
0811 06:17:18.574417 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.574518 (+ 101us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.574544 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.574665 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.574702 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.574708 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.574807 (+ 99us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.575134 (+ 327us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.575158 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:18.575165 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":831,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":905,"prepare.run_wall_time_us":1234,"raft.queue_time_us":153,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":15916}]]}
I20260811 06:17:18.579459 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:18.579900 11683 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:18.585945 11362 tablet_bootstrap.cc:492] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.586105 11362 ts_tablet_manager.cc:1397] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.181s user 0.005s sys 0.060s
I20260811 06:17:18.586777 11362 raft_consensus.cc:348] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.587055 11362 raft_consensus.cc:374] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.587113 11362 raft_consensus.cc:729] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.587333 11362 consensus_queue.cc:260] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.587870 11362 ts_tablet_manager.cc:1428] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:18.589056 11362 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.589041 14697 consensus_queue.cc:1035] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.593197 14882 raft_consensus.cc:482] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.593361 14882 raft_consensus.cc:504] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.594226 14882 leader_election.cc:288] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.594741 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.595142 10654 raft_consensus.cc:2454] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:18.595646 11046 leader_election.cc:302] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.595638 10620 tablet_service.cc:1467] Processing CreateTablet for tablet b9855da8111345808ecda0277b6e8dca (DEFAULT_TABLE table=default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.595901 14343 raft_consensus.cc:2781] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.595970 14343 raft_consensus.cc:482] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.596035 14343 raft_consensus.cc:3037] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.595942 11094 tablet_service.cc:1467] Processing CreateTablet for tablet b9855da8111345808ecda0277b6e8dca (DEFAULT_TABLE table=default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.596078 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9855da8111345808ecda0277b6e8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.596318 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9855da8111345808ecda0277b6e8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.598914 14343 raft_consensus.cc:504] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.599840 14343 leader_election.cc:288] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.600486 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:18.600674 10654 raft_consensus.cc:3037] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.600895 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe1d650abe7432f990b0639377b2694 (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.601222 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe1d650abe7432f990b0639377b2694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.601230 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe1d650abe7432f990b0639377b2694 (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.601565 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe1d650abe7432f990b0639377b2694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.603353 10654 raft_consensus.cc:2454] T 00483ba1f60c4db386e3a7f1d57b921c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:18.604063 11046 leader_election.cc:302] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.604450 14343 raft_consensus.cc:2781] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:18.604964 14343 raft_consensus.cc:686] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:18.605674 14343 consensus_queue.cc:237] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.609844 11663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 0f3fa8872f8b4a5e9b09da26f8bba721
I20260811 06:17:18.610440 11663 catalog_manager.cc:6565] ReplaceTablet: tablet 0f3fa8872f8b4a5e9b09da26f8bba721 deleted and replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac
I20260811 06:17:18.610643 11663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 222) took 1504 ms. Trace:
I20260811 06:17:18.610882 11663 rpcz_store.cc:276] 0811 06:17:17.106494 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.504761 (+1398267us) service_pool.cc:227] Handling call
0811 06:17:18.610541 (+105780us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.604477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.604582 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.604588 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:18.604590 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.604715 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.604729 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.604734 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.604815 (+ 81us) tablet.cc:699] Row locks acquired
0811 06:17:18.604817 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:18.604861 (+ 44us) write_op.cc:270] Start()
0811 06:17:18.604894 (+ 33us) write_op.cc:276] Timestamp: P: 1786429038604837 usec, L: 0
0811 06:17:18.604898 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.605102 (+ 204us) log.cc:842] Serialized 625 byte log entry
0811 06:17:18.608057 (+ 2955us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.608244 (+ 187us) write_op.cc:301] APPLY: starting
0811 06:17:18.608262 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.608311 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.608372 (+ 61us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.608495 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.608555 (+ 60us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.608563 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:18.608646 (+ 83us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.608722 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.608744 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:18.608751 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.608815 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.608818 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":631,"apply.run_wall_time_us":630,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":752,"prepare.run_wall_time_us":753,"raft.queue_time_us":218,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":281,"replication_time_us":3134}]]}
I20260811 06:17:18.612389 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_225e77366fe24f5490c5005f8e3e2f12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:18.613093 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_225e77366fe24f5490c5005f8e3e2f12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.616626 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 with delete_type TABLET_DATA_DELETED (replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:18.616990 14839 tablet_replica.cc:330] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:18.620620 11361 tablet_bootstrap.cc:492] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.620772 11361 ts_tablet_manager.cc:1397] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.130s user 0.023s sys 0.019s
I20260811 06:17:18.623504 11361 raft_consensus.cc:348] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.623772 11361 raft_consensus.cc:374] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.623826 11361 raft_consensus.cc:729] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.624389 11663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 226) took 1372 ms. Trace:
I20260811 06:17:18.624560 11663 rpcz_store.cc:276] 0811 06:17:17.252024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.612077 (+1360053us) service_pool.cc:227] Handling call
0811 06:17:18.613209 (+ 1132us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.613952 (+ 743us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.624062 (+ 10110us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.624182 (+ 120us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.624278 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.615204 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.615321 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.615328 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.615331 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.615437 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.615452 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.615456 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.615696 (+ 240us) tablet.cc:699] Row locks acquired
0811 06:17:18.615700 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:18.615744 (+ 44us) write_op.cc:270] Start()
0811 06:17:18.615783 (+ 39us) write_op.cc:276] Timestamp: P: 1786429038615722 usec, L: 0
0811 06:17:18.615788 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.615983 (+ 195us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.620611 (+ 4628us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.620755 (+ 144us) write_op.cc:301] APPLY: starting
0811 06:17:18.620776 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.620833 (+ 57us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.620901 (+ 68us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.621060 (+ 159us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.621105 (+ 45us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.621113 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:18.621222 (+ 109us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.621299 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.621325 (+ 26us) write_op.cc:454] Released schema lock
0811 06:17:18.621332 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.621405 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.621418 (+ 13us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":88,"apply.run_cpu_time_us":724,"apply.run_wall_time_us":723,"num_ops":2,"prepare.queue_time_us":670,"prepare.run_cpu_time_us":817,"prepare.run_wall_time_us":898,"raft.queue_time_us":1561,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":4791}]]}
I20260811 06:17:18.625820 11361 consensus_queue.cc:260] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.626515 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_0021f52eda354f048c66f9ea016f1bc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:18.595981 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.622344 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 with delete_type TABLET_DATA_DELETED (replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:18.627475 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0021f52eda354f048c66f9ea016f1bc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.605873 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00483ba1f60c4db386e3a7f1d57b921c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:18.623679 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe1d650abe7432f990b0639377b2694 (DEFAULT_TABLE table=default.Table_2ff79d6d72ae4a03933f83dfd29053a7 [id=6b6ceaa0d5ae4d58aa395cdd967483dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.592329 11362 tablet_bootstrap.cc:654] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.629106 14935 consensus_queue.cc:1035] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:18.630158 11047 leader_election.cc:341] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:18.630761 11047 leader_election.cc:341] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.631054 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:18 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:18.633608 11684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_374d60267ec54905a06d7f77594a68fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:18.636413 11365 tablet_bootstrap.cc:492] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:18.636572 11365 ts_tablet_manager.cc:1397] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.359s user 0.004s sys 0.008s
I20260811 06:17:18.637240 11365 raft_consensus.cc:348] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.637470 11365 raft_consensus.cc:374] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.637529 11365 raft_consensus.cc:729] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.637703 11365 consensus_queue.cc:260] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.638772 11365 ts_tablet_manager.cc:1428] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 06:17:18.639091 11365 tablet_bootstrap.cc:492] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:18.640321 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 7513bf5f22f84121a77702b1b09e6199 (DEFAULT_TABLE table=default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.641275 11365 tablet_bootstrap.cc:654] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.641515 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 with delete_type TABLET_DATA_DELETED (replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:18.641633 11361 ts_tablet_manager.cc:1428] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260811 06:17:18.641817 14484 tablet_replica.cc:330] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:18.641953 11361 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.642009 14484 raft_consensus.cc:2229] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:18.642167 14484 raft_consensus.cc:2258] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:18.642601 11098 tablet_service.cc:1467] Processing CreateTablet for tablet 7513bf5f22f84121a77702b1b09e6199 (DEFAULT_TABLE table=default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.642997 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7513bf5f22f84121a77702b1b09e6199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.643003 14484 ts_tablet_manager.cc:1905] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:18.646312 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe1d650abe7432f990b0639377b2694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.648036 14839 raft_consensus.cc:2229] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:18.648547 14839 raft_consensus.cc:2258] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:18.649545 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7513bf5f22f84121a77702b1b09e6199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.652778 14839 ts_tablet_manager.cc:1905] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:18.653268 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:18.653632 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:18.653913 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet c03f18c65ada4b0b86534d29cd363d9a (table default.Table_6c84470c4e8e4e0fa09d719f9cbc7f20 [id=3c39ffa2022447068fcc6f6f551a38a6]). Expected version 1 got 0
I20260811 06:17:18.654112 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:18.654232 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:18.654780 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:18.655133 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:18.655534 11676 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 54249325b2fa462bbc476ea609ec5389 (table default.Table_d868a0d8395f43fba4fd9381aaf5e93e [id=dcd0a85bedc24ef4b83da3f0786e87ff]). Expected version 1 got 0
I20260811 06:17:18.659422 14839 ts_tablet_manager.cc:1918] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.659647 14839 log.cc:1196] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/0f3fa8872f8b4a5e9b09da26f8bba721
I20260811 06:17:18.660082 14839 ts_tablet_manager.cc:1939] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:18.666097 14100 raft_consensus.cc:482] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.666294 14100 raft_consensus.cc:504] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.666924 14100 leader_election.cc:288] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:18.669420 11046 leader_election.cc:341] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:18.673010 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]) successfully deleted
W20260811 06:17:18.673465 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 35f5ad51ed6f443ca24bc09500b1152c because the tablet was not found. No further retry: Not found: Tablet not found: 35f5ad51ed6f443ca24bc09500b1152c
W20260811 06:17:18.673542 14969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:17:18.675350 14484 ts_tablet_manager.cc:1918] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.675498 14484 log.cc:1196] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/0f3fa8872f8b4a5e9b09da26f8bba721
W20260811 06:17:18.678750 11684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_374d60267ec54905a06d7f77594a68fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:18.679822 14484 ts_tablet_manager.cc:1939] T 0f3fa8872f8b4a5e9b09da26f8bba721 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:18.681555 11365 tablet_bootstrap.cc:492] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:18.681766 11365 ts_tablet_manager.cc:1397] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.004s
I20260811 06:17:18.682551 11365 raft_consensus.cc:348] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.683503 11365 raft_consensus.cc:374] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.683737 11365 raft_consensus.cc:729] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.684207 11365 consensus_queue.cc:260] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.685616 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 8af156c4975d47108000a5bccf21f9f7 (DEFAULT_TABLE table=default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.686124 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af156c4975d47108000a5bccf21f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.686595 14954 tablet_replica.cc:330] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:18.686803 14954 raft_consensus.cc:2229] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:18.687114 14954 raft_consensus.cc:2258] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:18.687162 11365 ts_tablet_manager.cc:1428] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260811 06:17:18.687878 11365 tablet_bootstrap.cc:492] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:18.687964 11362 tablet_bootstrap.cc:492] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.688088 11362 ts_tablet_manager.cc:1397] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.001s
I20260811 06:17:18.688691 11362 raft_consensus.cc:348] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.688894 11362 raft_consensus.cc:374] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.688953 11362 raft_consensus.cc:729] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.690927 11361 tablet_bootstrap.cc:654] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.693701 14954 ts_tablet_manager.cc:1905] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:18.699026 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 7513bf5f22f84121a77702b1b09e6199 (DEFAULT_TABLE table=default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.699208 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e00a72f178f74ca59cc073fe78c99373" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.699496 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7513bf5f22f84121a77702b1b09e6199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.703300 11362 consensus_queue.cc:260] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.703686 14935 raft_consensus.cc:482] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.703816 14935 raft_consensus.cc:504] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.703955 11362 ts_tablet_manager.cc:1428] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260811 06:17:18.704530 11362 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.704569 14935 leader_election.cc:288] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.705907 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.706257 10655 raft_consensus.cc:2379] T 03f2bd25baf347f7a1ba1b50459d8a97 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:18.709657 11362 tablet_bootstrap.cc:654] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.714056 11365 tablet_bootstrap.cc:654] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.714663 11361 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.714821 11361 ts_tablet_manager.cc:1397] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.073s user 0.008s sys 0.000s
I20260811 06:17:18.715409 14954 ts_tablet_manager.cc:1918] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:18.715541 14954 log.cc:1196] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/0f3fa8872f8b4a5e9b09da26f8bba721
I20260811 06:17:18.715920 14954 ts_tablet_manager.cc:1939] T 0f3fa8872f8b4a5e9b09da26f8bba721 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:18.756313 11362 tablet_bootstrap.cc:492] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.756529 11362 ts_tablet_manager.cc:1397] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.014s
I20260811 06:17:18.757329 11362 raft_consensus.cc:348] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.761536 11362 raft_consensus.cc:374] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.761686 11362 raft_consensus.cc:729] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.761956 11362 consensus_queue.cc:260] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.762657 11362 ts_tablet_manager.cc:1428] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 06:17:18.763052 11362 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.765588 14889 tablet.cc:1722] T 754b5fec454d44608b62ddec7d58bfac P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.767238 14914 raft_consensus.cc:482] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.767388 14914 raft_consensus.cc:504] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.768127 14914 leader_election.cc:288] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.768838 14880 tablet.cc:1722] T 754b5fec454d44608b62ddec7d58bfac P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.770402 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:18.771128 10555 leader_election.cc:341] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.772980 11362 tablet_bootstrap.cc:654] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.780820 14914 raft_consensus.cc:482] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.780997 14914 raft_consensus.cc:504] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.781617 14914 leader_election.cc:288] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.782836 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:18.783547 10555 leader_election.cc:341] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.785841 11362 tablet_bootstrap.cc:492] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.786007 11362 ts_tablet_manager.cc:1397] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.002s
I20260811 06:17:18.787197 11362 raft_consensus.cc:348] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.787446 11362 raft_consensus.cc:374] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.787496 11362 raft_consensus.cc:729] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.787696 11362 consensus_queue.cc:260] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.788439 11362 ts_tablet_manager.cc:1428] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:18.788766 11362 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.791857 11362 tablet_bootstrap.cc:654] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:18.691334 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 35f5ad51ed6f443ca24bc09500b1152c because the tablet was not found. No further retry: Not found: Tablet not found: 35f5ad51ed6f443ca24bc09500b1152c
W20260811 06:17:18.798986 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 107562us
W20260811 06:17:18.799465 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet f92a58686071449082f60d06b91b098c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92a58686071449082f60d06b91b098c already in progress: creating tablet
W20260811 06:17:18.800173 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 2d6280a32b6c49f5886fa1ff8745b740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6280a32b6c49f5886fa1ff8745b740 already in progress: creating tablet
I20260811 06:17:18.800699 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]) successfully deleted
I20260811 06:17:18.801419 11663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 227) took 1549 ms. Trace:
I20260811 06:17:18.801608 11663 rpcz_store.cc:276] 0811 06:17:17.252173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.626130 (+1373957us) service_pool.cc:227] Handling call
0811 06:17:18.627589 (+ 1459us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.679160 (+ 51571us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.800965 (+121805us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.801089 (+ 124us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.801193 (+ 104us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.794801 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.794920 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.794927 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.794929 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.795023 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.795038 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.795042 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.795124 (+ 82us) tablet.cc:699] Row locks acquired
0811 06:17:18.795126 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:18.795166 (+ 40us) write_op.cc:270] Start()
0811 06:17:18.795202 (+ 36us) write_op.cc:276] Timestamp: P: 1786429038795125 usec, L: 0
0811 06:17:18.795206 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.795438 (+ 232us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.799577 (+ 4139us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.799666 (+ 89us) write_op.cc:301] APPLY: starting
0811 06:17:18.799683 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.799727 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.799752 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.799887 (+ 135us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.799923 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.799940 (+ 17us) write_op.cc:312] APPLY: finished
0811 06:17:18.800033 (+ 93us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.800107 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.800139 (+ 32us) write_op.cc:454] Released schema lock
0811 06:17:18.800147 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.800211 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.800215 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":604,"apply.run_wall_time_us":604,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":763,"prepare.run_wall_time_us":763,"raft.queue_time_us":166,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":245,"replication_time_us":4342}]]}
I20260811 06:17:18.802647 11663 master_service.cc:946] ReplaceTablet: received request to replace tablet 45fc206d95a244e395d19328ae289485 from {username='slave'} at 127.0.0.1:52508
I20260811 06:17:18.805987 11362 tablet_bootstrap.cc:492] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.806278 11362 ts_tablet_manager.cc:1397] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.005s
I20260811 06:17:18.807422 11362 raft_consensus.cc:348] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.807682 11362 raft_consensus.cc:374] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.807739 11362 raft_consensus.cc:729] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.807948 11362 consensus_queue.cc:260] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.808521 11362 ts_tablet_manager.cc:1428] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:18.808820 11362 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.815799 11362 tablet_bootstrap.cc:654] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.820113 14880 tablet.cc:1722] T 10bb259b9721485db9c968763434f67e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.822497 11362 tablet_bootstrap.cc:492] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.822561 14935 raft_consensus.cc:482] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.822642 11362 ts_tablet_manager.cc:1397] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.004s
I20260811 06:17:18.822769 14935 raft_consensus.cc:504] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.823773 14935 leader_election.cc:288] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.823777 11362 raft_consensus.cc:348] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.824401 11362 raft_consensus.cc:374] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.824465 11362 raft_consensus.cc:729] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.824450 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.824631 11362 consensus_queue.cc:260] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.825171 11362 ts_tablet_manager.cc:1428] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:18.825460 11362 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.825661 14889 tablet.cc:1722] T 10bb259b9721485db9c968763434f67e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.831683 11362 tablet_bootstrap.cc:654] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.842419 11362 tablet_bootstrap.cc:492] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:18.842583 11362 ts_tablet_manager.cc:1397] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.001s
I20260811 06:17:18.843568 11362 raft_consensus.cc:348] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.843779 11362 raft_consensus.cc:374] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.843834 11362 raft_consensus.cc:729] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.844035 11362 consensus_queue.cc:260] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:18.844874 11362 ts_tablet_manager.cc:1428] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:18.845444 11362 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:18.849417 11362 tablet_bootstrap.cc:654] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.882902 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 8af156c4975d47108000a5bccf21f9f7 (DEFAULT_TABLE table=default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.883510 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af156c4975d47108000a5bccf21f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.891552 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c (DEFAULT_TABLE table=default.Table_d87403c480a745898b0a0d9cc9dad59f [id=d5247423f04f4ec88554dd83b8bdbd3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.892129 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f5ad51ed6f443ca24bc09500b1152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.895377 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 09a8a542712b4169b7bd015e9d311437 (DEFAULT_TABLE table=default.Table_939503f4b27040539b307fd35ab86781 [id=f85deb4905db46a697610d687506fc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.895926 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a8a542712b4169b7bd015e9d311437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.899430 10873 tablet_service.cc:1467] Processing CreateTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c (DEFAULT_TABLE table=default.Table_d87403c480a745898b0a0d9cc9dad59f [id=d5247423f04f4ec88554dd83b8bdbd3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.899930 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f5ad51ed6f443ca24bc09500b1152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.902072 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 6d5cfa63a633440897f09979413197ce (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.902594 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d5cfa63a633440897f09979413197ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.904803 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
W20260811 06:17:18.906919 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 203270us
W20260811 06:17:18.907230 11047 leader_election.cc:341] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.907341 11047 leader_election.cc:302] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:18.907990 11361 raft_consensus.cc:348] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.908214 11361 raft_consensus.cc:374] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:18.908272 11361 raft_consensus.cc:729] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:18.908450 11361 consensus_queue.cc:260] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.908993 11361 ts_tablet_manager.cc:1428] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.194s user 0.002s sys 0.000s
I20260811 06:17:18.909281 11361 tablet_bootstrap.cc:492] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:18.910697 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:18.910718 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:18.911583 10564 leader_election.cc:341] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.911739 10564 leader_election.cc:302] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:18.912125 10564 leader_election.cc:341] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:18.912209 10564 leader_election.cc:302] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:18.912513 14408 raft_consensus.cc:2726] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.912652 14408 raft_consensus.cc:2726] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.908279 14882 raft_consensus.cc:2726] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:18.922220 11361 tablet_bootstrap.cc:654] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:18.925911 11684 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 225) took 1707 ms. Trace:
I20260811 06:17:18.928124 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 6d5cfa63a633440897f09979413197ce (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.928750 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d5cfa63a633440897f09979413197ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.938095 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 09a8a542712b4169b7bd015e9d311437 (DEFAULT_TABLE table=default.Table_939503f4b27040539b307fd35ab86781 [id=f85deb4905db46a697610d687506fc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.938668 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a8a542712b4169b7bd015e9d311437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.945626 11684 rpcz_store.cc:276] 0811 06:17:17.218702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.578877 (+1360175us) service_pool.cc:227] Handling call
0811 06:17:18.814512 (+235635us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:18.815142 (+ 630us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:18.925421 (+110279us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.925430 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:18.925542 (+ 112us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:18.925673 (+ 131us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:18.925814 (+ 141us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.815879 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.816138 (+ 259us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.816145 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.816147 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.816244 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.816259 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.816264 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:18.816355 (+ 91us) tablet.cc:699] Row locks acquired
0811 06:17:18.816358 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.816401 (+ 43us) write_op.cc:270] Start()
0811 06:17:18.816451 (+ 50us) write_op.cc:276] Timestamp: P: 1786429038816359 usec, L: 0
0811 06:17:18.816455 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.816671 (+ 216us) log.cc:842] Serialized 433 byte log entry
0811 06:17:18.894451 (+ 77780us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.894603 (+ 152us) write_op.cc:301] APPLY: starting
0811 06:17:18.894624 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.894677 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.894742 (+ 65us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.894873 (+ 131us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.894917 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:18.894924 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:18.895043 (+ 119us) log.cc:842] Serialized 29 byte log entry
0811 06:17:18.895121 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.895150 (+ 29us) write_op.cc:454] Released schema lock
0811 06:17:18.895159 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":644,"apply.run_wall_time_us":643,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":823,"prepare.run_wall_time_us":979,"raft.queue_time_us":42,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":77960}]]}
I20260811 06:17:18.947708 15000 tablet.cc:1722] T 754b5fec454d44608b62ddec7d58bfac P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:18.948798 11361 tablet_bootstrap.cc:492] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:18.949791 14884 raft_consensus.cc:482] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.949954 14884 raft_consensus.cc:504] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.950506 14884 leader_election.cc:288] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.953065 10649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.953369 10649 raft_consensus.cc:2454] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:18.961342 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 53582.3us
I20260811 06:17:18.962978 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 0f3fa8872f8b4a5e9b09da26f8bba721 (table default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]) successfully deleted
I20260811 06:17:18.962982 14884 consensus_queue.cc:1035] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:18.963678 11046 leader_election.cc:302] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:18.963929 14884 raft_consensus.cc:2781] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:18.964068 14884 raft_consensus.cc:482] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:18.964188 14884 raft_consensus.cc:3037] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:18.966104 14100 raft_consensus.cc:482] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.966253 14100 raft_consensus.cc:504] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.966785 14100 leader_election.cc:288] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.967355 14100 raft_consensus.cc:482] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.967464 14100 raft_consensus.cc:504] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.967931 14100 leader_election.cc:288] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:18.969561 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 8af156c4975d47108000a5bccf21f9f7 (DEFAULT_TABLE table=default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.970046 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af156c4975d47108000a5bccf21f9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.971235 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:18.971725 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:18.972239 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 54249325b2fa462bbc476ea609ec5389 (table default.Table_d868a0d8395f43fba4fd9381aaf5e93e [id=dcd0a85bedc24ef4b83da3f0786e87ff]). Expected version 1 got 0
I20260811 06:17:18.972648 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c03f18c65ada4b0b86534d29cd363d9a (table default.Table_6c84470c4e8e4e0fa09d719f9cbc7f20 [id=3c39ffa2022447068fcc6f6f551a38a6]). Expected version 1 got 0
I20260811 06:17:18.973156 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 754b5fec454d44608b62ddec7d58bfac (table default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd]). Expected version 1 got 0
I20260811 06:17:18.974205 14935 raft_consensus.cc:482] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:18.974459 14935 raft_consensus.cc:504] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:18.975201 14935 leader_election.cc:288] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:18.975253 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 35f5ad51ed6f443ca24bc09500b1152c (DEFAULT_TABLE table=default.Table_d87403c480a745898b0a0d9cc9dad59f [id=d5247423f04f4ec88554dd83b8bdbd3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.975679 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f5ad51ed6f443ca24bc09500b1152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:18.976181 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:18.976502 10655 raft_consensus.cc:2379] T 2be78c7877934f438ac52e8bf82d145b P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:18.977964 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:18.978036 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 6d5cfa63a633440897f09979413197ce (DEFAULT_TABLE table=default.Table_32d14fb4e67a4a9fb4147e1442ed7dd7 [id=bfac4413a6bb4749a661484140fa53df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:18.978467 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d5cfa63a633440897f09979413197ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260811 06:17:18.997140 14975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 06:17:18.998466 11046 consensus_peers.cc:487] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6f682f675c344b6b5955e834f94091f. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:18.998694 11046 consensus_peers.cc:487] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2527862e75b42aa9091456b0f5f994e. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:19.018255 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 121d17e7eca045d79d1619745b55dde7 (DEFAULT_TABLE table=default.Table_9b872cb70c63459191dcbfadffebf4fb [id=ba2d8f6a79244e71956d6d10ebe98df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.018633 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.018960 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 121d17e7eca045d79d1619745b55dde7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.019061 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efc03bb295f45acabf65c33d6a4edf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.019402 14677 raft_consensus.cc:482] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.019539 14677 raft_consensus.cc:504] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.020133 14677 leader_election.cc:288] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.019532 14100 raft_consensus.cc:482] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.020445 14100 raft_consensus.cc:504] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.021025 14100 leader_election.cc:288] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.021514 14515 server_base.cc:1034] running on GCE node
W20260811 06:17:19.022110 15020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 06:17:18.949791 11361 ts_tablet_manager.cc:1397] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.003s
I20260811 06:17:19.023011 11365 tablet_bootstrap.cc:492] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.023270 11361 raft_consensus.cc:348] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.023496 11361 raft_consensus.cc:374] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.023545 11361 raft_consensus.cc:729] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.023592 14515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 06:17:19.023787 11361 consensus_queue.cc:260] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.024348 11361 ts_tablet_manager.cc:1428] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 06:17:19.024678 11365 ts_tablet_manager.cc:1397] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.337s user 0.026s sys 0.053s
I20260811 06:17:19.024927 11361 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:19.025705 11365 raft_consensus.cc:348] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.027822 11365 raft_consensus.cc:374] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.028263 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.028606 10658 raft_consensus.cc:2454] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:19.031344 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 121d17e7eca045d79d1619745b55dde7 (DEFAULT_TABLE table=default.Table_9b872cb70c63459191dcbfadffebf4fb [id=ba2d8f6a79244e71956d6d10ebe98df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.031872 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 121d17e7eca045d79d1619745b55dde7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.036454 11365 raft_consensus.cc:729] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.039352 11365 consensus_queue.cc:260] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.041118 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.042354 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efc03bb295f45acabf65c33d6a4edf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.043672 11365 ts_tablet_manager.cc:1428] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260811 06:17:19.043998 11365 tablet_bootstrap.cc:492] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.048357 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.048722 10654 raft_consensus.cc:2454] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:19.049870 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:19.050727 14914 raft_consensus.cc:482] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.050884 14914 raft_consensus.cc:504] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.051884 14914 leader_election.cc:288] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.052981 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 23ca4a89d00242ea98c5b964df27082f (table default.Table_b1633ab525bf4d3381d65de52f568771 [id=776130ee53724d72ba83b985a42f9b54]). Expected version 1 got 0
I20260811 06:17:19.053912 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0cec2c3e143a4834a07aef7a31340d9c (table default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016]). Expected version 2 got 0
I20260811 06:17:19.055226 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:19.055956 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 09a8a542712b4169b7bd015e9d311437 (DEFAULT_TABLE table=default.Table_939503f4b27040539b307fd35ab86781 [id=f85deb4905db46a697610d687506fc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.057423 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df64ad168f341be899eba30e55b7f44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.058100 11365 tablet_bootstrap.cc:654] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.062554 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03f2bd25baf347f7a1ba1b50459d8a97" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.059839 10555 leader_election.cc:341] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.068990 14515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 06:17:19.070297 14995 consensus_queue.cc:1035] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:19.072676 11046 leader_election.cc:341] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 79f307f50e044435be880079219170d8
I20260811 06:17:19.076249 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a8a542712b4169b7bd015e9d311437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.061120 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df64ad168f341be899eba30e55b7f44" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.076177 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 121d17e7eca045d79d1619745b55dde7 (DEFAULT_TABLE table=default.Table_9b872cb70c63459191dcbfadffebf4fb [id=ba2d8f6a79244e71956d6d10ebe98df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.076654 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 121d17e7eca045d79d1619745b55dde7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.076922 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 (DEFAULT_TABLE table=default.Table_434adc20066e4b959518efc1ea61e28f [id=3d16738627814e608855ed6395b537f6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:17:19.078635 10564 leader_election.cc:341] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.078971 10564 leader_election.cc:302] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.079267 14914 raft_consensus.cc:2726] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.080024 14515 hybrid_clock.cc:648] HybridClock initialized: now 1786429039079810 us; error 78 us; skew 500 ppm
I20260811 06:17:19.080360 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9efc03bb295f45acabf65c33d6a4edf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.080989 14515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 06:17:19.081622 11046 leader_election.cc:302] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:19.083118 11365 tablet_bootstrap.cc:492] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.084079 11365 ts_tablet_manager.cc:1397] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.001s
I20260811 06:17:19.085301 11365 raft_consensus.cc:348] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.085839 14100 raft_consensus.cc:2781] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.085937 14100 raft_consensus.cc:482] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.085995 14100 raft_consensus.cc:3037] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.087620 11365 raft_consensus.cc:374] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.088016 11365 raft_consensus.cc:729] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.088584 11365 consensus_queue.cc:260] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:17:19.088901 11046 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 02bb2819d9cc4880803ef959c131b9ac
I20260811 06:17:19.089093 11046 leader_election.cc:302] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:19.092119 14100 raft_consensus.cc:504] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.093820 14100 leader_election.cc:288] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.081373 14994 consensus_queue.cc:1035] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260811 06:17:19.094033 11365 ts_tablet_manager.cc:1428] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:17:19.094521 14994 raft_consensus.cc:2781] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.094671 14994 raft_consensus.cc:482] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.094790 14994 raft_consensus.cc:3037] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.095988 11365 tablet_bootstrap.cc:492] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.099053 11365 tablet_bootstrap.cc:654] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.101552 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_e17d8af91df54ff382547bea08d954d2 [id=d2255732f19f4b84828294798d33b5fc]). Expected version 2 got 0
I20260811 06:17:19.106662 11362 tablet_bootstrap.cc:492] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.106945 11362 ts_tablet_manager.cc:1397] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.262s user 0.026s sys 0.058s
I20260811 06:17:19.107983 11362 raft_consensus.cc:348] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.108309 11362 raft_consensus.cc:374] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.108412 11362 raft_consensus.cc:729] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.108770 11362 consensus_queue.cc:260] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.112186 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:19.112854 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:19.113216 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:19.114053 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (table default.Table_99affff9b5fe49d48a5012cba18e007b [id=4477e6c360934e079e00533d56a91c11]). Expected version 1 got 0
I20260811 06:17:19.114343 11362 ts_tablet_manager.cc:1428] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260811 06:17:19.114830 11362 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.119865 11365 tablet_bootstrap.cc:492] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.120014 11361 tablet_bootstrap.cc:654] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.120579 15000 tablet.cc:1722] T ce5f2fa8c64247419f2ca9b26df825b0 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:19.120870 11365 ts_tablet_manager.cc:1397] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.006s
I20260811 06:17:19.123799 11365 raft_consensus.cc:348] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.124876 11365 raft_consensus.cc:374] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.125161 11365 raft_consensus.cc:729] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.125860 11365 consensus_queue.cc:260] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.127719 11365 ts_tablet_manager.cc:1428] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:19.129355 11365 tablet_bootstrap.cc:492] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.130448 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7409453e6e34172870dbb9fb3c5ac44" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.143388 11365 tablet_bootstrap.cc:654] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.143524 15000 tablet.cc:1722] T 7716cda181d444a99d69cbc9ade3269e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.146231 14884 raft_consensus.cc:504] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.122865 11362 tablet_bootstrap.cc:654] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.153335 14884 leader_election.cc:288] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.155582 14934 raft_consensus.cc:482] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.155748 14934 raft_consensus.cc:504] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.156420 14934 leader_election.cc:288] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.157526 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2be78c7877934f438ac52e8bf82d145b" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.158070 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.159448 10918 raft_consensus.cc:3037] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.165584 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:19.166203 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79f307f50e044435be880079219170d8" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.166689 11365 tablet_bootstrap.cc:492] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.166908 11365 ts_tablet_manager.cc:1397] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.001s
I20260811 06:17:19.167085 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.167269 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:19.168215 11365 raft_consensus.cc:348] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.169152 11365 raft_consensus.cc:374] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.169387 11365 raft_consensus.cc:729] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.169910 11365 consensus_queue.cc:260] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.170646 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:19.171201 11365 ts_tablet_manager.cc:1428] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:19.172220 11365 tablet_bootstrap.cc:492] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.175751 11365 tablet_bootstrap.cc:654] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.178145 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7821b08482ed49ea8e90155805a88ae5" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.179962 10910 raft_consensus.cc:3037] T 6dd4a21086934bd9a64d74075ab41fbe P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.180294 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02bb2819d9cc4880803ef959c131b9ac" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.181139 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.175546 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:19.182407 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:19.183058 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:19.183643 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
W20260811 06:17:19.188736 10037 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 43985.2us
I20260811 06:17:19.194649 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1168c63178174571907981d4a6ac165f (table default.Table_e8aa31ae81824fd699449a5bfe4ba023 [id=485faa9398f8447398dbdc64b6ef2167]). Expected version 1 got 0
I20260811 06:17:19.197527 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:19.199113 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:19.197551 14994 raft_consensus.cc:504] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.200030 10813 leader_election.cc:302] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.200327 14935 raft_consensus.cc:3037] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.200624 14994 leader_election.cc:288] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.203485 14935 raft_consensus.cc:2726] T 03f2bd25baf347f7a1ba1b50459d8a97 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.205241 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:19.207080 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:19.209218 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:19.209558 11365 tablet_bootstrap.cc:492] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.209772 11365 ts_tablet_manager.cc:1397] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.002s
I20260811 06:17:19.210800 11365 raft_consensus.cc:348] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.211143 11365 raft_consensus.cc:374] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.211232 11365 raft_consensus.cc:729] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.211519 11365 consensus_queue.cc:260] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.210951 11656 catalog_manager.cc:5495] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:19.214015 11656 catalog_manager.cc:5495] T f1276a6c043948529b7537081e34b257 P 56a371f7ed104f68a5db9ca097eb237e reported cstate change: term changed from 0 to 1, leader changed from <none> to 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66). New cstate: current_term: 1 leader_uuid: "56a371f7ed104f68a5db9ca097eb237e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:19.218469 11365 ts_tablet_manager.cc:1428] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:19.219050 11365 tablet_bootstrap.cc:492] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.220654 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:19.221458 11365 tablet_bootstrap.cc:654] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.222724 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:19.223019 14934 consensus_queue.cc:1035] T 1a0278945378465ea9d61180b5f539dd P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.223584 11361 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:19.223727 11361 ts_tablet_manager.cc:1397] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.199s user 0.009s sys 0.008s
I20260811 06:17:19.224255 10813 leader_election.cc:302] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.224514 14934 raft_consensus.cc:2726] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.225099 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (table default.Table_177834d7b9304f4da015488acfeb6ef9 [id=1e63357b8e1e4c769761f84a22125a85]). Expected version 1 got 0
I20260811 06:17:19.225627 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:19.226058 11361 raft_consensus.cc:348] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.226562 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:19.227196 11656 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:19.227452 11361 raft_consensus.cc:374] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.227589 11361 raft_consensus.cc:729] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.227862 11361 consensus_queue.cc:260] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.228070 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.228346 10655 raft_consensus.cc:3037] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.230078 11361 ts_tablet_manager.cc:1428] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260811 06:17:19.230311 14889 tablet.cc:1722] T ce5f2fa8c64247419f2ca9b26df825b0 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:19.230839 11361 tablet_bootstrap.cc:492] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:19.234633 14889 tablet.cc:1722] T 7716cda181d444a99d69cbc9ade3269e P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.237751 10655 raft_consensus.cc:2454] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:19.240187 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:19.244750 10813 leader_election.cc:302] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.245042 14934 raft_consensus.cc:3037] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.248281 14934 raft_consensus.cc:2726] T 2be78c7877934f438ac52e8bf82d145b P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.248522 14994 raft_consensus.cc:482] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.249138 14994 raft_consensus.cc:504] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.250130 14994 leader_election.cc:288] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.250136 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.250388 10654 raft_consensus.cc:3037] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.250751 14995 raft_consensus.cc:482] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.250897 14995 raft_consensus.cc:504] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.251443 14995 leader_election.cc:288] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.254115 10654 raft_consensus.cc:2454] T 231bbec61fa247ef97b090f6a180b737 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:19.254118 11047 leader_election.cc:341] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.254714 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c014c792fe4f309d15856f63f47cc9" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.254987 14914 raft_consensus.cc:482] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.255021 10645 raft_consensus.cc:3037] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.255142 14914 raft_consensus.cc:504] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:19.255641 11047 consensus_peers.cc:487] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:19.255748 14914 leader_election.cc:288] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:19.256253 11047 leader_election.cc:341] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.256194 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.256379 11047 leader_election.cc:302] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.256569 14995 raft_consensus.cc:2726] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:19.256824 10564 leader_election.cc:341] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.257148 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:19.257674 10555 leader_election.cc:341] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.257884 10555 leader_election.cc:302] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.258126 14914 raft_consensus.cc:2726] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.258471 10645 raft_consensus.cc:2454] T c2c014c792fe4f309d15856f63f47cc9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:19.258893 11047 leader_election.cc:341] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.259920 11663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 228) took 1802 ms. Trace:
I20260811 06:17:19.260206 11663 rpcz_store.cc:276] 0811 06:17:17.456901 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.802512 (+1345611us) service_pool.cc:227] Handling call
0811 06:17:19.259742 (+457230us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260811 06:17:19.261117 11362 tablet_bootstrap.cc:492] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.261255 11362 ts_tablet_manager.cc:1397] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.147s user 0.004s sys 0.001s
I20260811 06:17:19.262053 11362 raft_consensus.cc:348] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.262277 11362 raft_consensus.cc:374] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.262326 11362 raft_consensus.cc:729] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.263566 11362 consensus_queue.cc:260] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.264323 11362 ts_tablet_manager.cc:1428] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:19.272284 14995 consensus_queue.cc:1035] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.272467 11361 tablet_bootstrap.cc:654] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:19.273666 11047 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.273887 11047 leader_election.cc:302] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.274068 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:19.274158 14995 raft_consensus.cc:2726] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.274359 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 10bb259b9721485db9c968763434f67e (table default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a]). Expected version 1 got 0
I20260811 06:17:19.274617 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:19.274912 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
W20260811 06:17:19.275408 11047 leader_election.cc:341] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.275605 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:19.276357 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:19.277086 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:19.277793 11653 catalog_manager.cc:5495] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:19.278594 11362 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.279037 11653 catalog_manager.cc:5495] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } }
I20260811 06:17:19.279940 11653 catalog_manager.cc:5495] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:19.281558 11653 catalog_manager.cc:5495] T a2f8100e334a4fd1b3c9b059e3bdef3e P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:19.283083 14995 consensus_queue.cc:1035] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.283944 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:19.284746 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:19.285086 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:19.285513 11653 catalog_manager.cc:5495] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:19.286329 14515 webserver.cc:460] Webserver started at http://127.9.203.124:39467/ using document root <none> and password file <none>
I20260811 06:17:19.286351 11653 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:19.286738 11653 catalog_manager.cc:5495] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:19.287599 11362 tablet_bootstrap.cc:654] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:19.291249 11047 consensus_peers.cc:487] T e7a707e7a6394e7a916001c0278a97bd P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:19.291491 11047 leader_election.cc:341] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:19.292901 11047 leader_election.cc:341] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.293668 11362 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.294461 15045 tablet.cc:1722] T a25b6d0d733c44398a233b595caad8a0 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:19.294643 11362 ts_tablet_manager.cc:1397] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260811 06:17:19.295526 11362 raft_consensus.cc:348] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.295770 11362 raft_consensus.cc:374] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.295833 11362 raft_consensus.cc:729] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.296032 11362 consensus_queue.cc:260] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.296617 11362 ts_tablet_manager.cc:1428] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260811 06:17:19.297197 10910 raft_consensus.cc:3037] T 511f08c3d4d642368805b6a89743b367 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.297955 10813 leader_election.cc:302] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.298283 10916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231bbec61fa247ef97b090f6a180b737" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:19.298969 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.300591 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.301121 14935 raft_consensus.cc:2726] T 7821b08482ed49ea8e90155805a88ae5 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.303737 11362 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.320545 14995 consensus_queue.cc:1035] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.328177 14515 fs_manager.cc:359] Metadata directory not provided
I20260811 06:17:19.328684 14515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 06:17:19.329437 11046 leader_election.cc:302] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.329810 14995 raft_consensus.cc:2781] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.270907 11365 tablet_bootstrap.cc:492] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.330448 11365 ts_tablet_manager.cc:1397] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.005s
I20260811 06:17:19.330497 14995 raft_consensus.cc:686] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:19.330998 14995 consensus_queue.cc:237] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.331430 11362 tablet_bootstrap.cc:654] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.331337 11365 raft_consensus.cc:348] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.331571 11365 raft_consensus.cc:374] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.331630 11365 raft_consensus.cc:729] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.331827 11365 consensus_queue.cc:260] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.332438 11365 ts_tablet_manager.cc:1428] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:19.332747 11365 tablet_bootstrap.cc:492] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.277995 14914 raft_consensus.cc:482] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.333843 14914 raft_consensus.cc:504] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.334115 10907 raft_consensus.cc:3037] T cce9f8fd074348ffb60abcc086ac0519 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.334486 14914 leader_election.cc:288] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.338238 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb185af613d14b53961dbf333a4ddb95" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.339082 15045 tablet.cc:1722] T 10bb259b9721485db9c968763434f67e P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.339694 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb185af613d14b53961dbf333a4ddb95" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.340176 10564 leader_election.cc:341] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.341493 11365 tablet_bootstrap.cc:654] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.330032 11046 leader_election.cc:302] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:19.348069 14677 raft_consensus.cc:2781] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.348266 14884 consensus_queue.cc:1035] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.348814 14677 raft_consensus.cc:686] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:19.349081 14677 consensus_queue.cc:237] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:19.352064 10555 leader_election.cc:341] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.352221 10555 leader_election.cc:302] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.353408 14408 raft_consensus.cc:2726] T fb185af613d14b53961dbf333a4ddb95 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.366079 15045 tablet.cc:1722] T b246b0e53af34c089f4fd67174396f44 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.372509 11365 tablet_bootstrap.cc:492] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.372706 11365 ts_tablet_manager.cc:1397] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.007s
I20260811 06:17:19.373335 15000 tablet.cc:1722] T 75094a86738d42fca39d57f8d90e8af9 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.373596 11046 leader_election.cc:302] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.373754 11365 raft_consensus.cc:348] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.374022 11365 raft_consensus.cc:374] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.374083 11365 raft_consensus.cc:729] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.376120 14884 raft_consensus.cc:2781] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.376253 14884 raft_consensus.cc:686] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:19.376526 14884 consensus_queue.cc:237] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.382221 11365 consensus_queue.cc:260] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.391319 11365 ts_tablet_manager.cc:1428] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260811 06:17:19.396727 11365 tablet_bootstrap.cc:492] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.399117 11365 tablet_bootstrap.cc:654] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.411665 15103 tablet.cc:1722] T ce5f2fa8c64247419f2ca9b26df825b0 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:19.417487 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 3acdca7b00a14095900171ff20918521 (DEFAULT_TABLE table=default.Table_0021f52eda354f048c66f9ea016f1bc4 [id=58ecd3df65df4483bef4a5a69d28b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.418005 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3acdca7b00a14095900171ff20918521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.421233 11362 tablet_bootstrap.cc:492] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.421363 11362 ts_tablet_manager.cc:1397] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.118s user 0.013s sys 0.000s
I20260811 06:17:19.421803 15103 tablet.cc:1722] T 7716cda181d444a99d69cbc9ade3269e P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.423619 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa252c053734bfeb10b442f150981e9 (DEFAULT_TABLE table=default.Table_225e77366fe24f5490c5005f8e3e2f12 [id=225cd7cd704f4fd0bf91215635645605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.423204 10868 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa252c053734bfeb10b442f150981e9 (DEFAULT_TABLE table=default.Table_225e77366fe24f5490c5005f8e3e2f12 [id=225cd7cd704f4fd0bf91215635645605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.424033 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa252c053734bfeb10b442f150981e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.424170 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa252c053734bfeb10b442f150981e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.423374 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 3acdca7b00a14095900171ff20918521 (DEFAULT_TABLE table=default.Table_0021f52eda354f048c66f9ea016f1bc4 [id=58ecd3df65df4483bef4a5a69d28b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.426469 10604 tablet_service.cc:1467] Processing CreateTablet for tablet c8caf02195bd4eca97704079199e05a4 (DEFAULT_TABLE table=default.Table_a989b3d8fb2c4ee1b9cc15262f9b1990 [id=d13b8263488e4d13b1894fe719ce5417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.426908 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8caf02195bd4eca97704079199e05a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.427222 10873 tablet_service.cc:1467] Processing CreateTablet for tablet c8caf02195bd4eca97704079199e05a4 (DEFAULT_TABLE table=default.Table_a989b3d8fb2c4ee1b9cc15262f9b1990 [id=d13b8263488e4d13b1894fe719ce5417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.427731 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8caf02195bd4eca97704079199e05a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.431332 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 946749d4c30041d996c10c96b533b73d (DEFAULT_TABLE table=default.Table_6d83a06b94ae443485f7abda5ed89ccc [id=3564054dc59743e18e63441ab01cbf9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.431747 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946749d4c30041d996c10c96b533b73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.438305 10872 tablet_service.cc:1467] Processing CreateTablet for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1 (DEFAULT_TABLE table=default.Table_2a087e426bd44e0985b5a33be4080232 [id=5e4de5869a644f3389f8eb2e5c974e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.438791 10872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.439150 15098 tablet.cc:1722] T a25b6d0d733c44398a233b595caad8a0 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260811 06:17:19.440032 11047 leader_election.cc:341] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.440925 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd1ae5b2aa341af937691badc7b9258 (DEFAULT_TABLE table=default.Table_3fe9be20185245808f90c1d489877dd7 [id=c03972e7d82e4a8fb80a0dc4c77fb834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.441322 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd1ae5b2aa341af937691badc7b9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.444855 10871 tablet_service.cc:1467] Processing CreateTablet for tablet 53a152cdff0d40a7921e3f31d3276246 (DEFAULT_TABLE table=default.Table_7c8021776ed44b54afcf67dde1816fcb [id=a327a01dfb8d484aa1778648f0ca2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.445461 10871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53a152cdff0d40a7921e3f31d3276246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.438305 10859 tablet_service.cc:1467] Processing CreateTablet for tablet 946749d4c30041d996c10c96b533b73d (DEFAULT_TABLE table=default.Table_6d83a06b94ae443485f7abda5ed89ccc [id=3564054dc59743e18e63441ab01cbf9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.446343 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946749d4c30041d996c10c96b533b73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.447476 10608 tablet_service.cc:1467] Processing CreateTablet for tablet 53a152cdff0d40a7921e3f31d3276246 (DEFAULT_TABLE table=default.Table_7c8021776ed44b54afcf67dde1816fcb [id=a327a01dfb8d484aa1778648f0ca2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.447872 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53a152cdff0d40a7921e3f31d3276246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.449199 10602 tablet_service.cc:1467] Processing CreateTablet for tablet 01669d923f2b4769bd8da8bc1f99cbac (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.449568 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01669d923f2b4769bd8da8bc1f99cbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.450446 10854 tablet_service.cc:1467] Processing CreateTablet for tablet 01669d923f2b4769bd8da8bc1f99cbac (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.450783 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01669d923f2b4769bd8da8bc1f99cbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.452316 10615 tablet_service.cc:1467] Processing CreateTablet for tablet 41f12d4bda13419f9a6b2a8006caadb9 (DEFAULT_TABLE table=default.Table_374d60267ec54905a06d7f77594a68fe [id=a50e305a206543ab8cb6e4a362addc46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.452692 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f12d4bda13419f9a6b2a8006caadb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.454203 10855 tablet_service.cc:1467] Processing CreateTablet for tablet 41f12d4bda13419f9a6b2a8006caadb9 (DEFAULT_TABLE table=default.Table_374d60267ec54905a06d7f77594a68fe [id=a50e305a206543ab8cb6e4a362addc46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.454267 14995 consensus_queue.cc:1035] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.454557 10855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f12d4bda13419f9a6b2a8006caadb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.460045 10620 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd1ae5b2aa341af937691badc7b9258 (DEFAULT_TABLE table=default.Table_3fe9be20185245808f90c1d489877dd7 [id=c03972e7d82e4a8fb80a0dc4c77fb834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.460549 10620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd1ae5b2aa341af937691badc7b9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.463129 10859 tablet_service.cc:1467] Processing CreateTablet for tablet e08a1cec09f6484fbe796e10a3a2b8ec (DEFAULT_TABLE table=default.Table_d08ef9d8d7a4456f84eb7f8a0d3f7b05 [id=b41b89ce637b447ead47c5c6745d3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.465034 10615 tablet_service.cc:1467] Processing CreateTablet for tablet e08a1cec09f6484fbe796e10a3a2b8ec (DEFAULT_TABLE table=default.Table_d08ef9d8d7a4456f84eb7f8a0d3f7b05 [id=b41b89ce637b447ead47c5c6745d3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.465420 10615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08a1cec09f6484fbe796e10a3a2b8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.466001 10604 tablet_service.cc:1467] Processing CreateTablet for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1 (DEFAULT_TABLE table=default.Table_2a087e426bd44e0985b5a33be4080232 [id=5e4de5869a644f3389f8eb2e5c974e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.468782 10604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.474565 10602 tablet_service.cc:1467] Processing CreateTablet for tablet b79ccc886cb9490f9bc642ee1c785240 (DEFAULT_TABLE table=default.Table_e62617e4966e4dfb8e603f9884650338 [id=81c11854b67d4e539406f6573bf8d834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.474577 10873 tablet_service.cc:1467] Processing CreateTablet for tablet b79ccc886cb9490f9bc642ee1c785240 (DEFAULT_TABLE table=default.Table_e62617e4966e4dfb8e603f9884650338 [id=81c11854b67d4e539406f6573bf8d834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.475069 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79ccc886cb9490f9bc642ee1c785240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.476635 11362 raft_consensus.cc:348] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.476853 11362 raft_consensus.cc:374] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.476915 11362 raft_consensus.cc:729] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.477356 10853 tablet_service.cc:1467] Processing CreateTablet for tablet 7af69017da384de8a28bcd184fe21894 (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.479233 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7af69017da384de8a28bcd184fe21894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.483400 11365 tablet_bootstrap.cc:492] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.483566 11365 ts_tablet_manager.cc:1397] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.008s
I20260811 06:17:19.484407 11365 raft_consensus.cc:348] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.484634 11365 raft_consensus.cc:374] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.484694 11365 raft_consensus.cc:729] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.484745 10880 tablet_service.cc:1467] Processing CreateTablet for tablet fba50687dcf7496cb0f527b633b14df7 (DEFAULT_TABLE table=default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.484978 11365 consensus_queue.cc:260] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.485123 10859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08a1cec09f6484fbe796e10a3a2b8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.485369 10880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fba50687dcf7496cb0f527b633b14df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.486495 11365 ts_tablet_manager.cc:1428] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260811 06:17:19.486581 10608 tablet_service.cc:1467] Processing CreateTablet for tablet fba50687dcf7496cb0f527b633b14df7 (DEFAULT_TABLE table=default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.486967 10608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fba50687dcf7496cb0f527b633b14df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.487537 11365 tablet_bootstrap.cc:492] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.489794 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 7af69017da384de8a28bcd184fe21894 (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.491820 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7af69017da384de8a28bcd184fe21894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.492409 11365 tablet_bootstrap.cc:654] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.495796 10873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79ccc886cb9490f9bc642ee1c785240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.505761 11362 consensus_queue.cc:260] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.507754 11362 ts_tablet_manager.cc:1428] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.086s user 0.001s sys 0.001s
I20260811 06:17:19.516458 14455 raft_consensus.cc:482] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.516639 14455 raft_consensus.cc:504] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } }
I20260811 06:17:19.517285 14455 leader_election.cc:288] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.518306 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.518651 10655 raft_consensus.cc:2379] T b8fefa0f4ed44b87825cc34f7ecafcbf P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56a371f7ed104f68a5db9ca097eb237e in current term 1: Already voted for candidate f8dcf15ece3a4389932aa672079442b6 in this term.
I20260811 06:17:19.524032 11362 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.524601 11361 tablet_bootstrap.cc:492] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:19.524762 11361 ts_tablet_manager.cc:1397] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.294s user 0.004s sys 0.037s
I20260811 06:17:19.525610 11362 tablet_bootstrap.cc:654] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.525596 11361 raft_consensus.cc:348] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.525851 11361 raft_consensus.cc:374] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.525916 11361 raft_consensus.cc:729] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.526189 11361 consensus_queue.cc:260] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.526820 11361 ts_tablet_manager.cc:1428] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:19.526925 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.527149 11361 tablet_bootstrap.cc:492] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:19.527158 10655 raft_consensus.cc:2454] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:19.528291 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.528923 10655 raft_consensus.cc:2454] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:19.529484 11361 tablet_bootstrap.cc:654] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:19.533039 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 93010.9us
W20260811 06:17:19.533515 11047 leader_election.cc:341] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:19.534040 11047 leader_election.cc:341] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.534013 14994 consensus_queue.cc:1035] T 511f08c3d4d642368805b6a89743b367 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.535490 14884 consensus_queue.cc:1035] T 2be78c7877934f438ac52e8bf82d145b P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.535822 15045 tablet.cc:1722] T 5fb45a26ce7e4d8c8bf75940a6070752 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:19.547616 10810 consensus_peers.cc:487] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bcc463affbb4154877624aec28435bc. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:19.550334 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fefa0f4ed44b87825cc34f7ecafcbf" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.563210 14994 raft_consensus.cc:482] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.563526 14994 raft_consensus.cc:504] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.564267 14994 leader_election.cc:288] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.565977 10813 leader_election.cc:302] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.566349 14934 raft_consensus.cc:3037] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.567066 11106 tablet_service.cc:1467] Processing CreateTablet for tablet 3acdca7b00a14095900171ff20918521 (DEFAULT_TABLE table=default.Table_0021f52eda354f048c66f9ea016f1bc4 [id=58ecd3df65df4483bef4a5a69d28b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.567562 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3acdca7b00a14095900171ff20918521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.569096 14934 raft_consensus.cc:2726] T b8fefa0f4ed44b87825cc34f7ecafcbf P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.570096 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 3aa252c053734bfeb10b442f150981e9 (DEFAULT_TABLE table=default.Table_225e77366fe24f5490c5005f8e3e2f12 [id=225cd7cd704f4fd0bf91215635645605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.570526 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3aa252c053734bfeb10b442f150981e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.573841 15100 tablet.cc:1722] T b246b0e53af34c089f4fd67174396f44 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.573920 15103 tablet.cc:1722] T 75094a86738d42fca39d57f8d90e8af9 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.589468 11098 tablet_service.cc:1467] Processing CreateTablet for tablet c8caf02195bd4eca97704079199e05a4 (DEFAULT_TABLE table=default.Table_a989b3d8fb2c4ee1b9cc15262f9b1990 [id=d13b8263488e4d13b1894fe719ce5417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.589965 11098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8caf02195bd4eca97704079199e05a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.592832 14889 tablet.cc:1722] T a25b6d0d733c44398a233b595caad8a0 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260811 06:17:19.596719 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1 (DEFAULT_TABLE table=default.Table_2a087e426bd44e0985b5a33be4080232 [id=5e4de5869a644f3389f8eb2e5c974e71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.596920 11110 tablet_service.cc:1467] Processing CreateTablet for tablet 53a152cdff0d40a7921e3f31d3276246 (DEFAULT_TABLE table=default.Table_7c8021776ed44b54afcf67dde1816fcb [id=a327a01dfb8d484aa1778648f0ca2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.597155 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09f1f2eaf5c84de384c4cf2e68e69fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.597368 11121 tablet_service.cc:1467] Processing CreateTablet for tablet 01669d923f2b4769bd8da8bc1f99cbac (DEFAULT_TABLE table=default.Table_b4c6d82b1d1c4c71b873fba5c3190393 [id=117b9366350949ef8c9484e417cdc5da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.597663 11121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01669d923f2b4769bd8da8bc1f99cbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.597757 11094 tablet_service.cc:1467] Processing CreateTablet for tablet 41f12d4bda13419f9a6b2a8006caadb9 (DEFAULT_TABLE table=default.Table_374d60267ec54905a06d7f77594a68fe [id=a50e305a206543ab8cb6e4a362addc46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.598132 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41f12d4bda13419f9a6b2a8006caadb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.600495 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53a152cdff0d40a7921e3f31d3276246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.604759 11094 tablet_service.cc:1467] Processing CreateTablet for tablet e08a1cec09f6484fbe796e10a3a2b8ec (DEFAULT_TABLE table=default.Table_d08ef9d8d7a4456f84eb7f8a0d3f7b05 [id=b41b89ce637b447ead47c5c6745d3457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.605144 11094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08a1cec09f6484fbe796e10a3a2b8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.596719 11096 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd1ae5b2aa341af937691badc7b9258 (DEFAULT_TABLE table=default.Table_3fe9be20185245808f90c1d489877dd7 [id=c03972e7d82e4a8fb80a0dc4c77fb834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.606196 14408 raft_consensus.cc:482] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.606282 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8dd1ae5b2aa341af937691badc7b9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.606330 14408 raft_consensus.cc:504] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.606922 14408 leader_election.cc:288] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.607486 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ff9b65fc804be9a686ad64a3d74ff0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.608042 10564 leader_election.cc:341] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.610360 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 7af69017da384de8a28bcd184fe21894 (DEFAULT_TABLE table=default.Table_57e6d74041d748be8601b9304ae7f2c1 [id=075176298aed4bc18499b2a3863eebdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.610743 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7af69017da384de8a28bcd184fe21894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.614079 11119 tablet_service.cc:1467] Processing CreateTablet for tablet fba50687dcf7496cb0f527b633b14df7 (DEFAULT_TABLE table=default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.614480 11119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fba50687dcf7496cb0f527b633b14df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.622139 11101 tablet_service.cc:1467] Processing CreateTablet for tablet 946749d4c30041d996c10c96b533b73d (DEFAULT_TABLE table=default.Table_6d83a06b94ae443485f7abda5ed89ccc [id=3564054dc59743e18e63441ab01cbf9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.623502 11101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946749d4c30041d996c10c96b533b73d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.624015 11110 tablet_service.cc:1467] Processing CreateTablet for tablet b79ccc886cb9490f9bc642ee1c785240 (DEFAULT_TABLE table=default.Table_e62617e4966e4dfb8e603f9884650338 [id=81c11854b67d4e539406f6573bf8d834]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:19.624374 11110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b79ccc886cb9490f9bc642ee1c785240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.631892 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:19.633103 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7716cda181d444a99d69cbc9ade3269e (table default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c]). Expected version 1 got 0
I20260811 06:17:19.633188 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ff9b65fc804be9a686ad64a3d74ff0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.634151 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 23ca4a89d00242ea98c5b964df27082f (table default.Table_b1633ab525bf4d3381d65de52f568771 [id=776130ee53724d72ba83b985a42f9b54]). Expected version 1 got 0
W20260811 06:17:19.635121 10555 leader_election.cc:341] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.635288 10555 leader_election.cc:302] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.635699 14408 raft_consensus.cc:2726] T f5ff9b65fc804be9a686ad64a3d74ff0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.635902 15133 tablet.cc:1722] T 5fb45a26ce7e4d8c8bf75940a6070752 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.640434 10915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1649493bd0924ee48fd5044d7288932d" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.647258 15064 tablet.cc:1722] T 75094a86738d42fca39d57f8d90e8af9 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.651428 14884 consensus_queue.cc:1035] T b8fefa0f4ed44b87825cc34f7ecafcbf P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.652781 15064 tablet.cc:1722] T b246b0e53af34c089f4fd67174396f44 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:19.655150 11047 leader_election.cc:341] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.658268 11362 tablet_bootstrap.cc:492] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.658430 11362 ts_tablet_manager.cc:1397] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.149s user 0.002s sys 0.000s
I20260811 06:17:19.659158 11362 raft_consensus.cc:348] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.659389 11362 raft_consensus.cc:374] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.659438 11362 raft_consensus.cc:729] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.659618 11362 consensus_queue.cc:260] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.679132 14455 raft_consensus.cc:482] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.679311 14455 raft_consensus.cc:504] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.679551 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:19.679875 14455 leader_election.cc:288] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.682207 11365 tablet_bootstrap.cc:492] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.682332 11046 leader_election.cc:302] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.683635 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5fb45a26ce7e4d8c8bf75940a6070752 (table default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab]). Expected version 1 got 0
I20260811 06:17:19.684558 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.685158 11365 ts_tablet_manager.cc:1397] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.198s user 0.012s sys 0.020s
I20260811 06:17:19.688221 11365 raft_consensus.cc:348] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.688570 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 3de77019fc074a55ab741db336a9fc60 (table default.Table_7abfc2b913e6498a9a9b2c8442c3fcc8 [id=68f45e1274514ff2afe14bbb13d23867]). Expected version 3 got 0
I20260811 06:17:19.689214 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 30cffba93ad74e84812e5879b851119f (table default.Table_e17d8af91df54ff382547bea08d954d2 [id=d2255732f19f4b84828294798d33b5fc]). Expected version 2 got 0
I20260811 06:17:19.689419 11365 raft_consensus.cc:374] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.689554 11365 raft_consensus.cc:729] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.687049 11361 tablet_bootstrap.cc:492] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:19.690352 11361 ts_tablet_manager.cc:1397] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.163s user 0.010s sys 0.005s
I20260811 06:17:19.690464 11046 leader_election.cc:302] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters: 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.691645 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b23c8754701444db93ceb1131a98b1dc (table default.Table_35f27424dfb64652ba634de320305dc7 [id=acef1f14b57e4d5cbb057a937eb783cd]). Expected version 1 got 0
I20260811 06:17:19.690059 11365 consensus_queue.cc:260] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.692854 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:19.694229 11365 ts_tablet_manager.cc:1428] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260811 06:17:19.694823 11362 ts_tablet_manager.cc:1428] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260811 06:17:19.695142 11362 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.695727 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b9855da8111345808ecda0277b6e8dca (table default.Table_690e8cf28c9940afa78b2d3e003d35de [id=37bda7b4398e4e4291743fd7f8826965]). Expected version 1 got 0
I20260811 06:17:19.696322 15138 raft_consensus.cc:482] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.696465 15138 raft_consensus.cc:504] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.696873 11365 tablet_bootstrap.cc:492] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.697016 11362 tablet_bootstrap.cc:654] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.697213 15138 leader_election.cc:288] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.698235 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3acdca7b00a14095900171ff20918521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:19.699102 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (table default.Table_99affff9b5fe49d48a5012cba18e007b [id=4477e6c360934e079e00533d56a91c11]). Expected version 1 got 0
I20260811 06:17:19.699157 14515 fs_manager.cc:709] Time spent opening directory manager: real 0.328s user 0.012s sys 0.028s
I20260811 06:17:19.699540 15145 raft_consensus.cc:2781] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.699647 15145 raft_consensus.cc:482] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.699724 15145 raft_consensus.cc:3037] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.700114 11365 tablet_bootstrap.cc:654] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.700654 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 0a67f283a7a6447daaecc9c03703b977 (table default.Table_9d0168019872459bab51e459df1b7a42 [id=d03f9c97eca5493d804fed87f220ade1]). Expected version 3 got 0
I20260811 06:17:19.701135 14994 raft_consensus.cc:2781] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.701220 14994 raft_consensus.cc:482] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.701280 14994 raft_consensus.cc:3037] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.703598 15145 raft_consensus.cc:504] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.704147 15145 leader_election.cc:288] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.704366 14994 raft_consensus.cc:504] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.704409 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:19.704608 10645 raft_consensus.cc:2454] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:19.705067 10810 leader_election.cc:302] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
W20260811 06:17:19.705209 11046 consensus_peers.cc:487] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2d9627d9f88466ba499aa175151f46a. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:19.705700 14994 leader_election.cc:288] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.710495 11361 raft_consensus.cc:348] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.711484 11361 raft_consensus.cc:374] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.711824 11361 raft_consensus.cc:729] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.712270 11361 consensus_queue.cc:260] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.713680 11361 ts_tablet_manager.cc:1428] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260811 06:17:19.715058 11361 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:19.715637 15064 tablet.cc:1722] T 5fb45a26ce7e4d8c8bf75940a6070752 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.718086 14408 raft_consensus.cc:482] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.718227 14408 raft_consensus.cc:504] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.718842 14408 leader_election.cc:288] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.718922 15152 raft_consensus.cc:2781] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.719020 15152 raft_consensus.cc:482] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.719086 15152 raft_consensus.cc:3037] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.719651 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2558f26ae7424ead9fb43883c81a02a0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.720520 10564 leader_election.cc:341] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.722435 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 8af156c4975d47108000a5bccf21f9f7 (table default.Table_fa8b97325e9b40c4b82252c1090734da [id=4df7e577a0a9424f95a5009e534db476]). Expected version 1 got 0
I20260811 06:17:19.723292 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.723502 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.723605 10655 raft_consensus.cc:3037] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.723671 10661 raft_consensus.cc:3037] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.725278 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet c7e350aaabbe42968eb8afb509bd8f4e (table default.Table_7bdf522454af4d4884e71798bffb78d4 [id=31262d66a31e4a34a9fef4ba1a065cb5]). Expected version 1 got 0
I20260811 06:17:19.726341 10661 raft_consensus.cc:2454] T 3c64c7100ccc4474bb895712f2d01b45 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:19.726475 10655 raft_consensus.cc:2454] T c42f153889c7490ea33002e3a857c631 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
W20260811 06:17:19.726588 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 49549.6us
I20260811 06:17:19.728677 10913 raft_consensus.cc:3037] T b7409453e6e34172870dbb9fb3c5ac44 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.730975 15152 raft_consensus.cc:504] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.732039 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:19.732288 10661 raft_consensus.cc:3037] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.735582 11361 tablet_bootstrap.cc:654] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.736294 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7513bf5f22f84121a77702b1b09e6199 (table default.Table_b35fe6d74f034773b642d52843e43bd3 [id=34e80fdc27064da99e1843979e2fb7b6]). Expected version 2 got 0
I20260811 06:17:19.736460 10661 raft_consensus.cc:2454] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:19.737193 15152 leader_election.cc:288] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.738638 10810 leader_election.cc:302] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e; no voters:
I20260811 06:17:19.739374 15158 raft_consensus.cc:2781] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.740007 15158 raft_consensus.cc:686] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:19.743908 15161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 06:17:19.740285 15158 consensus_queue.cc:237] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.746045 15125 raft_consensus.cc:482] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.746170 15125 raft_consensus.cc:504] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.746734 15125 leader_election.cc:288] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.747547 15125 raft_consensus.cc:482] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.747663 15125 raft_consensus.cc:504] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.748142 15125 leader_election.cc:288] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:19.748976 10810 leader_election.cc:341] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1f48707b4fb746f49eaaf91b5b81e814
W20260811 06:17:19.749851 10810 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 45fc206d95a244e395d19328ae289485
I20260811 06:17:19.750295 14515 fs_manager.cc:725] Time spent opening block manager: real 0.049s user 0.007s sys 0.001s
W20260811 06:17:19.745646 11046 leader_election.cc:341] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1649493bd0924ee48fd5044d7288932d
I20260811 06:17:19.750567 11046 leader_election.cc:302] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:19.751070 14995 raft_consensus.cc:2726] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.750644 14515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data,/tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
uuid: "29fb239be50c4171bdbc75e064555197"
format_stamp: "Formatted at 2026-08-11 06:16:43 on dist-test-slave-cvwc"
I20260811 06:17:19.752820 14994 consensus_queue.cc:1035] T 03f2bd25baf347f7a1ba1b50459d8a97 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.752815 14515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 06:17:19.755744 11046 leader_election.cc:302] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:19.756008 14994 raft_consensus.cc:2781] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.756073 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:19.756145 14994 raft_consensus.cc:686] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:19.756358 14994 consensus_queue.cc:237] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.757409 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c42f153889c7490ea33002e3a857c631" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:19.758325 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c64c7100ccc4474bb895712f2d01b45" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:19.761053 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a707e7a6394e7a916001c0278a97bd" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.761458 11046 leader_election.cc:302] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:19.761886 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.762610 14882 raft_consensus.cc:2781] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.762730 14882 raft_consensus.cc:686] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:19.762941 14882 consensus_queue.cc:237] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.764112 14100 consensus_queue.cc:1035] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.764245 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:19.767671 11365 tablet_bootstrap.cc:492] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.767879 11365 ts_tablet_manager.cc:1397] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.001s
I20260811 06:17:19.768203 11362 tablet_bootstrap.cc:492] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.768342 11362 ts_tablet_manager.cc:1397] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.002s
I20260811 06:17:19.768870 11365 raft_consensus.cc:348] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.769004 11362 raft_consensus.cc:348] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.769214 11362 raft_consensus.cc:374] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.769277 11362 raft_consensus.cc:729] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.769163 11365 raft_consensus.cc:374] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.769512 11365 raft_consensus.cc:729] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.769500 11362 consensus_queue.cc:260] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.769899 11365 consensus_queue.cc:260] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.770083 11362 ts_tablet_manager.cc:1428] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:19.771704 11365 ts_tablet_manager.cc:1428] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:17:19.772492 11362 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.773553 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:19.774188 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1f50ee875a8e4fa3b5738c9660a46c91 (table default.Table_826e7e8816374e1fa8267fa3a90704c9 [id=4fc37a54ea874c138c32769644dbc40c]). Expected version 2 got 0
I20260811 06:17:19.774626 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 2707979dce35428aa7145e9b34959989 (table default.Table_65a5ed2042ec4c04b49fa77f4bb6acf8 [id=4d57ccb25d5547908dc3999aa4142990]). Expected version 1 got 0
I20260811 06:17:19.775547 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 7b815bc117cf46db8250f33e5fec861d (table default.Table_c2df3453e7c04197819a9ddf42b2f6d1 [id=7a092c71e067458baa9826fcf30e8fd0]). Expected version 1 got 0
I20260811 06:17:19.776353 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1168c63178174571907981d4a6ac165f (table default.Table_e8aa31ae81824fd699449a5bfe4ba023 [id=485faa9398f8447398dbdc64b6ef2167]). Expected version 1 got 0
I20260811 06:17:19.777263 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 604cba8a4978479cbb15307aeb45a634 (table default.Table_08b52b87a0494cee8394125422ce0196 [id=66202ac0b7a048699a9794861351f377]). Expected version 1 got 0
I20260811 06:17:19.778945 14408 raft_consensus.cc:482] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.779202 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:19.779093 14408 raft_consensus.cc:504] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.779369 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1eeac19e22034ed3bf1b5cf8d0cd49cc (table default.Table_4f7e2cab315242af8d129fc6b73494be [id=1fe85b48deae4ecd9b50485ea2f47e31]). Expected version 1 got 0
I20260811 06:17:19.779589 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 5f040a4545164a75a1cfe2a203a867d6 (table default.Table_1df9e024defd44ceadab0755bf9eb4f1 [id=c881b1976ebe40dd8dc819e98a1d0581]). Expected version 1 got 0
I20260811 06:17:19.779755 14408 leader_election.cc:288] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.781307 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b24ba5f0434f8b804ec6e8631095b6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.782071 10564 leader_election.cc:341] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.785208 11362 tablet_bootstrap.cc:654] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.795818 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f48707b4fb746f49eaaf91b5b81e814" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.795928 11047 consensus_peers.cc:487] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:19.796064 11159 raft_consensus.cc:2454] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:19.796265 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b24ba5f0434f8b804ec6e8631095b6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.796954 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45fc206d95a244e395d19328ae289485" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.797173 11157 raft_consensus.cc:2454] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
W20260811 06:17:19.797573 10555 leader_election.cc:341] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.797739 10555 leader_election.cc:302] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.798247 14408 raft_consensus.cc:2726] T c7b24ba5f0434f8b804ec6e8631095b6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.798666 14882 consensus_queue.cc:1035] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:19.800283 11047 leader_election.cc:341] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:19.800604 11047 leader_election.cc:341] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.805619 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2558f26ae7424ead9fb43883c81a02a0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.813612 14408 raft_consensus.cc:482] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.813791 14408 raft_consensus.cc:504] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.814378 14408 leader_election.cc:288] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.815165 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92a58686071449082f60d06b91b098c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:19.815867 10564 leader_election.cc:341] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.816596 14515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 06:17:19.818506 14515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 06:17:19.818693 14408 raft_consensus.cc:482] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.818845 14408 raft_consensus.cc:504] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.819432 14408 leader_election.cc:288] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:19.820302 15158 raft_consensus.cc:482] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:19.820354 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a79e23d311a447480c70393259cbfae" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.820514 15158 raft_consensus.cc:504] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:19.821152 10564 leader_election.cc:341] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:19.821919 10810 leader_election.cc:341] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1649493bd0924ee48fd5044d7288932d
I20260811 06:17:19.821601 15158 leader_election.cc:288] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.822535 14515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 06:17:19.825827 11365 tablet_bootstrap.cc:492] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:19.826006 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2d6280a32b6c49f5886fa1ff8745b740 (table default.Table_bc33f4d4731d4f2d97d3b73e083ea78e [id=8652cb1fc38b4b09a06f4e94b33d9125], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2d6280a32b6c49f5886fa1ff8745b740 consensus state has no leader
I20260811 06:17:19.828909 10813 leader_election.cc:302] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.829420 15153 raft_consensus.cc:2726] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.830523 11362 tablet_bootstrap.cc:492] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.830659 11362 ts_tablet_manager.cc:1397] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.000s
I20260811 06:17:19.831312 11362 raft_consensus.cc:348] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.831542 11362 raft_consensus.cc:374] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.831606 11362 raft_consensus.cc:729] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.834437 11361 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
W20260811 06:17:19.835111 10813 leader_election.cc:341] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:19.835515 10813 leader_election.cc:341] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.835882 10813 leader_election.cc:302] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:19.836532 10813 leader_election.cc:302] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
W20260811 06:17:19.837945 10555 leader_election.cc:341] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.838078 10555 leader_election.cc:302] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.838433 14408 raft_consensus.cc:2726] T 2558f26ae7424ead9fb43883c81a02a0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.838810 11365 tablet_bootstrap.cc:654] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.842796 11361 ts_tablet_manager.cc:1397] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.128s user 0.004s sys 0.002s
I20260811 06:17:19.843010 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:19.837695 15153 raft_consensus.cc:2781] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.843241 15153 raft_consensus.cc:482] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.843331 15153 raft_consensus.cc:3037] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.843595 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:19.844213 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet 1ad5b9a7ea964e50a7c9f0f1ec6709f7 (table default.Table_177834d7b9304f4da015488acfeb6ef9 [id=1e63357b8e1e4c769761f84a22125a85]). Expected version 1 got 0
I20260811 06:17:19.844480 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet b246b0e53af34c089f4fd67174396f44 (table default.Table_aa71876da9624e69b0528199afa103d9 [id=9f6bacc2e4664cadb95f3261423ed7bd]). Expected version 1 got 0
I20260811 06:17:19.844900 11684 catalog_manager.cc:5587] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
W20260811 06:17:19.845538 11672 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e18efafb7d44746917564c571171838 consensus state has no leader
I20260811 06:17:19.845854 11672 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 212) took 2960 ms. Trace:
I20260811 06:17:19.846026 11672 rpcz_store.cc:276] 0811 06:17:16.884978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.940350 (+1055372us) service_pool.cc:227] Handling call
0811 06:17:17.940938 (+ 588us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.941143 (+ 205us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:17.941409 (+ 266us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:17.941493 (+ 84us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:18.161851 (+220358us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:19.845706 (+1683855us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.037031 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.037198 (+ 167us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.037207 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:18.037209 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.037401 (+ 192us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.037421 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.037427 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:18.037645 (+ 218us) tablet.cc:699] Row locks acquired
0811 06:17:18.037649 (+ 4us) write_op.cc:260] PREPARE: finished
0811 06:17:18.037709 (+ 60us) write_op.cc:270] Start()
0811 06:17:18.037780 (+ 71us) write_op.cc:276] Timestamp: P: 1786429038037638 usec, L: 0
0811 06:17:18.037785 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.038065 (+ 280us) log.cc:842] Serialized 405 byte log entry
0811 06:17:18.088072 (+ 50007us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.154338 (+ 66266us) write_op.cc:301] APPLY: starting
0811 06:17:18.154362 (+ 24us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.154410 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.154495 (+ 85us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.154604 (+ 109us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.154645 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.154651 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.154957 (+ 306us) log.cc:842] Serialized 23 byte log entry
0811 06:17:18.155041 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.155063 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:18.155071 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.155135 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.155139 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":66170,"apply.run_cpu_time_us":886,"apply.run_wall_time_us":886,"num_ops":1,"prepare.queue_time_us":92758,"prepare.run_cpu_time_us":1278,"prepare.run_wall_time_us":57800,"raft.queue_time_us":49,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":332,"replication_time_us":50254,"thread_start_us":181250,"threads_started":2}]]}
I20260811 06:17:19.846511 15153 raft_consensus.cc:504] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.837796 15152 raft_consensus.cc:2781] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.847798 15152 raft_consensus.cc:482] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.847889 15152 raft_consensus.cc:3037] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.850358 11670 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 216) took 2919 ms. Trace:
I20260811 06:17:19.850869 15152 raft_consensus.cc:504] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.850567 11670 rpcz_store.cc:276] 0811 06:17:16.930708 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.969144 (+1038436us) service_pool.cc:227] Handling call
0811 06:17:17.979548 (+ 10404us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:17.984803 (+ 5255us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:17.987260 (+ 2457us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:17.987348 (+ 88us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:18.265404 (+278056us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:19.850221 (+1584817us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.252697 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.252820 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.252827 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:18.252830 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.252957 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.252970 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.252976 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:18.253049 (+ 73us) tablet.cc:699] Row locks acquired
0811 06:17:18.253052 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.253091 (+ 39us) write_op.cc:270] Start()
0811 06:17:18.253127 (+ 36us) write_op.cc:276] Timestamp: P: 1786429038253054 usec, L: 0
0811 06:17:18.253131 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.253327 (+ 196us) log.cc:842] Serialized 405 byte log entry
0811 06:17:18.257256 (+ 3929us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.262646 (+ 5390us) write_op.cc:301] APPLY: starting
0811 06:17:18.262659 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.262694 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.262726 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.262777 (+ 51us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.262808 (+ 31us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.262813 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:18.262908 (+ 95us) log.cc:842] Serialized 23 byte log entry
0811 06:17:18.265291 (+ 2383us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.265316 (+ 25us) write_op.cc:454] Released schema lock
0811 06:17:18.265324 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.265535 (+ 211us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.265540 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5356,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":2954,"num_ops":1,"prepare.queue_time_us":264868,"prepare.run_cpu_time_us":776,"prepare.run_wall_time_us":9279,"raft.queue_time_us":9860,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":167,"replication_time_us":4113,"thread_start_us":9609,"threads_started":1}]]}
I20260811 06:17:19.851737 11670 master_service.cc:946] ReplaceTablet: received request to replace tablet eca9ef015de946548a39e661d0ce3fa9 from {username='slave'} at 127.0.0.1:52508
W20260811 06:17:19.853688 10810 leader_election.cc:341] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 45fc206d95a244e395d19328ae289485
I20260811 06:17:19.854621 15152 leader_election.cc:288] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:19.854835 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1649493bd0924ee48fd5044d7288932d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:19.855077 11159 raft_consensus.cc:2454] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:19.858194 15153 leader_election.cc:288] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:19.864908 10810 leader_election.cc:341] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1f48707b4fb746f49eaaf91b5b81e814
I20260811 06:17:19.865475 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92a58686071449082f60d06b91b098c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.866546 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a79e23d311a447480c70393259cbfae" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:19.842514 11362 consensus_queue.cc:260] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.869535 11362 ts_tablet_manager.cc:1428] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
W20260811 06:17:19.870064 10555 leader_election.cc:341] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.870292 10555 leader_election.cc:302] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.870792 14408 raft_consensus.cc:2726] T f92a58686071449082f60d06b91b098c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.871414 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45fc206d95a244e395d19328ae289485" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:19.871624 11157 raft_consensus.cc:3037] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.871560 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f48707b4fb746f49eaaf91b5b81e814" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:19.871742 11158 raft_consensus.cc:3037] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:19.872390 10555 leader_election.cc:341] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:19.872522 10555 leader_election.cc:302] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:19.872884 14408 raft_consensus.cc:2726] T 9a79e23d311a447480c70393259cbfae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:19.877900 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet a25b6d0d733c44398a233b595caad8a0 (table default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364]). Expected version 2 got 0
I20260811 06:17:19.878302 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:19.878551 11365 tablet_bootstrap.cc:492] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:19.878698 11365 ts_tablet_manager.cc:1397] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.003s
I20260811 06:17:19.878657 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:19.879889 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:19.880302 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:19.880200 15158 consensus_queue.cc:1035] T 7bcc463affbb4154877624aec28435bc P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:19.880715 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:19.881119 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet ce5f2fa8c64247419f2ca9b26df825b0 (table default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273]). Expected version 2 got 0
I20260811 06:17:19.881125 10813 leader_election.cc:302] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:19.881762 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 75094a86738d42fca39d57f8d90e8af9 (table default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb]). Expected version 1 got 0
I20260811 06:17:19.881865 11365 raft_consensus.cc:348] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.882110 11365 raft_consensus.cc:374] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.882177 11365 raft_consensus.cc:729] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.882596 15158 raft_consensus.cc:2781] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:19.882700 15158 raft_consensus.cc:482] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:19.882786 15158 raft_consensus.cc:3037] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.882628 11663 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:19.885607 15158 raft_consensus.cc:504] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.886736 15158 leader_election.cc:288] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:19.887578 10810 leader_election.cc:341] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 1649493bd0924ee48fd5044d7288932d
I20260811 06:17:19.890350 11365 consensus_queue.cc:260] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:19.892367 11362 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:19.893270 11361 raft_consensus.cc:348] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.896291 11361 raft_consensus.cc:374] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.896556 11361 raft_consensus.cc:729] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.899663 11157 raft_consensus.cc:2454] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:19.901110 11158 raft_consensus.cc:2454] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:19.904372 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1649493bd0924ee48fd5044d7288932d" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:19.904806 11158 raft_consensus.cc:3037] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.910310 11158 raft_consensus.cc:2454] T 1649493bd0924ee48fd5044d7288932d P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:19.911710 10813 leader_election.cc:302] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:19.912349 15153 raft_consensus.cc:2781] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.912487 15153 raft_consensus.cc:686] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:19.913506 11361 consensus_queue.cc:260] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.914268 10813 leader_election.cc:302] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:19.912716 15153 consensus_queue.cc:237] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.917163 11361 ts_tablet_manager.cc:1428] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.074s user 0.000s sys 0.002s
I20260811 06:17:19.920002 11361 tablet_bootstrap.cc:492] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:19.932930 15218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a36d6d06a0cb4489b5014178b9973219)
I20260811 06:17:19.933295 15218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" member_type: VOTER last_known_addr { host: "127.9.203.126" port: 33303 } } peers { permanent_uuid: "a36d6d06a0cb4489b5014178b9973219" member_type: VOTER last_known_addr { host: "127.9.203.125" port: 35327 } } peers { permanent_uuid: "29fb239be50c4171bdbc75e064555197" member_type: VOTER last_known_addr { host: "127.9.203.124" port: 45045 } }
W20260811 06:17:19.935367 11588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260811 06:17:19.936105 11362 tablet_bootstrap.cc:654] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.936317 11715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff4bfd7a38d4d999137c09f50fe4c57" candidate_term: 5 candidate_status { last_received { term: 4 index: 851 } } ignore_live_leader: false dest_uuid: "a36d6d06a0cb4489b5014178b9973219" is_pre_election: true
W20260811 06:17:19.936640 11588 consensus_peers.cc:487] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219 -> Peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Couldn't send request to peer 29fb239be50c4171bdbc75e064555197. Status: Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260811 06:17:19.941812 11365 ts_tablet_manager.cc:1428] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.063s user 0.003s sys 0.000s
I20260811 06:17:19.942162 11365 tablet_bootstrap.cc:492] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:19.942953 15218 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a36d6d06a0cb4489b5014178b9973219 (127.9.203.125:35327), 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045)
I20260811 06:17:19.943872 15045 tablet.cc:1722] T d45055341dab44089b2fc3fe25256073 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.944864 14889 tablet.cc:1722] T d45055341dab44089b2fc3fe25256073 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:19.945655 11004 heartbeater.cc:503] Master 127.9.203.125:35327 was elected leader, sending a full tablet report...
I20260811 06:17:19.949674 11361 tablet_bootstrap.cc:654] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:19.958909 15153 raft_consensus.cc:2781] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.959091 15153 raft_consensus.cc:686] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:19.959355 15153 consensus_queue.cc:237] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:19.962265 10072 leader_election.cc:334] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 29fb239be50c4171bdbc75e064555197 (127.9.203.124:45045): Network error: Client connection negotiation failed: client connection to 127.9.203.124:45045: connect: Connection refused (error 111)
I20260811 06:17:19.962613 10072 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ff4bfd7a38d4d999137c09f50fe4c57; no voters: 29fb239be50c4171bdbc75e064555197, a36d6d06a0cb4489b5014178b9973219
I20260811 06:17:19.962976 15218 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9ff4bfd7a38d4d999137c09f50fe4c57 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260811 06:17:19.982630 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 68372.9us
I20260811 06:17:19.982932 10813 leader_election.cc:302] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:19.983922 15158 raft_consensus.cc:2781] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:19.984059 15158 raft_consensus.cc:686] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:19.984315 15158 consensus_queue.cc:237] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.989382 10910 raft_consensus.cc:3037] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:19.995666 11362 tablet_bootstrap.cc:492] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:19.995675 11361 tablet_bootstrap.cc:492] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:19.995826 11362 ts_tablet_manager.cc:1397] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.104s user 0.004s sys 0.000s
I20260811 06:17:19.995846 11361 ts_tablet_manager.cc:1397] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.076s user 0.000s sys 0.005s
I20260811 06:17:19.996652 11362 raft_consensus.cc:348] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.996927 11362 raft_consensus.cc:374] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.996989 11362 raft_consensus.cc:729] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.996905 11361 raft_consensus.cc:348] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.997162 11362 consensus_queue.cc:260] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:19.997329 11361 raft_consensus.cc:374] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:19.997392 11361 raft_consensus.cc:729] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:19.999290 11361 consensus_queue.cc:260] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.000797 11361 ts_tablet_manager.cc:1428] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260811 06:17:20.017354 15100 tablet.cc:1722] T d45055341dab44089b2fc3fe25256073 P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:20.030791 11365 tablet_bootstrap.cc:654] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.033201 14408 raft_consensus.cc:482] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.033366 14408 raft_consensus.cc:504] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.034070 14408 leader_election.cc:288] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.037467 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed52a1eb610e4e39bbdb69a494c3575c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.038280 10564 leader_election.cc:341] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.038394 11361 tablet_bootstrap.cc:492] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.040535 11361 tablet_bootstrap.cc:654] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.043583 14408 raft_consensus.cc:482] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.043732 14408 raft_consensus.cc:504] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.044312 14408 leader_election.cc:288] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.045189 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e37f51b0b549b7a3e749f7fbe0d03a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.045874 10564 leader_election.cc:341] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.048345 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed52a1eb610e4e39bbdb69a494c3575c" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.048979 10555 leader_election.cc:341] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.049104 10555 leader_election.cc:302] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.049561 14408 raft_consensus.cc:2726] T ed52a1eb610e4e39bbdb69a494c3575c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.051751 11362 ts_tablet_manager.cc:1428] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.056s user 0.002s sys 0.000s
I20260811 06:17:20.052548 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36e37f51b0b549b7a3e749f7fbe0d03a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.053267 11365 tablet_bootstrap.cc:492] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.053426 11365 ts_tablet_manager.cc:1397] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.001s
W20260811 06:17:20.053795 10555 leader_election.cc:341] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.053915 10555 leader_election.cc:302] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.054147 11365 raft_consensus.cc:348] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.054349 11365 raft_consensus.cc:374] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.054399 11365 raft_consensus.cc:729] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.054841 14408 raft_consensus.cc:2726] T 36e37f51b0b549b7a3e749f7fbe0d03a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.057844 11361 tablet_bootstrap.cc:492] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.058001 11361 ts_tablet_manager.cc:1397] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.003s
I20260811 06:17:20.059072 11361 raft_consensus.cc:348] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.059320 11361 raft_consensus.cc:374] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.059378 11361 raft_consensus.cc:729] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.059249 11365 consensus_queue.cc:260] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.059604 11361 consensus_queue.cc:260] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.060163 11365 ts_tablet_manager.cc:1428] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 06:17:20.060354 11361 ts_tablet_manager.cc:1428] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:20.060639 11361 tablet_bootstrap.cc:492] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.065907 11361 tablet_bootstrap.cc:654] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.071015 11362 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:20.072568 11365 tablet_bootstrap.cc:492] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.075434 11365 tablet_bootstrap.cc:654] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.079402 11361 tablet_bootstrap.cc:492] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.079579 11361 ts_tablet_manager.cc:1397] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.006s
I20260811 06:17:20.080870 11361 raft_consensus.cc:348] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.081127 11361 raft_consensus.cc:374] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.081176 11361 raft_consensus.cc:729] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.081445 11361 consensus_queue.cc:260] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.082636 11361 ts_tablet_manager.cc:1428] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 06:17:20.083209 11361 tablet_bootstrap.cc:492] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.089617 11670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet eca9ef015de946548a39e661d0ce3fa9
I20260811 06:17:20.090432 11670 catalog_manager.cc:6565] ReplaceTablet: tablet eca9ef015de946548a39e661d0ce3fa9 deleted and replaced by tablet b6ce5253cb444b14ad42884ea146daf5
I20260811 06:17:20.090647 11670 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:52508 (request call id 229) took 2609 ms. Trace:
I20260811 06:17:20.090904 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet eca9ef015de946548a39e661d0ce3fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ce5253cb444b14ad42884ea146daf5) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.090888 11670 rpcz_store.cc:276] 0811 06:17:17.481180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:19.851462 (+2370282us) service_pool.cc:227] Handling call
0811 06:17:20.090536 (+239074us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.002072 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.002354 (+ 282us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.002364 (+ 10us) write_op.cc:435] Acquired schema lock
0811 06:17:20.002367 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:20.002555 (+ 188us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.002572 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.002578 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:20.002682 (+ 104us) tablet.cc:699] Row locks acquired
0811 06:17:20.002684 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:20.002737 (+ 53us) write_op.cc:270] Start()
0811 06:17:20.002786 (+ 49us) write_op.cc:276] Timestamp: P: 1786429040002679 usec, L: 0
0811 06:17:20.002791 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.003092 (+ 301us) log.cc:842] Serialized 659 byte log entry
0811 06:17:20.076974 (+ 73882us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.088396 (+ 11422us) write_op.cc:301] APPLY: starting
0811 06:17:20.088415 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.088465 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.088493 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.088676 (+ 183us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.088785 (+ 109us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.088791 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:20.088899 (+ 108us) log.cc:842] Serialized 29 byte log entry
0811 06:17:20.089194 (+ 295us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.089218 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:20.089225 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":11367,"mutex_wait_us":97978,"num_ops":2,"prepare.queue_time_us":116469,"prepare.run_cpu_time_us":1166,"prepare.run_wall_time_us":1166,"raft.queue_time_us":5268,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":74149,"threads_started":1}]]}
I20260811 06:17:20.094806 11361 tablet_bootstrap.cc:654] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.094995 11672 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:20.096757 11672 catalog_manager.cc:5495] T 00483ba1f60c4db386e3a7f1d57b921c P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:20.098402 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet eca9ef015de946548a39e661d0ce3fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ce5253cb444b14ad42884ea146daf5) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.097653 11672 catalog_manager.cc:5495] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:20.102634 11672 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:20.103339 11672 catalog_manager.cc:5495] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:20.104483 11672 catalog_manager.cc:5495] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8dcf15ece3a4389932aa672079442b6 (127.9.203.67). New cstate: current_term: 1 leader_uuid: "f8dcf15ece3a4389932aa672079442b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } health_report { overall_health: UNKNOWN } } }
I20260811 06:17:20.105357 11672 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:20.107201 11672 catalog_manager.cc:5587] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:20.107981 11684 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_89a519352be540d6a2b30a854b9ecacd [id=0fa3ffd94a2b495a818c7d2e98491e1a] alter complete (version 1)
I20260811 06:17:20.113154 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet eca9ef015de946548a39e661d0ce3fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6ce5253cb444b14ad42884ea146daf5) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.114208 11679 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_f4976af097324949ac059ce0cab288b4 [id=2c17310139a841fab9f7e4aaed39cc98] alter complete (version 1)
I20260811 06:17:20.115393 15258 tablet_replica.cc:330] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:20.115751 15258 raft_consensus.cc:2229] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.116348 15258 raft_consensus.cc:2258] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.117297 15258 ts_tablet_manager.cc:1905] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.120865 14914 raft_consensus.cc:482] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.121039 14914 raft_consensus.cc:504] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.121999 14914 leader_election.cc:288] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.122138 14914 raft_consensus.cc:482] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.122237 14914 raft_consensus.cc:504] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.122725 14914 leader_election.cc:288] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.124749 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c01d05b8769440d8c7a544c0e9d80b4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.125413 10564 leader_election.cc:341] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.125809 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afbfec0bdf34619bf492d6803c73308" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.126377 10564 leader_election.cc:341] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.131692 15261 tablet_replica.cc:330] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.132297 15261 raft_consensus.cc:2229] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.133915 15261 raft_consensus.cc:2258] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.134845 15261 ts_tablet_manager.cc:1905] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.151530 15261 ts_tablet_manager.cc:1918] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260811 06:17:20.151835 15261 log.cc:1196] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/eca9ef015de946548a39e661d0ce3fa9
I20260811 06:17:20.152374 15261 ts_tablet_manager.cc:1939] T eca9ef015de946548a39e661d0ce3fa9 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.159269 11361 tablet_bootstrap.cc:492] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.159520 11361 ts_tablet_manager.cc:1397] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.076s user 0.006s sys 0.020s
I20260811 06:17:20.160506 11361 raft_consensus.cc:348] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.160869 11361 raft_consensus.cc:374] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.160943 11361 raft_consensus.cc:729] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.161240 11361 consensus_queue.cc:260] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.163196 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]) successfully deleted
I20260811 06:17:20.168135 11361 ts_tablet_manager.cc:1428] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260811 06:17:20.168453 11361 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.174969 14995 consensus_queue.cc:1035] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:20.178754 11361 tablet_bootstrap.cc:654] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.184230 15258 ts_tablet_manager.cc:1918] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260811 06:17:20.184715 15259 tablet_replica.cc:330] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:20.185202 15259 raft_consensus.cc:2229] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.185418 15259 raft_consensus.cc:2258] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.186100 15258 log.cc:1196] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/eca9ef015de946548a39e661d0ce3fa9
I20260811 06:17:20.188516 15258 ts_tablet_manager.cc:1939] T eca9ef015de946548a39e661d0ce3fa9 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:20.190577 11365 tablet_bootstrap.cc:492] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.196623 11365 ts_tablet_manager.cc:1397] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.124s user 0.022s sys 0.017s
I20260811 06:17:20.197187 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]) successfully deleted
I20260811 06:17:20.197486 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5afbfec0bdf34619bf492d6803c73308" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.197468 11365 raft_consensus.cc:348] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.197662 11365 raft_consensus.cc:374] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.197753 11365 raft_consensus.cc:729] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.198002 11365 consensus_queue.cc:260] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.198800 11365 ts_tablet_manager.cc:1428] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:17:20.199326 11365 tablet_bootstrap.cc:492] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.201642 15158 raft_consensus.cc:482] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.201856 15158 raft_consensus.cc:504] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.202500 15158 leader_election.cc:288] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:20.203630 10810 leader_election.cc:341] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:20.205874 11362 tablet_bootstrap.cc:654] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.206528 11365 tablet_bootstrap.cc:654] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.224581 11365 tablet_bootstrap.cc:492] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.225457 11365 ts_tablet_manager.cc:1397] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.002s
I20260811 06:17:20.226763 11365 raft_consensus.cc:348] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.229842 11365 raft_consensus.cc:374] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.229998 11365 raft_consensus.cc:729] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.230329 11365 consensus_queue.cc:260] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.230679 14408 raft_consensus.cc:482] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.231173 14408 raft_consensus.cc:504] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.231778 14408 leader_election.cc:288] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.232532 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3de77019fc074a55ab741db336a9fc60" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.232981 11365 ts_tablet_manager.cc:1428] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260811 06:17:20.233378 10564 leader_election.cc:341] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.235879 15259 ts_tablet_manager.cc:1905] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.238865 11365 tablet_bootstrap.cc:492] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.240896 11365 tablet_bootstrap.cc:654] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.242049 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c01d05b8769440d8c7a544c0e9d80b4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.243533 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3de77019fc074a55ab741db336a9fc60" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.244311 10555 leader_election.cc:341] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.244431 10555 leader_election.cc:302] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.244768 14408 raft_consensus.cc:2726] T 5afbfec0bdf34619bf492d6803c73308 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.245805 10555 leader_election.cc:341] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.245929 10555 leader_election.cc:302] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.246488 14408 raft_consensus.cc:2726] T 7c01d05b8769440d8c7a544c0e9d80b4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.247284 10555 leader_election.cc:341] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.247390 10555 leader_election.cc:302] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.247751 14408 raft_consensus.cc:2726] T 3de77019fc074a55ab741db336a9fc60 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.249490 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e00a72f178f74ca59cc073fe78c99373" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.249734 11158 raft_consensus.cc:2454] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:20.249815 14408 raft_consensus.cc:482] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.249934 14408 raft_consensus.cc:504] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.250531 14408 leader_election.cc:288] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:20.250901 11047 consensus_peers.cc:487] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.250921 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ef5e72bc28740cc95b9b1c6a60d7b5f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.251538 10564 leader_election.cc:341] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.254755 11365 tablet_bootstrap.cc:492] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.254966 11365 ts_tablet_manager.cc:1397] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260811 06:17:20.255961 11365 raft_consensus.cc:348] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.258049 11365 raft_consensus.cc:374] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.258345 11365 raft_consensus.cc:729] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.258931 11365 consensus_queue.cc:260] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.264518 11365 ts_tablet_manager.cc:1428] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260811 06:17:20.266069 11365 tablet_bootstrap.cc:492] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.272297 10913 raft_consensus.cc:3037] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.278689 11365 tablet_bootstrap.cc:654] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.279026 11361 tablet_bootstrap.cc:492] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.279397 11361 ts_tablet_manager.cc:1397] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.111s user 0.007s sys 0.015s
I20260811 06:17:20.282014 11361 raft_consensus.cc:348] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.282349 11361 raft_consensus.cc:374] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.282545 11361 raft_consensus.cc:729] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.282800 11361 consensus_queue.cc:260] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.283595 11361 ts_tablet_manager.cc:1428] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260811 06:17:20.283955 11361 tablet_bootstrap.cc:492] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.285348 15145 raft_consensus.cc:482] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.285463 15145 raft_consensus.cc:504] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.287251 15145 leader_election.cc:288] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.287961 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.288192 10655 raft_consensus.cc:2454] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:20.288691 11046 leader_election.cc:302] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.289024 15145 raft_consensus.cc:2781] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.289101 15145 raft_consensus.cc:482] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.289163 15145 raft_consensus.cc:3037] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.290992 11361 tablet_bootstrap.cc:654] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.293077 14994 raft_consensus.cc:482] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.293231 14994 raft_consensus.cc:504] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.293862 14994 leader_election.cc:288] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:20.294814 11046 leader_election.cc:341] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 3210614ebacf45c89d63413c51c8f923
I20260811 06:17:20.293702 15145 raft_consensus.cc:504] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.296937 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.297144 10655 raft_consensus.cc:3037] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.300223 10655 raft_consensus.cc:2454] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.310352 11046 leader_election.cc:302] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.310694 14994 raft_consensus.cc:2781] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.310810 14994 raft_consensus.cc:686] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.310976 15259 ts_tablet_manager.cc:1918] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260811 06:17:20.311100 15259 log.cc:1196] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/eca9ef015de946548a39e661d0ce3fa9
I20260811 06:17:20.311061 14994 consensus_queue.cc:237] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.311486 15259 ts_tablet_manager.cc:1939] T eca9ef015de946548a39e661d0ce3fa9 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:20.312220 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet eca9ef015de946548a39e661d0ce3fa9 (table default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]) successfully deleted
I20260811 06:17:20.315485 15145 leader_election.cc:288] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.323496 11362 tablet_bootstrap.cc:492] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:20.323751 11362 ts_tablet_manager.cc:1397] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.253s user 0.004s sys 0.002s
I20260811 06:17:20.325145 11362 raft_consensus.cc:348] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.325503 11362 raft_consensus.cc:374] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.325608 11362 raft_consensus.cc:729] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.325937 11362 consensus_queue.cc:260] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.327121 11362 ts_tablet_manager.cc:1428] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 06:17:20.330403 11365 tablet_bootstrap.cc:492] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.330593 11365 ts_tablet_manager.cc:1397] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.009s
I20260811 06:17:20.331774 11365 raft_consensus.cc:348] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.332018 11365 raft_consensus.cc:374] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.332067 11365 raft_consensus.cc:729] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.332284 11365 consensus_queue.cc:260] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.332939 11365 ts_tablet_manager.cc:1428] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:20.338797 11365 tablet_bootstrap.cc:492] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.342887 15145 raft_consensus.cc:482] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.343183 15145 raft_consensus.cc:504] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.345060 11365 tablet_bootstrap.cc:654] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.346923 15145 leader_election.cc:288] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:20.357564 11046 leader_election.cc:341] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 61671753b0964b3987bd3f33226857b7
I20260811 06:17:20.358448 11365 tablet_bootstrap.cc:492] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.358639 11365 ts_tablet_manager.cc:1397] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.001s
I20260811 06:17:20.363025 11365 raft_consensus.cc:348] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.363317 11365 raft_consensus.cc:374] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.363389 11365 raft_consensus.cc:729] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.363660 11365 consensus_queue.cc:260] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.365784 14408 raft_consensus.cc:482] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.365947 14408 raft_consensus.cc:504] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.366504 14408 leader_election.cc:288] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.367996 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4583024f1f79477886a7664a71eecb8a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.368566 10564 leader_election.cc:341] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.371438 11365 ts_tablet_manager.cc:1428] T a25398c10a134356ac21b8a356eba46c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.013s user 0.002s sys 0.002s
I20260811 06:17:20.373237 11365 tablet_bootstrap.cc:492] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.377864 11365 tablet_bootstrap.cc:654] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.394280 15145 consensus_queue.cc:1035] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:20.395095 11365 tablet_bootstrap.cc:492] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.395263 11365 ts_tablet_manager.cc:1397] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20260811 06:17:20.396384 11365 raft_consensus.cc:348] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.396620 11365 raft_consensus.cc:374] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.396667 11365 raft_consensus.cc:729] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.396873 11365 consensus_queue.cc:260] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.397531 11365 ts_tablet_manager.cc:1428] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 06:17:20.397835 11365 tablet_bootstrap.cc:492] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.400537 11365 tablet_bootstrap.cc:654] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.407594 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet eede55349694488b9899ec56a80c8d5b (table default.Table_eea4fffd66b24b51a38504075b4d284a [id=587929f897ff4559a8fc4f15e4346433]). Expected version 1 got 0
I20260811 06:17:20.410858 15145 consensus_queue.cc:1035] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:20.413376 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f1276a6c043948529b7537081e34b257 (table default.Table_94e9469041254852be2c820b5ca5ab2f [id=688e4024d52e40dd9e84aa7a08e8f33a]). Expected version 1 got 0
I20260811 06:17:20.416887 11361 tablet_bootstrap.cc:492] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.417049 11361 ts_tablet_manager.cc:1397] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.133s user 0.021s sys 0.008s
I20260811 06:17:20.417426 11365 tablet_bootstrap.cc:492] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.417683 11365 ts_tablet_manager.cc:1397] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.004s
I20260811 06:17:20.418069 11361 raft_consensus.cc:348] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.418291 11361 raft_consensus.cc:374] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.418349 11361 raft_consensus.cc:729] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.418601 11361 consensus_queue.cc:260] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.419163 11361 ts_tablet_manager.cc:1428] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:20.419015 11365 raft_consensus.cc:348] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.419238 11365 raft_consensus.cc:374] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.419942 11365 raft_consensus.cc:729] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.420153 11365 consensus_queue.cc:260] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.421991 11365 ts_tablet_manager.cc:1428] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260811 06:17:20.422318 11365 tablet_bootstrap.cc:492] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.422924 11361 tablet_bootstrap.cc:492] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.424611 11365 tablet_bootstrap.cc:654] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.425609 11361 tablet_bootstrap.cc:654] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.431213 15145 consensus_queue.cc:1035] T c2c014c792fe4f309d15856f63f47cc9 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:20.435726 10037 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 71576.9us
I20260811 06:17:20.443913 11365 tablet_bootstrap.cc:492] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.444140 11365 ts_tablet_manager.cc:1397] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260811 06:17:20.445019 11365 raft_consensus.cc:348] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.445271 11365 raft_consensus.cc:374] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.445328 11365 raft_consensus.cc:729] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.445545 11365 consensus_queue.cc:260] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.447564 11365 ts_tablet_manager.cc:1428] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:20.448809 11365 tablet_bootstrap.cc:492] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.377522 10913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.404474 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3210614ebacf45c89d63413c51c8f923" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.405970 10918 raft_consensus.cc:3037] T e7a707e7a6394e7a916001c0278a97bd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.406564 10923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "085179a610734942b9dd050ce9cf56d4" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:20.407140 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61671753b0964b3987bd3f33226857b7" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.429936 10922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ef5e72bc28740cc95b9b1c6a60d7b5f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.430473 10905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4583024f1f79477886a7664a71eecb8a" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.463894 11365 tablet_bootstrap.cc:654] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.465559 14408 raft_consensus.cc:482] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.465698 14408 raft_consensus.cc:504] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.466446 14408 leader_election.cc:288] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.468262 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1168c63178174571907981d4a6ac165f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.469102 10564 leader_election.cc:341] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.473675 11365 tablet_bootstrap.cc:492] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.473963 11365 ts_tablet_manager.cc:1397] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.005s
I20260811 06:17:20.474785 15153 raft_consensus.cc:482] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.474813 11365 raft_consensus.cc:348] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.475049 11365 raft_consensus.cc:374] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.475095 11365 raft_consensus.cc:729] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.475050 15153 raft_consensus.cc:504] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.475330 11365 consensus_queue.cc:260] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.475785 15153 leader_election.cc:288] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:20.477000 10810 leader_election.cc:341] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:20.477494 11365 ts_tablet_manager.cc:1428] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:20.478385 11365 tablet_bootstrap.cc:492] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.485088 11365 tablet_bootstrap.cc:654] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.485203 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 6dd4a21086934bd9a64d74075ab41fbe (table default.Table_e748a073117748be8c1442641fca722f [id=7b85de4e62004d3bab802b1878b0722e]). Expected version 2 got 0
I20260811 06:17:20.485534 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet f4ed851746ef4861a624940952796a37 (table default.Table_8e32495bbc6f44fd8b5e684f16ed7c88 [id=f226ec40ad1f4701bb7e6a289a6ca5bd]). Expected version 1 got 0
I20260811 06:17:20.485796 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 4aacb1b4304d4c7f9f4630bf7fcbb0ab (table default.Table_6f37222dddb540a59514bf3552a3b5d1 [id=0f76cb2b3f154167b4fa6a056cdf6fc3]). Expected version 1 got 0
I20260811 06:17:20.485983 11670 catalog_manager.cc:5587] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755) does not have the latest schema for tablet 7e87f192975a484ea038dc6c66fd6bae (table default.Table_ccd7875b455a463e917b1bfddbbf5177 [id=f8872b7a8c2140e3acbb418a770173cc]). Expected version 1 got 0
I20260811 06:17:20.490420 11365 tablet_bootstrap.cc:492] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.490597 11365 ts_tablet_manager.cc:1397] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260811 06:17:20.490916 11683 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_d8f75079304e472b90776fdc30412ed8 [id=313d481f9dff4c88b5611606ebf4faac] alter complete (version 2)
I20260811 06:17:20.491302 11676 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_22419b35407c47a6ae1cc32c15b56e1d [id=4751fa5ee6184aa39890f385e967f8fd] alter complete (version 1)
I20260811 06:17:20.491371 11365 raft_consensus.cc:348] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.491619 11365 raft_consensus.cc:374] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.491668 11365 raft_consensus.cc:729] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.491875 11365 consensus_queue.cc:260] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.493227 11365 ts_tablet_manager.cc:1428] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 06:17:20.493521 11365 tablet_bootstrap.cc:492] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.491130 11672 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_c8a55dfd94684d02b34a85dc6462c22f [id=35e26ca6163d4acdac6cc34f05d420fb] alter complete (version 1)
I20260811 06:17:20.494649 11653 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_d868a0d8395f43fba4fd9381aaf5e93e [id=dcd0a85bedc24ef4b83da3f0786e87ff] alter complete (version 1)
I20260811 06:17:20.495424 11365 tablet_bootstrap.cc:654] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.498199 15153 raft_consensus.cc:482] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.498354 15153 raft_consensus.cc:504] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.499075 15153 leader_election.cc:288] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:20.506498 11361 tablet_bootstrap.cc:492] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.506884 11361 ts_tablet_manager.cc:1397] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.084s user 0.010s sys 0.005s
I20260811 06:17:20.508085 11672 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_9073ee4ab0a549d9aac211766fc56887 [id=1d188ef5750f4c53a794d6fe52d9a273] alter complete (version 2)
I20260811 06:17:20.511472 11653 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_6c84470c4e8e4e0fa09d719f9cbc7f20 [id=3c39ffa2022447068fcc6f6f551a38a6] alter complete (version 1)
I20260811 06:17:20.514086 11365 tablet_bootstrap.cc:492] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.514254 11365 ts_tablet_manager.cc:1397] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260811 06:17:20.515383 11365 raft_consensus.cc:348] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.515831 11365 raft_consensus.cc:374] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.515898 11365 raft_consensus.cc:729] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.516141 11365 consensus_queue.cc:260] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.516834 11365 ts_tablet_manager.cc:1428] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 06:17:20.517107 11365 tablet_bootstrap.cc:492] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.518631 11361 raft_consensus.cc:348] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.522034 11365 tablet_bootstrap.cc:654] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.523213 11361 raft_consensus.cc:374] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.523330 11361 raft_consensus.cc:729] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.523608 11361 consensus_queue.cc:260] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.526849 11361 ts_tablet_manager.cc:1428] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.020s user 0.002s sys 0.002s
I20260811 06:17:20.527251 11361 tablet_bootstrap.cc:492] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
W20260811 06:17:20.528373 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 102) took 2539 ms (client timeout 1000 ms). Trace:
I20260811 06:17:20.529314 14408 raft_consensus.cc:482] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:20.528594 11676 rpcz_store.cc:269] 0811 06:17:17.989115 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.189047 (+199932us) service_pool.cc:227] Handling call
0811 06:17:18.195421 (+ 6374us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:20.528233 (+2332812us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.120064 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.120207 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.120216 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:20.120235 (+ 19us) tablet.cc:660] Decoding operations
0811 06:17:20.120430 (+ 195us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.120447 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.120453 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.120536 (+ 83us) tablet.cc:699] Row locks acquired
0811 06:17:20.120539 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.120588 (+ 49us) write_op.cc:270] Start()
0811 06:17:20.120634 (+ 46us) write_op.cc:276] Timestamp: P: 1786429040120571 usec, L: 0
0811 06:17:20.120639 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.124935 (+ 4296us) log.cc:842] Serialized 356 byte log entry
0811 06:17:20.125193 (+ 258us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:20.147102 (+ 21909us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.147264 (+ 162us) write_op.cc:301] APPLY: starting
0811 06:17:20.147283 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.147328 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.147331 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.147398 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.147445 (+ 47us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.147451 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:20.147597 (+ 146us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.147890 (+ 293us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.147912 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:20.147920 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.148047 (+ 127us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.148051 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34476,"reported_tablets":35,"spinlock_wait_cycles":8200576,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":562,"apply.run_wall_time_us":839,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":1300,"prepare.run_wall_time_us":5232,"raft.queue_time_us":1012,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":26433,"spinlock_wait_cycles":9234816}]]}
I20260811 06:17:20.529453 14408 raft_consensus.cc:504] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.529870 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.530082 14408 leader_election.cc:288] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.530129 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 40c31ffb11484783bca9263c947f37da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.530930 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.530956 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.531155 15258 tablet_replica.cc:330] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:20.531327 15261 tablet_replica.cc:330] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.531349 15258 raft_consensus.cc:2229] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.531533 15258 raft_consensus.cc:2258] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.531534 15261 raft_consensus.cc:2229] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.531891 15261 raft_consensus.cc:2258] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.532222 15258 ts_tablet_manager.cc:1905] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.532294 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97886e07a36049b992a75d99081d32c4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.533921 10564 leader_election.cc:341] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.534368 15261 ts_tablet_manager.cc:1905] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:20.535290 11655 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 101) took 3562 ms (client timeout 1000 ms). Trace:
W20260811 06:17:20.535468 11655 rpcz_store.cc:269] 0811 06:17:16.973018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.012189 (+ 39171us) service_pool.cc:227] Handling call
0811 06:17:17.061909 (+ 49720us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f85d8f 00007f3e4b27a946 00007f3e4b27a675 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:20.535217 (+3473308us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:17.240707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.240869 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.240876 (+ 7us) write_op.cc:435] Acquired schema lock
0811 06:17:17.240879 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:17.241031 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.241046 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.241051 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:17.241166 (+ 115us) tablet.cc:699] Row locks acquired
0811 06:17:17.241169 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:17.241217 (+ 48us) write_op.cc:270] Start()
0811 06:17:17.243898 (+ 2681us) write_op.cc:276] Timestamp: P: 1786429037241175 usec, L: 0
0811 06:17:17.243904 (+ 6us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.351886 (+107982us) log.cc:842] Serialized 907 byte log entry
0811 06:17:17.352543 (+ 657us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:17.369500 (+ 16957us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.401741 (+ 32241us) write_op.cc:301] APPLY: starting
0811 06:17:17.401768 (+ 27us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.401847 (+ 79us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.401849 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.401984 (+ 135us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.402025 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:17.402031 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:17.402143 (+ 112us) log.cc:842] Serialized 29 byte log entry
0811 06:17:17.402609 (+ 466us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.402636 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:17.402645 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.499698 (+ 97053us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.499707 (+ 9us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:17.410506 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:17.410648 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:17.410657 (+ 9us) write_op.cc:435] Acquired schema lock
0811 06:17:17.410659 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:17.410783 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:17.410797 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:17.410802 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:17.410872 (+ 70us) tablet.cc:699] Row locks acquired
0811 06:17:17.410875 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:17.410919 (+ 44us) write_op.cc:270] Start()
0811 06:17:17.410967 (+ 48us) write_op.cc:276] Timestamp: P: 1786429037410864 usec, L: 0
0811 06:17:17.410972 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:17.436834 (+ 25862us) log.cc:842] Serialized 356 byte log entry
0811 06:17:17.437417 (+ 583us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:17.482583 (+ 45166us) op_driver.cc:444] REPLICATION: finished
0811 06:17:17.482671 (+ 88us) write_op.cc:301] APPLY: starting
0811 06:17:17.482691 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:17.482734 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:17.482737 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:17.482806 (+ 69us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:17.482842 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:17.482848 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:17.482948 (+ 100us) log.cc:842] Serialized 23 byte log entry
0811 06:17:17.483019 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.483043 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:17.483051 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:17.483110 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:17.483113 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36103,"reported_tablets":26,"spinlock_wait_cycles":111019904,"child_traces":[["op",{"apply.queue_time_us":32111,"apply.run_cpu_time_us":829,"apply.run_wall_time_us":98084,"num_ops":2,"prepare.queue_time_us":1931,"prepare.run_cpu_time_us":1858,"prepare.run_wall_time_us":112345,"raft.queue_time_us":60,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":297,"replication_time_us":125559,"spinlock_wait_cycles":247795072}],["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":497,"apply.run_wall_time_us":497,"num_ops":1,"prepare.queue_time_us":5164,"prepare.run_cpu_time_us":1383,"prepare.run_wall_time_us":27005,"raft.queue_time_us":69,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":260,"replication_time_us":71580,"spinlock_wait_cycles":58943872}]]}
I20260811 06:17:20.536830 11655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_9cba92820384428c9888d5fb5b4bbc4b" } modify_external_catalogs: true
I20260811 06:17:20.537053 11655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_9cba92820384428c9888d5fb5b4bbc4b" } modify_external_catalogs: true
W20260811 06:17:20.539893 11683 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 95) took 3029 ms (client timeout 1000 ms). Trace:
I20260811 06:17:20.540985 15261 ts_tablet_manager.cc:1918] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.541047 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.541190 15261 log.cc:1196] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/f6f682f675c344b6b5955e834f94091f
I20260811 06:17:20.541270 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet 02bb2819d9cc4880803ef959c131b9ac with delete_type TABLET_DATA_DELETED (replaced by tablet 8af156c4975d47108000a5bccf21f9f7) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.541348 11365 tablet_bootstrap.cc:492] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.541458 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.541471 11365 ts_tablet_manager.cc:1397] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.006s
I20260811 06:17:20.541687 15261 ts_tablet_manager.cc:1939] T f6f682f675c344b6b5955e834f94091f P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.541653 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 3210614ebacf45c89d63413c51c8f923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.542276 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.542296 11365 raft_consensus.cc:348] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.542532 11365 raft_consensus.cc:374] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.542600 11365 raft_consensus.cc:729] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.542589 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.542824 11365 consensus_queue.cc:260] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:17:20.543494 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 because the tablet was not found. No further retry: Not found: Tablet not found: bc0ec3b040cd4a54a7919a15f8eb5da7
W20260811 06:17:20.543824 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 40c31ffb11484783bca9263c947f37da because the tablet was not found. No further retry: Not found: Tablet not found: 40c31ffb11484783bca9263c947f37da
I20260811 06:17:20.543900 15261 tablet_replica.cc:330] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.544034 11365 ts_tablet_manager.cc:1428] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 06:17:20.544299 11365 tablet_bootstrap.cc:492] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.544322 15261 raft_consensus.cc:2229] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.544770 15261 raft_consensus.cc:2258] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.545694 15261 ts_tablet_manager.cc:1905] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.546471 15258 ts_tablet_manager.cc:1918] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.546645 15258 log.cc:1196] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/085179a610734942b9dd050ce9cf56d4
I20260811 06:17:20.547006 15258 ts_tablet_manager.cc:1939] T 085179a610734942b9dd050ce9cf56d4 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
I20260811 06:17:20.547781 11365 tablet_bootstrap.cc:654] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.547819 11672 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_5370d92e09cb4fe4bcd141b66bc50f1e [id=832a83a4d4ba4f26a9437c48bb0c7c3c] alter complete (version 1)
I20260811 06:17:20.549520 11663 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_90ce61ad47934df68a1e8f9dda9ea09d [id=1e600dca3e674ce18101f1005808f016] alter complete (version 2)
I20260811 06:17:20.553985 15261 ts_tablet_manager.cc:1918] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.556440 15261 log.cc:1196] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c2527862e75b42aa9091456b0f5f994e
I20260811 06:17:20.557090 15261 ts_tablet_manager.cc:1939] T c2527862e75b42aa9091456b0f5f994e P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.559621 14408 raft_consensus.cc:482] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.559785 14408 raft_consensus.cc:504] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.560467 14408 leader_election.cc:288] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.562994 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a67f283a7a6447daaecc9c03703b977" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.563719 10564 leader_election.cc:341] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.565869 11362 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
W20260811 06:17:20.553706 11653 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.67:39037 (request call id 96) took 2008 ms (client timeout 1000 ms). Trace:
I20260811 06:17:20.569036 11362 tablet_bootstrap.cc:654] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.566094 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet f6f682f675c344b6b5955e834f94091f (table default.Table_aecd4ad372f24176971a2c21bd9af268 [id=c2d109e3ad464e859595ceb53aac54cf]) successfully deleted
W20260811 06:17:20.569522 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 4124f64656614c91b7d9115c2efbecd1 because the tablet was not found. No further retry: Not found: Tablet not found: 4124f64656614c91b7d9115c2efbecd1
I20260811 06:17:20.430562 10813 leader_election.cc:302] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:20.570176 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet c2527862e75b42aa9091456b0f5f994e (table default.Table_ac3235af8d1f42d29a220ec551aa448a [id=3b92a2f628794cb3827f5015816baa11]) successfully deleted
I20260811 06:17:20.570226 15153 raft_consensus.cc:2781] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.570314 15153 raft_consensus.cc:482] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.570385 15153 raft_consensus.cc:3037] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.571472 11101 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.571663 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.571758 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.571947 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.572140 11110 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 with delete_type TABLET_DATA_DELETED (replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.572304 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.572722 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.572786 15261 tablet_replica.cc:330] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.573045 15261 raft_consensus.cc:2229] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.573227 15261 raft_consensus.cc:2258] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.573396 15153 raft_consensus.cc:504] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.573925 15261 ts_tablet_manager.cc:1905] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.574558 15153 leader_election.cc:288] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:20.574913 10810 leader_election.cc:341] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: e00a72f178f74ca59cc073fe78c99373
W20260811 06:17:20.575212 10813 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.67:46797, user_credentials={real_user=slave}} blocked reactor thread for 144672us
I20260811 06:17:20.559777 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet 085179a610734942b9dd050ce9cf56d4 (table default.Table_d1ddabd0a6e648f2b4034f0e44abeb6a [id=44dd0d87ba974468ba238d0d4a891b34]) successfully deleted
W20260811 06:17:20.576519 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 4124f64656614c91b7d9115c2efbecd1 because the tablet was not found. No further retry: Not found: Tablet not found: 4124f64656614c91b7d9115c2efbecd1
W20260811 06:17:20.576757 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 02bb2819d9cc4880803ef959c131b9ac because the tablet was not found. No further retry: Not found: Tablet not found: 02bb2819d9cc4880803ef959c131b9ac
W20260811 06:17:20.577073 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because the tablet was not found. No further retry: Not found: Tablet not found: 61671753b0964b3987bd3f33226857b7
W20260811 06:17:20.577344 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 3210614ebacf45c89d63413c51c8f923 because the tablet was not found. No further retry: Not found: Tablet not found: 3210614ebacf45c89d63413c51c8f923
W20260811 06:17:20.577766 10555 leader_election.cc:341] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.577910 10555 leader_election.cc:302] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.578138 14408 raft_consensus.cc:2726] T 3ef5e72bc28740cc95b9b1c6a60d7b5f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.567706 11653 rpcz_store.cc:269] 0811 06:17:18.545271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:18.573439 (+ 28168us) service_pool.cc:227] Handling call
0811 06:17:20.553653 (+1980214us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:19.289915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:19.290098 (+ 183us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:19.290106 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:19.290108 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:19.290491 (+ 383us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:19.290509 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:19.290514 (+ 5us) tablet.cc:683] Acquiring locks for 6 operations
0811 06:17:19.290723 (+ 209us) tablet.cc:699] Row locks acquired
0811 06:17:19.290726 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:19.290784 (+ 58us) write_op.cc:270] Start()
0811 06:17:19.290830 (+ 46us) write_op.cc:276] Timestamp: P: 1786429039290746 usec, L: 0
0811 06:17:19.290834 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:19.291148 (+ 314us) log.cc:842] Serialized 2416 byte log entry
0811 06:17:19.300229 (+ 9081us) op_driver.cc:444] REPLICATION: finished
0811 06:17:19.300387 (+ 158us) write_op.cc:301] APPLY: starting
0811 06:17:19.300406 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:19.300531 (+ 125us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:19.300600 (+ 69us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:19.300961 (+ 361us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:19.301011 (+ 50us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0811 06:17:19.301019 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:19.301177 (+ 158us) log.cc:842] Serialized 53 byte log entry
0811 06:17:19.301256 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.301286 (+ 30us) write_op.cc:454] Released schema lock
0811 06:17:19.301296 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:19.301359 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.301362 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:19.306942 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:19.307053 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:19.307059 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:19.307061 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:19.307169 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:19.307184 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:19.307189 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:19.307256 (+ 67us) tablet.cc:699] Row locks acquired
0811 06:17:19.307259 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:19.307292 (+ 33us) write_op.cc:270] Start()
0811 06:17:19.307325 (+ 33us) write_op.cc:276] Timestamp: P: 1786429039307259 usec, L: 0
0811 06:17:19.307329 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:19.307694 (+ 365us) log.cc:842] Serialized 356 byte log entry
0811 06:17:19.319011 (+ 11317us) op_driver.cc:444] REPLICATION: finished
0811 06:17:19.319197 (+ 186us) write_op.cc:301] APPLY: starting
0811 06:17:19.319220 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:19.319272 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:19.319320 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:19.319392 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:19.319433 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:19.319440 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:19.319539 (+ 99us) log.cc:842] Serialized 23 byte log entry
0811 06:17:19.319613 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.319640 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:19.319648 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:19.319710 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.319715 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0811 06:17:20.498317 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.498426 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.498431 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:20.498433 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:20.498549 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.498558 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.498563 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.498616 (+ 53us) tablet.cc:699] Row locks acquired
0811 06:17:20.498619 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.498651 (+ 32us) write_op.cc:270] Start()
0811 06:17:20.498679 (+ 28us) write_op.cc:276] Timestamp: P: 1786429040498602 usec, L: 0
0811 06:17:20.498683 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.498827 (+ 144us) log.cc:842] Serialized 356 byte log entry
0811 06:17:20.506138 (+ 7311us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.507036 (+ 898us) write_op.cc:301] APPLY: starting
0811 06:17:20.507048 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.507085 (+ 37us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.507112 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.507233 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.507266 (+ 33us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.507273 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:20.507385 (+ 112us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.507429 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.507446 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:20.507452 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.507504 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.507507 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26280,"reported_tablets":56,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":1036,"apply.run_wall_time_us":1036,"num_ops":6,"prepare.queue_time_us":835,"prepare.run_cpu_time_us":1377,"prepare.run_wall_time_us":1377,"raft.queue_time_us":1273,"raft.run_cpu_time_us":706,"raft.run_wall_time_us":706,"replication_time_us":9364}],["op",{"apply.queue_time_us":127,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":577,"num_ops":1,"prepare.queue_time_us":835,"prepare.run_cpu_time_us":868,"prepare.run_wall_time_us":868,"raft.queue_time_us":418,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":8,"replication_time_us":11648}],["op",{"apply.queue_time_us":867,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":511,"num_ops":1,"prepare.queue_time_us":1217,"prepare.run_cpu_time_us":787,"prepare.run_wall_time_us":19297,"raft.queue_time_us":1019,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":7441,"thread_start_us":18676,"threads_started":1}]]}
I20260811 06:17:20.580757 15261 ts_tablet_manager.cc:1918] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.580976 15261 log.cc:1196] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/32407c8872464da2b1470a8ae21c86fd
W20260811 06:17:20.540040 11683 rpcz_store.cc:269] 0811 06:17:17.510824 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.887521 (+376697us) service_pool.cc:227] Handling call
0811 06:17:18.603270 (+715749us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.603287 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:20.539853 (+1936566us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.581061 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.581205 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.581211 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:18.581214 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.581420 (+ 206us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.581436 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.581441 (+ 5us) tablet.cc:683] Acquiring locks for 4 operations
0811 06:17:18.581551 (+ 110us) tablet.cc:699] Row locks acquired
0811 06:17:18.581553 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:18.581589 (+ 36us) write_op.cc:270] Start()
0811 06:17:18.581622 (+ 33us) write_op.cc:276] Timestamp: P: 1786429038581571 usec, L: 0
0811 06:17:18.581626 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.581912 (+ 286us) log.cc:842] Serialized 1662 byte log entry
0811 06:17:18.590703 (+ 8791us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.590807 (+ 104us) write_op.cc:301] APPLY: starting
0811 06:17:18.590827 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.590933 (+ 106us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.590997 (+ 64us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.591095 (+ 98us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.591132 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0811 06:17:18.591138 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.591311 (+ 173us) log.cc:842] Serialized 41 byte log entry
0811 06:17:18.591383 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.591410 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:18.591418 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0811 06:17:18.934322 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.934507 (+ 185us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.934515 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:18.934517 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:18.934703 (+ 186us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.934721 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.934727 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:18.934805 (+ 78us) tablet.cc:699] Row locks acquired
0811 06:17:18.934807 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:18.934855 (+ 48us) write_op.cc:270] Start()
0811 06:17:18.934896 (+ 41us) write_op.cc:276] Timestamp: P: 1786429038934800 usec, L: 0
0811 06:17:18.934900 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.935136 (+ 236us) log.cc:842] Serialized 356 byte log entry
0811 06:17:19.239923 (+304787us) op_driver.cc:444] REPLICATION: finished
0811 06:17:19.240195 (+ 272us) write_op.cc:301] APPLY: starting
0811 06:17:19.240215 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:19.240264 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:19.240301 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:19.240366 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:19.240402 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:19.240407 (+ 5us) write_op.cc:312] APPLY: finished
0811 06:17:19.240506 (+ 99us) log.cc:842] Serialized 23 byte log entry
0811 06:17:19.240580 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.240601 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:19.240610 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:19.240671 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.240675 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":132,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":677,"apply.run_wall_time_us":677,"num_ops":4,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":977,"prepare.run_wall_time_us":1337,"raft.queue_time_us":121,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":249,"replication_time_us":9048}],["op",{"apply.queue_time_us":218,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":538,"num_ops":1,"prepare.queue_time_us":11546,"prepare.run_cpu_time_us":911,"prepare.run_wall_time_us":1399,"raft.queue_time_us":40,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":304996}]]}
I20260811 06:17:20.582229 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.583061 15261 ts_tablet_manager.cc:1939] T 32407c8872464da2b1470a8ae21c86fd P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
W20260811 06:17:20.583503 11047 leader_election.cc:341] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:20.583837 11047 leader_election.cc:341] T 085179a610734942b9dd050ce9cf56d4 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.584385 15261 tablet_replica.cc:330] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.584648 15261 raft_consensus.cc:2229] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.584864 15261 raft_consensus.cc:2258] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.585474 15261 ts_tablet_manager.cc:1905] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:20.586265 11047 leader_election.cc:341] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.586426 11047 leader_election.cc:302] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
W20260811 06:17:20.587049 10555 leader_election.cc:341] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.587208 10555 leader_election.cc:302] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.587453 14408 raft_consensus.cc:2726] T 4583024f1f79477886a7664a71eecb8a P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.590874 10645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.592464 14884 raft_consensus.cc:2726] T 61671753b0964b3987bd3f33226857b7 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.600596 15261 ts_tablet_manager.cc:1918] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.601521 15261 log.cc:1196] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/79f307f50e044435be880079219170d8
I20260811 06:17:20.602360 15261 ts_tablet_manager.cc:1939] T 79f307f50e044435be880079219170d8 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.602478 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d64ea5000504cbd82ecedcf5f6b78a9" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.603729 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e00a72f178f74ca59cc073fe78c99373" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:20.603955 11163 raft_consensus.cc:3037] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.604619 15261 tablet_replica.cc:330] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.606464 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 32407c8872464da2b1470a8ae21c86fd (table default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]) successfully deleted
I20260811 06:17:20.606665 11365 tablet_bootstrap.cc:492] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.606819 11365 ts_tablet_manager.cc:1397] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.017s
I20260811 06:17:20.607340 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 79f307f50e044435be880079219170d8 (table default.Table_02a8e77ed1244d0fad74b7f3de65575a [id=52e1833445374d2597286469e41bc14b]) successfully deleted
I20260811 06:17:20.614027 14995 raft_consensus.cc:482] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.614321 14995 raft_consensus.cc:504] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.614629 10921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97886e07a36049b992a75d99081d32c4" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.615188 14995 leader_election.cc:288] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.617157 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.617494 10661 raft_consensus.cc:2454] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:20.618103 11046 leader_election.cc:302] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.618359 15261 raft_consensus.cc:2229] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.618628 14995 raft_consensus.cc:2781] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.618659 15261 raft_consensus.cc:2258] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.618813 14995 raft_consensus.cc:482] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.619043 14995 raft_consensus.cc:3037] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.619977 10905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a67f283a7a6447daaecc9c03703b977" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.620983 11365 raft_consensus.cc:348] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.621323 11365 raft_consensus.cc:374] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.621385 11365 raft_consensus.cc:729] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.625810 14408 raft_consensus.cc:482] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.626013 14408 raft_consensus.cc:504] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.626705 14408 leader_election.cc:288] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:20.628727 10555 leader_election.cc:341] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.628861 10555 leader_election.cc:302] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
W20260811 06:17:20.629408 10813 leader_election.cc:341] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Not found: Tablet not found: 32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:20.629540 10813 leader_election.cc:302] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.629757 15158 raft_consensus.cc:2726] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.629752 14408 raft_consensus.cc:2726] T 97886e07a36049b992a75d99081d32c4 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.630369 10555 leader_election.cc:341] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.630508 10555 leader_election.cc:302] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.630692 15337 raft_consensus.cc:2726] T 0a67f283a7a6447daaecc9c03703b977 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.630679 10813 leader_election.cc:302] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e; no voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.630868 15158 raft_consensus.cc:2726] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 06:17:20.631592 10905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52344eea7d3548feb9949beb09b34492" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.632119 10555 leader_election.cc:341] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.633271 11365 consensus_queue.cc:260] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.634169 11365 ts_tablet_manager.cc:1428] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20260811 06:17:20.641695 11365 tablet_bootstrap.cc:492] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.642424 15158 raft_consensus.cc:482] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.642589 15158 raft_consensus.cc:504] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.643221 15158 leader_election.cc:288] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
I20260811 06:17:20.644593 15342 tablet.cc:1722] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:20.645900 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1168c63178174571907981d4a6ac165f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.646870 10810 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 02bb2819d9cc4880803ef959c131b9ac
W20260811 06:17:20.647660 10555 leader_election.cc:341] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.647791 10555 leader_election.cc:302] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.648164 15337 raft_consensus.cc:2726] T 1168c63178174571907981d4a6ac165f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.653584 14100 raft_consensus.cc:482] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260811 06:17:20.655681 11047 leader_election.cc:341] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.656359 11163 raft_consensus.cc:2454] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:20.658083 11047 leader_election.cc:302] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:20.656467 15261 ts_tablet_manager.cc:1905] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.658584 14994 raft_consensus.cc:2726] T 3210614ebacf45c89d63413c51c8f923 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.658419 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 51165.3us
I20260811 06:17:20.659857 10813 leader_election.cc:302] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:20.660167 15158 raft_consensus.cc:2781] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.660285 15158 raft_consensus.cc:686] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:20.660509 15158 consensus_queue.cc:237] T e00a72f178f74ca59cc073fe78c99373 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.656689 11157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52344eea7d3548feb9949beb09b34492" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.657035 14882 raft_consensus.cc:482] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.663383 14882 raft_consensus.cc:504] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.664248 14882 leader_election.cc:288] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.657135 14100 raft_consensus.cc:504] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.664716 10654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.664875 14100 leader_election.cc:288] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.664980 10654 raft_consensus.cc:2454] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:20.665359 10564 leader_election.cc:341] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.665481 10564 leader_election.cc:302] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.666170 11046 leader_election.cc:302] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.666483 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.666848 10655 raft_consensus.cc:2379] T f4ed851746ef4861a624940952796a37 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8dcf15ece3a4389932aa672079442b6 in current term 1: Already voted for candidate 56a371f7ed104f68a5db9ca097eb237e in this term.
I20260811 06:17:20.667268 15337 raft_consensus.cc:2726] T 52344eea7d3548feb9949beb09b34492 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.657361 14995 raft_consensus.cc:504] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.657953 11361 tablet_bootstrap.cc:654] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.668861 14995 leader_election.cc:288] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.670733 11362 tablet_bootstrap.cc:492] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:20.671028 11362 ts_tablet_manager.cc:1397] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.006s
I20260811 06:17:20.672309 15261 ts_tablet_manager.cc:1918] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.672601 15261 log.cc:1196] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/7bcc463affbb4154877624aec28435bc
I20260811 06:17:20.673415 15261 ts_tablet_manager.cc:1939] T 7bcc463affbb4154877624aec28435bc P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.673733 15340 tablet.cc:1722] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:20.676935 11365 tablet_bootstrap.cc:654] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.678051 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_525aee396dc64b5c8c61da99ad866f4a" } modify_external_catalogs: true
I20260811 06:17:20.678300 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_525aee396dc64b5c8c61da99ad866f4a" } modify_external_catalogs: true
I20260811 06:17:20.679994 11653 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_4b4b2a4be06e4c8dab03f2c2c8ed2a81" } new_table_name: "default.Table_974c0dab73cb47b9b9dc23da561cc49a" modify_external_catalogs: true
I20260811 06:17:20.686633 11362 raft_consensus.cc:348] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.686877 11362 raft_consensus.cc:374] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.686928 11362 raft_consensus.cc:729] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.687139 11362 consensus_queue.cc:260] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.687876 11362 ts_tablet_manager.cc:1428] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260811 06:17:20.688163 11362 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:20.693739 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.695616 11684 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_2688b9dc1ae346318cf1c1f4fea6f6ff [id=96779515e5d244168d9008c60764f9fd] alter complete (version 1)
I20260811 06:17:20.698839 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02bb2819d9cc4880803ef959c131b9ac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.701282 11158 raft_consensus.cc:2454] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 0.
I20260811 06:17:20.701629 14995 raft_consensus.cc:2781] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.701779 14995 raft_consensus.cc:482] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.701858 14995 raft_consensus.cc:3037] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.703856 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.704070 10655 raft_consensus.cc:3037] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.705389 14995 raft_consensus.cc:504] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.706156 14995 leader_election.cc:288] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.706923 10655 raft_consensus.cc:2454] T e7dc9bfb0c444d799b18c3e647b186fa P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.708695 11361 tablet_bootstrap.cc:492] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.708835 11361 ts_tablet_manager.cc:1397] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.182s user 0.001s sys 0.004s
I20260811 06:17:20.710906 11046 leader_election.cc:302] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.711344 15145 raft_consensus.cc:2781] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.711459 15145 raft_consensus.cc:686] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.711668 15145 consensus_queue.cc:237] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:20.712718 11047 consensus_peers.cc:487] T 231bbec61fa247ef97b090f6a180b737 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260811 06:17:20.713209 11047 consensus_peers.cc:487] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 -> Peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Couldn't send request to peer 56a371f7ed104f68a5db9ca097eb237e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.714649 11365 tablet_bootstrap.cc:492] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.714561 11361 raft_consensus.cc:348] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.714743 11361 raft_consensus.cc:374] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.714789 11361 raft_consensus.cc:729] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.714792 11365 ts_tablet_manager.cc:1397] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.000s
I20260811 06:17:20.714995 11361 consensus_queue.cc:260] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.715457 11365 raft_consensus.cc:348] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.715655 11365 raft_consensus.cc:374] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.715705 11365 raft_consensus.cc:729] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.715739 11361 ts_tablet_manager.cc:1428] T ed52a1eb610e4e39bbdb69a494c3575c P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260811 06:17:20.715953 11365 consensus_queue.cc:260] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.716657 11365 ts_tablet_manager.cc:1428] T 5195c4d7b09d45b8873575e1f67a5cb3 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:20.717330 11365 tablet_bootstrap.cc:492] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
W20260811 06:17:20.718734 10810 consensus_peers.cc:487] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f48707b4fb746f49eaaf91b5b81e814. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.719184 11365 tablet_bootstrap.cc:654] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.722249 11361 tablet_bootstrap.cc:492] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.722283 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_08562628f460412fbbe8b7b6a32bcba3 [id=f745406e98324e04bd0bdcb4baad9364] alter complete (version 2)
I20260811 06:17:20.727216 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.729141 10655 raft_consensus.cc:3037] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.731964 11365 tablet_bootstrap.cc:492] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.732117 11365 ts_tablet_manager.cc:1397] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260811 06:17:20.732983 11365 raft_consensus.cc:348] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.733203 11365 raft_consensus.cc:374] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.733265 11365 raft_consensus.cc:729] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.733748 11361 tablet_bootstrap.cc:654] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.733546 11365 consensus_queue.cc:260] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.734674 14994 raft_consensus.cc:482] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.734805 14994 raft_consensus.cc:504] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.735409 14994 leader_election.cc:288] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.735468 11365 ts_tablet_manager.cc:1428] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 06:17:20.735980 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.736966 10661 raft_consensus.cc:2454] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
W20260811 06:17:20.737025 11047 leader_election.cc:341] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.737444 11046 leader_election.cc:302] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.737780 14994 raft_consensus.cc:2781] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.737857 14994 raft_consensus.cc:482] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.737916 14994 raft_consensus.cc:3037] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.740638 14994 raft_consensus.cc:504] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.741897 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.742147 10661 raft_consensus.cc:3037] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.745304 10661 raft_consensus.cc:2454] T 8ad42cef6aad49a1932bf1e9b20e169c P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.746115 11046 leader_election.cc:302] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.746402 14995 raft_consensus.cc:2781] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.746517 14995 raft_consensus.cc:686] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.746732 14995 consensus_queue.cc:237] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:20.748672 10810 consensus_peers.cc:487] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45fc206d95a244e395d19328ae289485. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.750603 14994 leader_election.cc:288] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.751641 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.752381 11362 tablet_bootstrap.cc:654] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.735737 11365 tablet_bootstrap.cc:492] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.756817 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4ed851746ef4861a624940952796a37" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.759161 11365 tablet_bootstrap.cc:654] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.761989 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7dc9bfb0c444d799b18c3e647b186fa" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:20.766333 15337 raft_consensus.cc:482] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.766491 15337 raft_consensus.cc:504] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.767120 15337 leader_election.cc:288] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.768182 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4734a689aa4eeca4c0bbbab7efd1d0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.768905 10564 leader_election.cc:341] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.769896 10655 raft_consensus.cc:2454] T 00206b4e8c99424c9f1c4ba39fe51c82 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.771730 11046 leader_election.cc:302] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.772109 15145 raft_consensus.cc:2781] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.772235 15145 raft_consensus.cc:686] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.772488 15145 consensus_queue.cc:237] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.772483 11361 tablet_bootstrap.cc:492] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:20.773967 11361 ts_tablet_manager.cc:1397] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.004s
I20260811 06:17:20.775877 11361 raft_consensus.cc:348] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.776244 11361 raft_consensus.cc:374] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.776360 11361 raft_consensus.cc:729] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.776633 11361 consensus_queue.cc:260] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.777390 11361 ts_tablet_manager.cc:1428] T 2558f26ae7424ead9fb43883c81a02a0 P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260811 06:17:20.777935 11361 tablet_bootstrap.cc:492] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:20.780025 11361 tablet_bootstrap.cc:654] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.771731 15261 tablet_replica.cc:330] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.781112 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa4734a689aa4eeca4c0bbbab7efd1d0" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.781895 11365 tablet_bootstrap.cc:492] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:20.782042 11365 ts_tablet_manager.cc:1397] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20260811 06:17:20.782788 11365 raft_consensus.cc:348] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.783018 11365 raft_consensus.cc:374] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.783079 11365 raft_consensus.cc:729] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
W20260811 06:17:20.783553 10555 leader_election.cc:341] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.783669 10555 leader_election.cc:302] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.783785 15261 raft_consensus.cc:2229] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.783936 15261 raft_consensus.cc:2258] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.784127 15337 raft_consensus.cc:2726] T fa4734a689aa4eeca4c0bbbab7efd1d0 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.784494 15261 ts_tablet_manager.cc:1905] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.785317 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00206b4e8c99424c9f1c4ba39fe51c82" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:20.786631 15367 tablet.cc:1722] T 4aacb1b4304d4c7f9f4630bf7fcbb0ab P 56a371f7ed104f68a5db9ca097eb237e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:20.787046 11365 consensus_queue.cc:260] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.787678 11365 ts_tablet_manager.cc:1428] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260811 06:17:20.788672 11365 tablet_bootstrap.cc:492] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:20.790763 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.791880 10813 leader_election.cc:302] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:20.792187 15158 raft_consensus.cc:2781] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.792273 15158 raft_consensus.cc:482] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.792404 15158 raft_consensus.cc:3037] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.795157 15158 raft_consensus.cc:504] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.796363 15158 leader_election.cc:288] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797)
W20260811 06:17:20.796711 10810 leader_election.cc:341] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Not found: Tablet not found: 02bb2819d9cc4880803ef959c131b9ac
I20260811 06:17:20.797642 11365 tablet_bootstrap.cc:654] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:20.808514 15261 ts_tablet_manager.cc:1918] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.809167 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet a5008449b09e43fba758a7edab4a5c48
I20260811 06:17:20.809209 15261 log.cc:1196] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/45fc206d95a244e395d19328ae289485
I20260811 06:17:20.809563 15261 ts_tablet_manager.cc:1939] T 45fc206d95a244e395d19328ae289485 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.809764 11655 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 230) took 2715 ms. Trace:
I20260811 06:17:20.809906 11655 rpcz_store.cc:276] 0811 06:17:18.093950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.536552 (+2442602us) service_pool.cc:227] Handling call
0811 06:17:20.537182 (+ 630us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.537330 (+ 148us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:20.537449 (+ 119us) catalog_manager.cc:2761] Locking tablets
0811 06:17:20.557772 (+ 20323us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:20.694863 (+137091us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:20.808989 (+114126us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:20.809072 (+ 83us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:20.809695 (+ 623us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.683042 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.683133 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.683139 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:20.683141 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:20.683247 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.683258 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.683263 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:20.683374 (+ 111us) tablet.cc:699] Row locks acquired
0811 06:17:20.683376 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:20.683410 (+ 34us) write_op.cc:270] Start()
0811 06:17:20.683441 (+ 31us) write_op.cc:276] Timestamp: P: 1786429040683365 usec, L: 0
0811 06:17:20.683445 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.683653 (+ 208us) log.cc:842] Serialized 762 byte log entry
0811 06:17:20.693241 (+ 9588us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.693866 (+ 625us) write_op.cc:301] APPLY: starting
0811 06:17:20.693877 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.693913 (+ 36us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.693944 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.693997 (+ 53us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.694024 (+ 27us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:20.694031 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:20.694085 (+ 54us) log.cc:842] Serialized 29 byte log entry
0811 06:17:20.694133 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.694146 (+ 13us) write_op.cc:454] Released schema lock
0811 06:17:20.694151 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.694194 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.694198 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":594,"apply.run_cpu_time_us":373,"apply.run_wall_time_us":373,"num_ops":2,"prepare.queue_time_us":124571,"prepare.run_cpu_time_us":715,"prepare.run_wall_time_us":9787,"replication_time_us":9779}]]}
I20260811 06:17:20.810401 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet a5008449b09e43fba758a7edab4a5c48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.810600 10881 tablet_service.cc:1467] Processing CreateTablet for tablet b6ce5253cb444b14ad42884ea146daf5 (DEFAULT_TABLE table=default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:20.810796 11655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_434adc20066e4b959518efc1ea61e28f" } modify_external_catalogs: true
I20260811 06:17:20.811028 11655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_434adc20066e4b959518efc1ea61e28f" } modify_external_catalogs: true
I20260811 06:17:20.811082 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ce5253cb444b14ad42884ea146daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:20.812134 15261 tablet_replica.cc:330] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.812376 15261 raft_consensus.cc:2229] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.812691 15261 raft_consensus.cc:2258] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.813871 15259 tablet_replica.cc:330] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:20.814123 15259 raft_consensus.cc:2229] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.814302 15259 raft_consensus.cc:2258] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.815263 15259 ts_tablet_manager.cc:1905] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 06:17:20.816075 11663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.65:43241 (request call id 103) took 1829 ms (client timeout 1000 ms). Trace:
W20260811 06:17:20.816223 11663 rpcz_store.cc:269] 0811 06:17:18.986985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:19.260463 (+273478us) service_pool.cc:227] Handling call
0811 06:17:20.816024 (+1555561us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.517671 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.517831 (+ 160us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.517837 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:20.517840 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:20.517961 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.517975 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.517980 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.518044 (+ 64us) tablet.cc:699] Row locks acquired
0811 06:17:20.518047 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.518080 (+ 33us) write_op.cc:270] Start()
0811 06:17:20.518115 (+ 35us) write_op.cc:276] Timestamp: P: 1786429040518029 usec, L: 0
0811 06:17:20.518119 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.519267 (+ 1148us) log.cc:842] Serialized 356 byte log entry
0811 06:17:20.519459 (+ 192us) spinlock_profiling.cc:243] Waited 907 us on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:20.546398 (+ 26939us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.546630 (+ 232us) write_op.cc:301] APPLY: starting
0811 06:17:20.546649 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.546695 (+ 46us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.546698 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.546758 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.546793 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.546799 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:20.546913 (+ 114us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.547018 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.547040 (+ 22us) write_op.cc:454] Released schema lock
0811 06:17:20.547049 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.547113 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.547116 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"spinlock_wait_cycles":15744,"child_traces":[["op",{"apply.queue_time_us":176,"apply.run_cpu_time_us":544,"apply.run_wall_time_us":545,"num_ops":1,"prepare.queue_time_us":20541,"prepare.run_cpu_time_us":1047,"prepare.run_wall_time_us":1871,"raft.queue_time_us":3302,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":264,"replication_time_us":28251,"spinlock_wait_cycles":2086272}]]}
I20260811 06:17:20.817152 11663 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_db6e8fb7be4b48d282a221b3b30c493e" } new_table_name: "default.Table_c8837bc04e304b798ce4cc3e6d3a2866" modify_external_catalogs: true
I20260811 06:17:20.819613 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 4124f64656614c91b7d9115c2efbecd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.819875 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet b5bf05ee95b244b88b943cc1d37f8839 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d5cfa63a633440897f09979413197ce) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.819907 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.821449 15259 ts_tablet_manager.cc:1918] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.821558 15259 log.cc:1196] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/a5008449b09e43fba758a7edab4a5c48
I20260811 06:17:20.822613 15259 ts_tablet_manager.cc:1939] T a5008449b09e43fba758a7edab4a5c48 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
I20260811 06:17:20.822633 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02bb2819d9cc4880803ef959c131b9ac" candidate_uuid: "56a371f7ed104f68a5db9ca097eb237e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6"
I20260811 06:17:20.822850 11158 raft_consensus.cc:3037] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.824769 15261 ts_tablet_manager.cc:1905] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.825781 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet a5008449b09e43fba758a7edab4a5c48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.826053 10620 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.826195 10608 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.826758 15258 tablet_replica.cc:330] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:20.826977 15258 raft_consensus.cc:2229] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.827158 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.827462 15258 raft_consensus.cc:2258] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.827782 10602 tablet_service.cc:1467] Processing CreateTablet for tablet b6ce5253cb444b14ad42884ea146daf5 (DEFAULT_TABLE table=default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 06:17:20.828133 15258 ts_tablet_manager.cc:1905] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.828220 10602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ce5253cb444b14ad42884ea146daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:20.829280 11158 raft_consensus.cc:2454] T 02bb2819d9cc4880803ef959c131b9ac P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56a371f7ed104f68a5db9ca097eb237e in term 1.
I20260811 06:17:20.839610 11653 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 231) took 2701 ms. Trace:
I20260811 06:17:20.839763 11653 rpcz_store.cc:276] 0811 06:17:18.138172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.580601 (+2442429us) service_pool.cc:227] Handling call
0811 06:17:20.679914 (+ 99313us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8d586 00007f3e4b280de6 00007f3e4b280b15 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:20.680195 (+ 281us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.680382 (+ 187us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:20.680601 (+ 219us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:20.680709 (+ 108us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:20.744875 (+ 64166us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:20.839517 (+ 94642us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.696217 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.696297 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.696302 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:20.696304 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:20.696378 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.696385 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.696390 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.696437 (+ 47us) tablet.cc:699] Row locks acquired
0811 06:17:20.696439 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:20.696466 (+ 27us) write_op.cc:270] Start()
0811 06:17:20.696491 (+ 25us) write_op.cc:276] Timestamp: P: 1786429040696423 usec, L: 0
0811 06:17:20.696494 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.696627 (+ 133us) log.cc:842] Serialized 405 byte log entry
0811 06:17:20.743630 (+ 47003us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.744385 (+ 755us) write_op.cc:301] APPLY: starting
0811 06:17:20.744395 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.744425 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.744461 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.744494 (+ 33us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.744519 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.744526 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:20.744579 (+ 53us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.744631 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.744645 (+ 14us) write_op.cc:454] Released schema lock
0811 06:17:20.744650 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.744711 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.744715 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":227629952,"child_traces":[["op",{"apply.queue_time_us":726,"apply.run_cpu_time_us":371,"apply.run_wall_time_us":370,"num_ops":1,"prepare.queue_time_us":15037,"prepare.run_cpu_time_us":487,"prepare.run_wall_time_us":745,"replication_time_us":47122}]]}
I20260811 06:17:20.840749 11653 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_b257fa815c634965884deb91f100ff84" } new_table_name: "default.Table_23f3bd7b3b5340b4839f12eb38e4ff06" modify_external_catalogs: true
I20260811 06:17:20.841033 15258 ts_tablet_manager.cc:1918] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.841169 15258 log.cc:1196] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-0/wal/wals/a5008449b09e43fba758a7edab4a5c48
I20260811 06:17:20.841526 15258 ts_tablet_manager.cc:1939] T a5008449b09e43fba758a7edab4a5c48 P 24d29113b2454d9c93e23db3e3dac801: Deleting consensus metadata
W20260811 06:17:20.844568 10810 consensus_peers.cc:487] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e -> Peer 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): Couldn't send request to peer 24d29113b2454d9c93e23db3e3dac801. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1649493bd0924ee48fd5044d7288932d. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.845847 11584 catalog_manager.cc:4841] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): tablet a5008449b09e43fba758a7edab4a5c48 (table default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]) successfully deleted
W20260811 06:17:20.846697 11584 catalog_manager.cc:4808] TS 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755): delete failed for tablet 085179a610734942b9dd050ce9cf56d4 because the tablet was not found. No further retry: Not found: Tablet not found: 085179a610734942b9dd050ce9cf56d4
I20260811 06:17:20.847052 15258 tablet_replica.cc:330] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: stopping tablet replica
I20260811 06:17:20.837504 15261 ts_tablet_manager.cc:1918] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.848003 15261 log.cc:1196] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/c2d9627d9f88466ba499aa175151f46a
I20260811 06:17:20.848453 15261 ts_tablet_manager.cc:1939] T c2d9627d9f88466ba499aa175151f46a P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:20.849524 15261 tablet_replica.cc:330] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:20.849763 15261 raft_consensus.cc:2229] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.849917 15261 raft_consensus.cc:2258] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.850518 15261 ts_tablet_manager.cc:1905] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.853562 15145 raft_consensus.cc:482] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.853686 15145 raft_consensus.cc:504] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.853892 11094 tablet_service.cc:1514] Processing DeleteTablet for tablet a5008449b09e43fba758a7edab4a5c48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.854291 15145 leader_election.cc:288] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.854940 11106 tablet_service.cc:1467] Processing CreateTablet for tablet b6ce5253cb444b14ad42884ea146daf5 (DEFAULT_TABLE table=default.Table_de974c553cfc44e5b22f7277e9ca9388 [id=825f1af5eebb40d383efc7bb576b1538]), partition=RANGE (key) PARTITION UNBOUNDED
W20260811 06:17:20.855186 10813 consensus_peers.cc:487] T 45fc206d95a244e395d19328ae289485 P 56a371f7ed104f68a5db9ca097eb237e -> Peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Couldn't send request to peer f8dcf15ece3a4389932aa672079442b6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260811 06:17:20.855350 11106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6ce5253cb444b14ad42884ea146daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 06:17:20.855268 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.855508 10661 raft_consensus.cc:2454] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:20.855903 11046 leader_election.cc:302] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.856151 14882 raft_consensus.cc:2781] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.856223 14882 raft_consensus.cc:482] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.856287 14882 raft_consensus.cc:3037] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.858601 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 7bcc463affbb4154877624aec28435bc (table default.Table_99b250b50327413e93d821e917b05f4c [id=84cd51fd1af54cf797610b6b432e1eaf]) successfully deleted
I20260811 06:17:20.858903 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet 45fc206d95a244e395d19328ae289485 (table default.Table_c37fb719a3e14506afcc1723b90ae323 [id=effd576838844300b8d7a4ee9a30a0d0]) successfully deleted
I20260811 06:17:20.858824 14882 raft_consensus.cc:504] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:20.859153 11601 catalog_manager.cc:4808] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): delete failed for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 because the tablet was not found. No further retry: Not found: Tablet not found: 0f3fa8872f8b4a5e9b09da26f8bba721
I20260811 06:17:20.859131 14995 consensus_queue.cc:1035] T 3c64c7100ccc4474bb895712f2d01b45 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:20.859335 11601 catalog_manager.cc:4841] TS f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): tablet c2d9627d9f88466ba499aa175151f46a (table default.Table_e4db0c1cd4b54fa8bacaf9e35020fbc9 [id=bf45c731d6e4455d9873db38c9863033]) successfully deleted
I20260811 06:17:20.859349 14882 leader_election.cc:288] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.860069 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.860267 10661 raft_consensus.cc:3037] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.861411 15337 raft_consensus.cc:482] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.861528 15337 raft_consensus.cc:504] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.862071 15337 leader_election.cc:288] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.862138 11683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 67e2683156f8466b8d63b298c9da15c1
I20260811 06:17:20.862636 11683 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 232) took 2718 ms. Trace:
I20260811 06:17:20.862739 11683 rpcz_store.cc:276] 0811 06:17:18.144355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.581608 (+2437253us) service_pool.cc:227] Handling call
0811 06:17:20.677987 (+ 96379us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8c2e6 00007f3e4b27f126 00007f3e4b27ee55 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:20.678413 (+ 426us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.678555 (+ 142us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:20.678628 (+ 73us) catalog_manager.cc:2761] Locking tablets
0811 06:17:20.678780 (+ 152us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:20.744828 (+ 66048us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:20.862035 (+117207us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:20.862088 (+ 53us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:20.862566 (+ 478us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.695178 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.695261 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.695266 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:20.695268 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:20.695357 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.695365 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.695369 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:20.695456 (+ 87us) tablet.cc:699] Row locks acquired
0811 06:17:20.695458 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:20.695489 (+ 31us) write_op.cc:270] Start()
0811 06:17:20.695514 (+ 25us) write_op.cc:276] Timestamp: P: 1786429040695444 usec, L: 0
0811 06:17:20.695517 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.695702 (+ 185us) log.cc:842] Serialized 762 byte log entry
0811 06:17:20.743563 (+ 47861us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.743763 (+ 200us) write_op.cc:301] APPLY: starting
0811 06:17:20.743782 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.743834 (+ 52us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.743865 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.743954 (+ 89us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.743996 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:20.744003 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:20.744103 (+ 100us) log.cc:842] Serialized 29 byte log entry
0811 06:17:20.744185 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.744209 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:20.744216 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.744280 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.744284 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":220812160,"child_traces":[["op",{"apply.queue_time_us":145,"apply.run_cpu_time_us":590,"apply.run_wall_time_us":589,"num_ops":2,"prepare.queue_time_us":15600,"prepare.run_cpu_time_us":587,"prepare.run_wall_time_us":1007,"replication_time_us":48014}]]}
I20260811 06:17:20.863518 10661 raft_consensus.cc:2454] T 7e87f192975a484ea038dc6c66fd6bae P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.863636 11683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_690e8cf28c9940afa78b2d3e003d35de" } modify_external_catalogs: true
I20260811 06:17:20.863852 11683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_690e8cf28c9940afa78b2d3e003d35de" } modify_external_catalogs: true
I20260811 06:17:20.864269 11046 leader_election.cc:302] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.864549 14995 raft_consensus.cc:2781] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.864652 14995 raft_consensus.cc:686] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.864902 14995 consensus_queue.cc:237] T 7e87f192975a484ea038dc6c66fd6bae P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.866406 10604 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e2683156f8466b8d63b298c9da15c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.867700 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79f635593b04cd59d43d54f702a8cc6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:20.867970 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet a5008449b09e43fba758a7edab4a5c48 (table default.Table_9cba92820384428c9888d5fb5b4bbc4b [id=af4fdcbf16fd4d91899d11b2d795d0fd]) successfully deleted
W20260811 06:17:20.868251 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4124f64656614c91b7d9115c2efbecd1 because the tablet was not found. No further retry: Not found: Tablet not found: 4124f64656614c91b7d9115c2efbecd1
W20260811 06:17:20.868404 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b5bf05ee95b244b88b943cc1d37f8839 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5bf05ee95b244b88b943cc1d37f8839 already in progress: creating tablet
W20260811 06:17:20.868572 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet bc0ec3b040cd4a54a7919a15f8eb5da7 because the tablet was not found. No further retry: Not found: Tablet not found: bc0ec3b040cd4a54a7919a15f8eb5da7
W20260811 06:17:20.868671 10564 leader_election.cc:341] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.868867 10813 leader_election.cc:302] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801
I20260811 06:17:20.869149 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 61671753b0964b3987bd3f33226857b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 811e63e51151415bb994921facf8db73) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.869354 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f48707b4fb746f49eaaf91b5b81e814 with delete_type TABLET_DATA_DELETED (replaced by tablet 524db95e51fe444497aa1c558bd4539a) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.869555 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f8456bc7fbd461c85ed2f5e7b42193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.869627 15259 tablet_replica.cc:330] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:20.869735 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet e8dfa9eb84334e9e86434aa2d9593efd with delete_type TABLET_DATA_DELETED (replaced by tablet 167599e794e5436898df2a78c7438d54) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.869850 15259 raft_consensus.cc:2229] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:20.869928 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fa71e5477644e0a0d7c40ecc55928b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:55 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.870085 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 32407c8872464da2b1470a8ae21c86fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:01 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.870445 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet b79f635593b04cd59d43d54f702a8cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.870499 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet 79f307f50e044435be880079219170d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.870440 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f44d4df9df7407890790c80fc71f8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.871114 15259 pending_rounds.cc:62] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:20.871176 15259 pending_rounds.cc:68] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213347676291072 op_type: NO_OP noop_request { }
I20260811 06:17:20.871287 15259 raft_consensus.cc:2866] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:20.871366 15259 raft_consensus.cc:2258] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.872243 15259 ts_tablet_manager.cc:1905] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.874897 15153 raft_consensus.cc:2781] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.875291 15153 raft_consensus.cc:686] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Becoming Leader. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Running, Role: LEADER
I20260811 06:17:20.875566 15153 consensus_queue.cc:237] T 02bb2819d9cc4880803ef959c131b9ac P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.877931 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet d6063a34ee55495584ed5623215a130f with delete_type TABLET_DATA_DELETED (replaced by tablet b9855da8111345808ecda0277b6e8dca) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.878151 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a79e23d311a447480c70393259cbfae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:05 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.878528 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4d1035d5b0435a8a3611e5e15c1547 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.878700 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet a25398c10a134356ac21b8a356eba46c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.878993 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 1649493bd0924ee48fd5044d7288932d with delete_type TABLET_DATA_DELETED (replaced by tablet 990e3308157d4edbb2ba8744a09d0b06) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.879320 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet fd91e4f85cc64de9a13c598a3695f8a1 with delete_type TABLET_DATA_DELETED (replaced by tablet 18b082ed126e41afbac160ebba87e769) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.879702 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c3a381b6744b8d989d644f2b643958 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:13 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.879912 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 814b7a212b164b4f8551ece59f57fafd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:11 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.880239 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 3210614ebacf45c89d63413c51c8f923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.880537 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ef5e72bc28740cc95b9b1c6a60d7b5f with delete_type TABLET_DATA_DELETED (replaced by tablet 9258f70b17214a90bb0da4127dfed959) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.880856 15259 ts_tablet_manager.cc:1918] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260811 06:17:20.880913 10873 tablet_service.cc:1514] Processing DeleteTablet for tablet 2df64ad168f341be899eba30e55b7f44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.881156 10868 tablet_service.cc:1514] Processing DeleteTablet for tablet 5195c4d7b09d45b8873575e1f67a5cb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 7513bf5f22f84121a77702b1b09e6199) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.881428 10859 tablet_service.cc:1514] Processing DeleteTablet for tablet a0c8b46163af4623b93af79302871941 with delete_type TABLET_DATA_DELETED (replaced by tablet 9efc03bb295f45acabf65c33d6a4edf5) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.881670 10853 tablet_service.cc:1514] Processing DeleteTablet for tablet 085179a610734942b9dd050ce9cf56d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.881816 10855 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d6280a32b6c49f5886fa1ff8745b740 with delete_type TABLET_DATA_DELETED (replaced by tablet fba50687dcf7496cb0f527b633b14df7) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.881937 10854 tablet_service.cc:1514] Processing DeleteTablet for tablet f92a58686071449082f60d06b91b098c with delete_type TABLET_DATA_DELETED (replaced by tablet 7af69017da384de8a28bcd184fe21894) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.882051 10871 tablet_service.cc:1514] Processing DeleteTablet for tablet 446112faf4374fa29fea8bb40666856e with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe1d650abe7432f990b0639377b2694) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.882170 10880 tablet_service.cc:1514] Processing DeleteTablet for tablet 02bb2819d9cc4880803ef959c131b9ac with delete_type TABLET_DATA_DELETED (replaced by tablet 8af156c4975d47108000a5bccf21f9f7) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.882283 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fc206d95a244e395d19328ae289485 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.882380 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e2683156f8466b8d63b298c9da15c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.885628 15259 log.cc:1196] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/1f48707b4fb746f49eaaf91b5b81e814
W20260811 06:17:20.885656 11656 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 101) took 2964 ms (client timeout 1000 ms). Trace:
I20260811 06:17:20.886363 15259 ts_tablet_manager.cc:1939] T 1f48707b4fb746f49eaaf91b5b81e814 P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:20.886036 11656 rpcz_store.cc:269] 0811 06:17:17.920933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:17.936073 (+ 15140us) service_pool.cc:227] Handling call
0811 06:17:19.252613 (+1316540us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.252623 (+ 10us) write_op.cc:454] Released schema lock
0811 06:17:20.885597 (+1632974us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:19.233439 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:19.233558 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:19.233564 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:19.233567 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:19.233694 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:19.233706 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:19.233732 (+ 26us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:19.233849 (+ 117us) tablet.cc:699] Row locks acquired
0811 06:17:19.233851 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:19.233894 (+ 43us) write_op.cc:270] Start()
0811 06:17:19.233933 (+ 39us) write_op.cc:276] Timestamp: P: 1786429039233865 usec, L: 0
0811 06:17:19.233937 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:19.234133 (+ 196us) log.cc:842] Serialized 907 byte log entry
0811 06:17:19.239989 (+ 5856us) op_driver.cc:444] REPLICATION: finished
0811 06:17:19.240763 (+ 774us) write_op.cc:301] APPLY: starting
0811 06:17:19.240774 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:19.240829 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:19.240854 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:19.240912 (+ 58us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:19.240938 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:19.240945 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:19.241001 (+ 56us) log.cc:842] Serialized 29 byte log entry
0811 06:17:19.241040 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:19.241057 (+ 17us) write_op.cc:454] Released schema lock
0811 06:17:19.241062 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":21989,"reported_tablets":223,"child_traces":[["op",{"apply.queue_time_us":746,"apply.run_cpu_time_us":343,"apply.run_wall_time_us":343,"num_ops":2,"prepare.queue_time_us":1434,"prepare.run_cpu_time_us":828,"prepare.run_wall_time_us":827,"raft.queue_time_us":1157,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":306,"replication_time_us":6038,"thread_start_us":8485,"threads_started":1}]]}
I20260811 06:17:20.887347 11656 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_99ff11e948be4a3bbda8fba9ceb9ffd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 06:17:20.892010 15259 tablet_replica.cc:330] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:20.894934 15259 raft_consensus.cc:2229] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.895429 15259 raft_consensus.cc:2258] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:20.896386 15259 ts_tablet_manager.cc:1905] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.917227 14995 raft_consensus.cc:482] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.917412 14995 raft_consensus.cc:504] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.918041 14995 leader_election.cc:288] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.918125 15337 raft_consensus.cc:482] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.918255 15337 raft_consensus.cc:504] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.918826 15337 leader_election.cc:288] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.896904 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ad42cef6aad49a1932bf1e9b20e169c" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:20.919268 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30cffba93ad74e84812e5879b851119f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.919938 10564 leader_election.cc:341] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.920466 10655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:20.920670 10655 raft_consensus.cc:2454] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:20.920992 11046 leader_election.cc:302] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.921240 14995 raft_consensus.cc:2781] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:20.921304 14995 raft_consensus.cc:482] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:20.921358 14995 raft_consensus.cc:3037] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.924168 14995 raft_consensus.cc:504] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.925151 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:20.925333 10661 raft_consensus.cc:3037] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.925457 15259 ts_tablet_manager.cc:1918] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.925572 15259 log.cc:1196] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-1/wal/wals/32407c8872464da2b1470a8ae21c86fd
I20260811 06:17:20.926874 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b79f635593b04cd59d43d54f702a8cc6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.927438 10555 leader_election.cc:341] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.927543 10555 leader_election.cc:302] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.927879 15337 raft_consensus.cc:2726] T b79f635593b04cd59d43d54f702a8cc6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.928104 10661 raft_consensus.cc:2454] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 1.
I20260811 06:17:20.929352 11046 leader_election.cc:302] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:20.929641 14882 raft_consensus.cc:2781] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 06:17:20.930274 14882 raft_consensus.cc:686] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [term 1 LEADER]: Becoming Leader. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Running, Role: LEADER
I20260811 06:17:20.930526 14882 consensus_queue.cc:237] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.930858 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30cffba93ad74e84812e5879b851119f" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.931411 10555 leader_election.cc:341] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.931520 10555 leader_election.cc:302] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.931835 15337 raft_consensus.cc:2726] T 30cffba93ad74e84812e5879b851119f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.933199 15153 consensus_queue.cc:1035] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:20.933653 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet c2527862e75b42aa9091456b0f5f994e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:16:56 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.933904 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet e00a72f178f74ca59cc073fe78c99373 with delete_type TABLET_DATA_DELETED (replaced by tablet 604cba8a4978479cbb15307aeb45a634) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.934113 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet dcfab8bff5bd4a6cb7ea85dae3a48888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:16 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.934303 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet f6f682f675c344b6b5955e834f94091f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:09 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.934501 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f3fa8872f8b4a5e9b09da26f8bba721 with delete_type TABLET_DATA_DELETED (replaced by tablet 01669d923f2b4769bd8da8bc1f99cbac) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.934669 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcc463affbb4154877624aec28435bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:07 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.934852 10879 tablet_service.cc:1514] Processing DeleteTablet for tablet 314a569c95414c04b8b505ca471caa6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:12 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.935011 10872 tablet_service.cc:1514] Processing DeleteTablet for tablet c2d9627d9f88466ba499aa175151f46a with delete_type TABLET_DATA_DELETED (replaced by tablet 9f44d4df9df7407890790c80fc71f8cb) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:20.936064 11656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ff11e948be4a3bbda8fba9ceb9ffd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:20.936885 14995 leader_election.cc:288] T e8dfa9eb84334e9e86434aa2d9593efd P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
W20260811 06:17:20.890549 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 61671753b0964b3987bd3f33226857b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61671753b0964b3987bd3f33226857b7 already in progress: creating tablet
W20260811 06:17:20.937891 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 47252.8us
I20260811 06:17:20.938422 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 1f48707b4fb746f49eaaf91b5b81e814 (table default.Table_d7af297ac07b41e3b08ea8f3fdcda000 [id=f6b016d74b08404c83cc6155dc00baa6]) successfully deleted
W20260811 06:17:20.890865 11601 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 (table default.Table_99affff9b5fe49d48a5012cba18e007b [id=4477e6c360934e079e00533d56a91c11], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5ef2fa3ab0e9494b9b36a18feb1514c2 consensus state has no leader
I20260811 06:17:20.902758 11672 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_5ea88bec6b2e46018539d76056f3eaa9 [id=c31dcf2b8e114693be2cad7ac29b74ab] alter complete (version 1)
I20260811 06:17:20.908311 11670 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: default.Table_08562ae83b774258bf17856350ad14af [id=8ae837e4085947f783acb33a801b60cf] alter complete (version 1)
I20260811 06:17:20.909670 11655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36d6d06a0cb4489b5014178b9973219: Sending DeleteTablet for 3 replicas of tablet 9efc03bb295f45acabf65c33d6a4edf5
W20260811 06:17:20.940001 11047 leader_election.cc:341] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.940249 11655 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:52508 (request call id 233) took 2788 ms. Trace:
I20260811 06:17:20.940335 11047 leader_election.cc:302] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8dcf15ece3a4389932aa672079442b6; no voters: 24d29113b2454d9c93e23db3e3dac801, 56a371f7ed104f68a5db9ca097eb237e
I20260811 06:17:20.940454 11119 tablet_service.cc:1514] Processing DeleteTablet for tablet 67e2683156f8466b8d63b298c9da15c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:20.940591 14995 raft_consensus.cc:3037] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:20.940505 11655 rpcz_store.cc:276] 0811 06:17:18.151498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.810614 (+2659116us) service_pool.cc:227] Handling call
0811 06:17:20.811138 (+ 524us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.811298 (+ 160us) catalog_manager.cc:2752] Modifying in-memory table state
0811 06:17:20.811371 (+ 73us) catalog_manager.cc:2761] Locking tablets
0811 06:17:20.811521 (+ 150us) catalog_manager.cc:2775] Removing table and tablets from system table
0811 06:17:20.909424 (+ 97903us) catalog_manager.cc:2793] Removing table from by-name map
0811 06:17:20.909527 (+ 103us) catalog_manager.cc:2809] Committing in-memory state
0811 06:17:20.909582 (+ 55us) catalog_manager.cc:2813] Aborting table tasks
0811 06:17:20.940012 (+ 30430us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.891026 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.891177 (+ 151us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.891185 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:20.891188 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:20.891332 (+ 144us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.891349 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.891355 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:20.891536 (+ 181us) tablet.cc:699] Row locks acquired
0811 06:17:20.891539 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.891587 (+ 48us) write_op.cc:270] Start()
0811 06:17:20.891630 (+ 43us) write_op.cc:276] Timestamp: P: 1786429040891520 usec, L: 0
0811 06:17:20.891634 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.891876 (+ 242us) log.cc:842] Serialized 728 byte log entry
0811 06:17:20.896523 (+ 4647us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.896664 (+ 141us) write_op.cc:301] APPLY: starting
0811 06:17:20.896682 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.896732 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.896759 (+ 27us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.896849 (+ 90us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.896890 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0811 06:17:20.896898 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:20.896983 (+ 85us) log.cc:842] Serialized 29 byte log entry
0811 06:17:20.897053 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.897073 (+ 20us) write_op.cc:454] Released schema lock
0811 06:17:20.897080 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.897136 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.897140 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":531,"apply.run_wall_time_us":531,"num_ops":2,"prepare.queue_time_us":78725,"prepare.run_cpu_time_us":988,"prepare.run_wall_time_us":987,"raft.queue_time_us":175,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":240,"replication_time_us":4863}]]}
I20260811 06:17:20.942317 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_154bf6b3f4be4df5ac49b25a590186ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:20.943620 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_154bf6b3f4be4df5ac49b25a590186ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:20.943643 14995 raft_consensus.cc:2726] T f4ed851746ef4861a624940952796a37 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.944530 15340 tablet.cc:1722] T 5d64ea5000504cbd82ecedcf5f6b78a9 P f8dcf15ece3a4389932aa672079442b6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260811 06:17:20.919236 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.9.203.66:34991 (request call id 100) took 4075 ms (client timeout 1000 ms). Trace:
W20260811 06:17:20.945014 11679 rpcz_store.cc:269] 0811 06:17:16.843671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:16.860446 (+ 16775us) service_pool.cc:227] Handling call
0811 06:17:20.919174 (+4058728us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:18.183788 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:18.183929 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:18.183935 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:18.183938 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:18.184075 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:18.184087 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:18.184092 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:18.184835 (+ 743us) tablet.cc:699] Row locks acquired
0811 06:17:18.184838 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:18.184882 (+ 44us) write_op.cc:270] Start()
0811 06:17:18.184923 (+ 41us) write_op.cc:276] Timestamp: P: 1786429038184851 usec, L: 0
0811 06:17:18.184927 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:18.194749 (+ 9822us) log.cc:842] Serialized 356 byte log entry
0811 06:17:18.198885 (+ 4136us) op_driver.cc:444] REPLICATION: finished
0811 06:17:18.209968 (+ 11083us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:18.211828 (+ 1860us) write_op.cc:301] APPLY: starting
0811 06:17:18.211847 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:18.211889 (+ 42us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:18.211892 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:18.211953 (+ 61us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:18.211989 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:18.211995 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:18.212087 (+ 92us) log.cc:842] Serialized 23 byte log entry
0811 06:17:18.212750 (+ 663us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.212771 (+ 21us) write_op.cc:454] Released schema lock
0811 06:17:18.212779 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:18.213144 (+ 365us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:18.213148 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105504,"reported_tablets":216,"child_traces":[["op",{"apply.queue_time_us":12863,"apply.run_cpu_time_us":535,"apply.run_wall_time_us":1386,"num_ops":1,"prepare.queue_time_us":221680,"prepare.run_cpu_time_us":1364,"prepare.run_wall_time_us":27067,"raft.queue_time_us":1100,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"replication_time_us":13917,"spinlock_wait_cycles":21787904}]]}
I20260811 06:17:20.946138 11679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_09cbe19506314e9b873b0af8a7746a7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:20.946954 11679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09cbe19506314e9b873b0af8a7746a7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:20.949476 15342 tablet.cc:1722] T 5d64ea5000504cbd82ecedcf5f6b78a9 P 24d29113b2454d9c93e23db3e3dac801: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260811 06:17:20.950449 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dfd6bc48bdd4e008f9e1aba35c3716f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:17 UTC) from {username='slave'} at 127.0.0.1:51802
I20260811 06:17:20.951637 10602 tablet_service.cc:1514] Processing DeleteTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:36594
I20260811 06:17:20.957837 14995 consensus_queue.cc:1035] T c42f153889c7490ea33002e3a857c631 P f8dcf15ece3a4389932aa672079442b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 06:17:20.960168 11047 leader_election.cc:341] T e7dc9bfb0c444d799b18c3e647b186fa P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.974083 15337 raft_consensus.cc:482] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.974269 15337 raft_consensus.cc:504] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.974907 15337 leader_election.cc:288] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.975751 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b75a143de45040eba72de483363504de" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.976433 10564 leader_election.cc:341] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.977274 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b75a143de45040eba72de483363504de" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:20.977890 10555 leader_election.cc:341] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.978053 10555 leader_election.cc:302] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.978446 15337 raft_consensus.cc:2726] T b75a143de45040eba72de483363504de P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:20.960529 11047 leader_election.cc:341] T 00206b4e8c99424c9f1c4ba39fe51c82 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
W20260811 06:17:20.980635 11047 leader_election.cc:341] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.987421 11362 tablet_bootstrap.cc:492] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e: No bootstrap required, opened a new log
I20260811 06:17:20.987627 11362 ts_tablet_manager.cc:1397] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e: Time spent bootstrapping tablet: real 0.300s user 0.004s sys 0.009s
I20260811 06:17:20.988749 11362 raft_consensus.cc:348] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:20.989090 11362 raft_consensus.cc:374] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:20.989197 11362 raft_consensus.cc:729] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a371f7ed104f68a5db9ca097eb237e, State: Initialized, Role: FOLLOWER
I20260811 06:17:20.990222 15337 raft_consensus.cc:482] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:20.990361 15337 raft_consensus.cc:504] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:20.990911 15337 leader_election.cc:288] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:20.991469 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f8456bc7fbd461c85ed2f5e7b42193d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:20.992043 10564 leader_election.cc:341] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.993582 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f8456bc7fbd461c85ed2f5e7b42193d" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:20.993743 15258 raft_consensus.cc:2229] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:20.993945 15258 raft_consensus.cc:2258] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 06:17:20.994140 10555 leader_election.cc:341] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:20.994261 10555 leader_election.cc:302] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:20.994776 15337 raft_consensus.cc:2726] T 4f8456bc7fbd461c85ed2f5e7b42193d P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:20.997205 15258 ts_tablet_manager.cc:1905] T e8dfa9eb84334e9e86434aa2d9593efd P 24d29113b2454d9c93e23db3e3dac801: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:20.999493 15261 ts_tablet_manager.cc:1918] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:20.999697 15261 log.cc:1196] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/e00a72f178f74ca59cc073fe78c99373
I20260811 06:17:21.000108 15261 ts_tablet_manager.cc:1939] T e00a72f178f74ca59cc073fe78c99373 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:21.001066 15261 tablet_replica.cc:330] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:21.001330 15261 raft_consensus.cc:2229] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 06:17:21.001559 15261 raft_consensus.cc:2258] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:21.002362 15261 ts_tablet_manager.cc:1905] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:21.003680 11365 tablet_bootstrap.cc:492] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:21.003826 11365 ts_tablet_manager.cc:1397] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.215s user 0.003s sys 0.000s
I20260811 06:17:21.004487 11365 raft_consensus.cc:348] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.004714 11365 raft_consensus.cc:374] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:21.004768 11365 raft_consensus.cc:729] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:21.004973 11365 consensus_queue.cc:260] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.005545 11365 ts_tablet_manager.cc:1428] T 23ca4a89d00242ea98c5b964df27082f P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 06:17:21.006094 11365 tablet_bootstrap.cc:492] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:21.008463 11365 tablet_bootstrap.cc:654] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
W20260811 06:17:21.013411 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 4f8456bc7fbd461c85ed2f5e7b42193d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f8456bc7fbd461c85ed2f5e7b42193d already in progress: creating tablet
W20260811 06:17:21.013847 11588 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 74985.5us
I20260811 06:17:21.014083 15259 ts_tablet_manager.cc:1939] T 32407c8872464da2b1470a8ae21c86fd P 56a371f7ed104f68a5db9ca097eb237e: Deleting consensus metadata
W20260811 06:17:21.015781 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet e8dfa9eb84334e9e86434aa2d9593efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8dfa9eb84334e9e86434aa2d9593efd already in progress: creating tablet
W20260811 06:17:21.016193 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d9fa71e5477644e0a0d7c40ecc55928b because the tablet was not found. No further retry: Not found: Tablet not found: d9fa71e5477644e0a0d7c40ecc55928b
I20260811 06:17:21.016232 15259 tablet_replica.cc:330] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: stopping tablet replica
I20260811 06:17:21.016462 15259 raft_consensus.cc:2229] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: Raft consensus shutting down.
I20260811 06:17:21.017194 11588 catalog_manager.cc:4841] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): tablet 32407c8872464da2b1470a8ae21c86fd (table default.Table_221001ee9f7d4adbaeed611c4a678bcf [id=d22a42e5f3a04f5198d9b22c62f8d83a]) successfully deleted
I20260811 06:17:21.017438 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:51802
W20260811 06:17:21.017630 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet b79f635593b04cd59d43d54f702a8cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b79f635593b04cd59d43d54f702a8cc6 already in progress: creating tablet
W20260811 06:17:21.018054 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 79f307f50e044435be880079219170d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79f307f50e044435be880079219170d8 already in progress: creating tablet
I20260811 06:17:21.018004 11362 consensus_queue.cc:260] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
W20260811 06:17:21.018497 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9f44d4df9df7407890790c80fc71f8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f44d4df9df7407890790c80fc71f8cb already in progress: creating tablet
W20260811 06:17:21.018829 11588 catalog_manager.cc:4808] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet d6063a34ee55495584ed5623215a130f because the tablet was not found. No further retry: Not found: Tablet not found: d6063a34ee55495584ed5623215a130f
W20260811 06:17:21.019143 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 9a79e23d311a447480c70393259cbfae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a79e23d311a447480c70393259cbfae already in progress: creating tablet
W20260811 06:17:21.025025 11653 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78a22685fb924840b9f28908f565e5a6 consensus state has no leader
I20260811 06:17:21.025344 11653 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 235) took 2855 ms. Trace:
I20260811 06:17:21.025558 11362 ts_tablet_manager.cc:1428] T a2f8100e334a4fd1b3c9b059e3bdef3e P 56a371f7ed104f68a5db9ca097eb237e: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260811 06:17:21.025976 11362 tablet_bootstrap.cc:492] T 61671753b0964b3987bd3f33226857b7 P 56a371f7ed104f68a5db9ca097eb237e: Bootstrap starting.
I20260811 06:17:21.025569 11653 rpcz_store.cc:276] 0811 06:17:18.169416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.840508 (+2671092us) service_pool.cc:227] Handling call
0811 06:17:20.841005 (+ 497us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.841221 (+ 216us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:20.841456 (+ 235us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:20.841538 (+ 82us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:20.961241 (+119703us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:21.025271 (+ 64030us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.908544 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.908669 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.908675 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:20.908677 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:20.908785 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.908799 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.908804 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.908920 (+ 116us) tablet.cc:699] Row locks acquired
0811 06:17:20.908923 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.908959 (+ 36us) write_op.cc:270] Start()
0811 06:17:20.908991 (+ 32us) write_op.cc:276] Timestamp: P: 1786429040908893 usec, L: 0
0811 06:17:20.908996 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.909201 (+ 205us) log.cc:842] Serialized 405 byte log entry
0811 06:17:20.952829 (+ 43628us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.953241 (+ 412us) write_op.cc:301] APPLY: starting
0811 06:17:20.953260 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.953304 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.953333 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.953398 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.953440 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.953447 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:20.953542 (+ 95us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.953629 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.953653 (+ 24us) write_op.cc:454] Released schema lock
0811 06:17:20.953661 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.953985 (+ 324us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.953990 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":337,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":809,"mutex_wait_us":25360,"num_ops":1,"prepare.queue_time_us":25432,"prepare.run_cpu_time_us":761,"prepare.run_wall_time_us":761,"raft.queue_time_us":58,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":43804}]]}
W20260811 06:17:21.029731 11663 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0d128d3feca4296a226ad50f3e12da0 consensus state has no leader
I20260811 06:17:21.030005 11663 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:52508 (request call id 234) took 2870 ms. Trace:
I20260811 06:17:21.030213 11663 rpcz_store.cc:276] 0811 06:17:18.159171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.816943 (+2657772us) service_pool.cc:227] Handling call
0811 06:17:20.817384 (+ 441us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0811 06:17:20.817571 (+ 187us) catalog_manager.cc:3616] Apply alter schema
0811 06:17:20.884634 (+ 67063us) catalog_manager.cc:3639] Acquired catalog manager lock
0811 06:17:20.884748 (+ 114us) catalog_manager.cc:3786] Updating metadata on disk
0811 06:17:20.963586 (+ 78838us) catalog_manager.cc:3817] Committing alterations to in-memory state
0811 06:17:21.029969 (+ 66383us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.912919 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.913081 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.913086 (+ 5us) write_op.cc:435] Acquired schema lock
0811 06:17:20.913090 (+ 4us) tablet.cc:660] Decoding operations
0811 06:17:20.913226 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.913236 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.913242 (+ 6us) tablet.cc:683] Acquiring locks for 1 operations
0811 06:17:20.913296 (+ 54us) tablet.cc:699] Row locks acquired
0811 06:17:20.913298 (+ 2us) write_op.cc:260] PREPARE: finished
0811 06:17:20.913328 (+ 30us) write_op.cc:270] Start()
0811 06:17:20.913357 (+ 29us) write_op.cc:276] Timestamp: P: 1786429040913263 usec, L: 0
0811 06:17:20.913361 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:20.913516 (+ 155us) log.cc:842] Serialized 405 byte log entry
0811 06:17:20.952963 (+ 39447us) op_driver.cc:444] REPLICATION: finished
0811 06:17:20.954530 (+ 1567us) write_op.cc:301] APPLY: starting
0811 06:17:20.954540 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:20.954565 (+ 25us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:20.954603 (+ 38us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:20.954632 (+ 29us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:20.954656 (+ 24us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0811 06:17:20.954662 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:20.954709 (+ 47us) log.cc:842] Serialized 23 byte log entry
0811 06:17:20.954741 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.954754 (+ 13us) write_op.cc:454] Released schema lock
0811 06:17:20.954758 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:20.954800 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:20.954804 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1539,"apply.run_cpu_time_us":307,"apply.run_wall_time_us":307,"mutex_wait_us":27562,"num_ops":1,"prepare.queue_time_us":27644,"prepare.run_cpu_time_us":699,"prepare.run_wall_time_us":754,"raft.queue_time_us":35,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":39588,"threads_started":1}]]}
I20260811 06:17:21.031489 11365 tablet_bootstrap.cc:492] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
I20260811 06:17:21.031652 11365 ts_tablet_manager.cc:1397] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260811 06:17:21.032425 11365 raft_consensus.cc:348] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.032660 11365 raft_consensus.cc:374] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:21.032721 11365 raft_consensus.cc:729] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:21.033120 11365 consensus_queue.cc:260] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
W20260811 06:17:21.033244 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet 0f4d1035d5b0435a8a3611e5e15c1547 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4d1035d5b0435a8a3611e5e15c1547 already in progress: creating tablet
W20260811 06:17:21.033694 11588 catalog_manager.cc:4821] TS 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): delete failed for tablet a25398c10a134356ac21b8a356eba46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a25398c10a134356ac21b8a356eba46c already in progress: creating tablet
I20260811 06:17:21.034404 11365 ts_tablet_manager.cc:1428] T f2362a85273a460da7d7cd30a20f220c P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 06:17:21.035633 11365 tablet_bootstrap.cc:492] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:21.037421 11365 tablet_bootstrap.cc:654] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:21.046626 15337 raft_consensus.cc:482] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.046797 15337 raft_consensus.cc:504] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.047465 15337 leader_election.cc:288] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.034724 15259 pending_rounds.cc:62] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Trying to abort 1 pending ops.
I20260811 06:17:21.057986 15259 pending_rounds.cc:68] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317213347778506752 op_type: NO_OP noop_request { }
I20260811 06:17:21.058475 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f040a4545164a75a1cfe2a203a867d6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:21.062098 10555 leader_election.cc:341] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.062546 15259 raft_consensus.cc:2866] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260811 06:17:21.018783 11361 tablet_bootstrap.cc:492] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:21.063078 11361 ts_tablet_manager.cc:1397] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.285s user 0.023s sys 0.028s
I20260811 06:17:21.063788 15259 raft_consensus.cc:2258] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 06:17:21.063956 11361 raft_consensus.cc:348] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.064180 11656 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 237) took 2594 ms. Trace:
I20260811 06:17:21.064579 11361 raft_consensus.cc:374] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:21.064723 11361 raft_consensus.cc:729] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8dcf15ece3a4389932aa672079442b6, State: Initialized, Role: FOLLOWER
I20260811 06:17:21.064996 11361 consensus_queue.cc:260] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.048230 11158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f040a4545164a75a1cfe2a203a867d6" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:21.064567 11656 rpcz_store.cc:276] 0811 06:17:18.469396 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.886957 (+2417561us) service_pool.cc:227] Handling call
0811 06:17:20.936308 (+ 49351us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:20.936865 (+ 557us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:21.063776 (+126911us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:21.063917 (+ 141us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:21.064032 (+ 115us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:20.981665 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:20.981819 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:20.981827 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:20.981830 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:20.981952 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:20.981969 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:20.981975 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:20.982077 (+ 102us) tablet.cc:699] Row locks acquired
0811 06:17:20.982080 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:20.982125 (+ 45us) write_op.cc:270] Start()
0811 06:17:20.982166 (+ 41us) write_op.cc:276] Timestamp: P: 1786429040982050 usec, L: 0
0811 06:17:20.982171 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:21.048295 (+ 66124us) log.cc:842] Serialized 433 byte log entry
0811 06:17:21.049876 (+ 1581us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f3e4c463d02 00007f3e4d7967f1 00007f3e4d795359 00007f3e4d79d1bb 00007f3e4d79d038 00000000009edb7c 00007f3e40f97344 00007f3e40f9a91b 00007f3e40f9a798 00000000009edb7c
0811 06:17:21.060544 (+ 10668us) op_driver.cc:444] REPLICATION: finished
0811 06:17:21.060697 (+ 153us) write_op.cc:301] APPLY: starting
0811 06:17:21.060717 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:21.060772 (+ 55us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:21.060775 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:21.060965 (+ 190us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:21.061009 (+ 44us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:21.061017 (+ 8us) write_op.cc:312] APPLY: finished
0811 06:17:21.061116 (+ 99us) log.cc:842] Serialized 29 byte log entry
0811 06:17:21.061193 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.061216 (+ 23us) write_op.cc:454] Released schema lock
0811 06:17:21.061223 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:21.061286 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.061290 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":682,"apply.run_wall_time_us":682,"num_ops":2,"prepare.queue_time_us":44131,"prepare.run_cpu_time_us":1837,"prepare.run_wall_time_us":68319,"raft.queue_time_us":2651,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":277,"replication_time_us":78340,"spinlock_wait_cycles":151353216}]]}
W20260811 06:17:21.066365 10564 leader_election.cc:341] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.066501 10564 leader_election.cc:302] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:21.066849 15337 raft_consensus.cc:2726] T 5f040a4545164a75a1cfe2a203a867d6 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:21.068212 11365 tablet_bootstrap.cc:492] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801: No bootstrap required, opened a new log
W20260811 06:17:21.039412 11047 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.203.66:45845, user_credentials={real_user=slave}} blocked reactor thread for 58243.2us
I20260811 06:17:21.068361 11365 ts_tablet_manager.cc:1397] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
W20260811 06:17:21.068684 11047 leader_election.cc:341] T 8ad42cef6aad49a1932bf1e9b20e169c P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.069015 11365 raft_consensus.cc:348] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.070236 11361 ts_tablet_manager.cc:1428] T 36e37f51b0b549b7a3e749f7fbe0d03a P f8dcf15ece3a4389932aa672079442b6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260811 06:17:21.070271 11655 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 238) took 2600 ms. Trace:
I20260811 06:17:21.070542 11655 rpcz_store.cc:276] 0811 06:17:18.469614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.941930 (+2472316us) service_pool.cc:227] Handling call
0811 06:17:20.943746 (+ 1816us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:20.944312 (+ 566us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:21.069822 (+125510us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:21.069960 (+ 138us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:21.070134 (+ 174us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:21.050028 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:21.050196 (+ 168us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:21.050204 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:21.050207 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:21.050337 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:21.050351 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:21.050356 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:21.050458 (+ 102us) tablet.cc:699] Row locks acquired
0811 06:17:21.050461 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:21.050501 (+ 40us) write_op.cc:270] Start()
0811 06:17:21.050543 (+ 42us) write_op.cc:276] Timestamp: P: 1786429041050420 usec, L: 0
0811 06:17:21.050547 (+ 4us) op_driver.cc:331] REPLICATION: starting
0811 06:17:21.050787 (+ 240us) log.cc:842] Serialized 433 byte log entry
0811 06:17:21.060612 (+ 9825us) op_driver.cc:444] REPLICATION: finished
0811 06:17:21.061414 (+ 802us) write_op.cc:301] APPLY: starting
0811 06:17:21.061426 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:21.061464 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:21.061494 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:21.061582 (+ 88us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:21.061628 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:21.061635 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:21.061692 (+ 57us) log.cc:842] Serialized 29 byte log entry
0811 06:17:21.061827 (+ 135us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.061845 (+ 18us) write_op.cc:454] Released schema lock
0811 06:17:21.061851 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:21.061909 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.061913 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":772,"apply.run_cpu_time_us":545,"apply.run_wall_time_us":545,"mutex_wait_us":42640,"num_ops":2,"prepare.queue_time_us":105112,"prepare.run_cpu_time_us":894,"prepare.run_wall_time_us":2126,"raft.queue_time_us":39,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":10050}]]}
I20260811 06:17:21.071969 11361 tablet_bootstrap.cc:492] T 52344eea7d3548feb9949beb09b34492 P f8dcf15ece3a4389932aa672079442b6: Bootstrap starting.
I20260811 06:17:21.072949 11655 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_bd06116c723546758bc906a02c84e389"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:21.074172 11655 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd06116c723546758bc906a02c84e389 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:21.075934 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:21.059139 11362 tablet_bootstrap.cc:654] T 61671753b0964b3987bd3f33226857b7 P 56a371f7ed104f68a5db9ca097eb237e: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:21.072897 15337 raft_consensus.cc:482] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.080550 15337 raft_consensus.cc:504] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.081249 15337 leader_election.cc:288] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.081756 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e87f192975a484ea038dc6c66fd6bae" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:21.081972 11365 raft_consensus.cc:374] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 06:17:21.082046 11365 raft_consensus.cc:729] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d29113b2454d9c93e23db3e3dac801, State: Initialized, Role: FOLLOWER
I20260811 06:17:21.082284 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478a5fbcc353475ba35a5b9f98654c33" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:21.082824 10564 leader_election.cc:341] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.083097 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478a5fbcc353475ba35a5b9f98654c33" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
W20260811 06:17:21.083657 10555 leader_election.cc:341] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.083811 10555 leader_election.cc:302] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:21.084112 15337 raft_consensus.cc:2726] T 478a5fbcc353475ba35a5b9f98654c33 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:21.086217 11361 tablet_bootstrap.cc:654] T 52344eea7d3548feb9949beb09b34492 P f8dcf15ece3a4389932aa672079442b6: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:21.088624 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:21.083823 11365 consensus_queue.cc:260] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.092131 11365 ts_tablet_manager.cc:1428] T b5bf05ee95b244b88b943cc1d37f8839 P 24d29113b2454d9c93e23db3e3dac801: Time spent starting tablet: real 0.024s user 0.002s sys 0.001s
I20260811 06:17:21.094475 11679 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 239) took 2624 ms. Trace:
I20260811 06:17:21.094627 11679 rpcz_store.cc:276] 0811 06:17:18.469779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:20.945855 (+2476076us) service_pool.cc:227] Handling call
0811 06:17:20.947061 (+ 1206us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:20.978336 (+ 31275us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:21.094185 (+115849us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:21.094306 (+ 121us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:21.094401 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:21.052177 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:21.052294 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:21.052302 (+ 8us) write_op.cc:435] Acquired schema lock
0811 06:17:21.052304 (+ 2us) tablet.cc:660] Decoding operations
0811 06:17:21.052410 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:21.052422 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:21.052428 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:21.052508 (+ 80us) tablet.cc:699] Row locks acquired
0811 06:17:21.052511 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:21.052546 (+ 35us) write_op.cc:270] Start()
0811 06:17:21.052581 (+ 35us) write_op.cc:276] Timestamp: P: 1786429041052466 usec, L: 0
0811 06:17:21.052586 (+ 5us) op_driver.cc:331] REPLICATION: starting
0811 06:17:21.052754 (+ 168us) log.cc:842] Serialized 433 byte log entry
0811 06:17:21.089441 (+ 36687us) op_driver.cc:444] REPLICATION: finished
0811 06:17:21.089608 (+ 167us) write_op.cc:301] APPLY: starting
0811 06:17:21.089631 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:21.089687 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:21.089738 (+ 51us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:21.089886 (+ 148us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:21.089928 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:21.089935 (+ 7us) write_op.cc:312] APPLY: finished
0811 06:17:21.090054 (+ 119us) log.cc:842] Serialized 29 byte log entry
0811 06:17:21.090129 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.090156 (+ 27us) write_op.cc:454] Released schema lock
0811 06:17:21.090164 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:21.090232 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.090235 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":687,"apply.run_wall_time_us":686,"num_ops":2,"prepare.queue_time_us":56599,"prepare.run_cpu_time_us":673,"prepare.run_wall_time_us":1062,"raft.queue_time_us":32,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":36819}]]}
I20260811 06:17:21.096529 11679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e62617e4966e4dfb8e603f9884650338" } modify_external_catalogs: true
I20260811 06:17:21.096771 11679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52508:
table { table_name: "default.Table_e62617e4966e4dfb8e603f9884650338" } modify_external_catalogs: true
I20260811 06:17:21.099058 11663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52508:
name: "default.Table_fbd1f2426373445db3e0a75c50681bb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 06:17:21.100008 11663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd1f2426373445db3e0a75c50681bb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 06:17:21.101629 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8dfa9eb84334e9e86434aa2d9593efd" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e"
I20260811 06:17:21.105652 15259 ts_tablet_manager.cc:1905] T 1649493bd0924ee48fd5044d7288932d P 56a371f7ed104f68a5db9ca097eb237e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 06:17:21.110749 15158 consensus_queue.cc:1035] T f4ed851746ef4861a624940952796a37 P 56a371f7ed104f68a5db9ca097eb237e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 06:17:21.118103 11365 tablet_bootstrap.cc:492] T ffbcb6061e544b5cb1a31bf1175fb0ba P 24d29113b2454d9c93e23db3e3dac801: Bootstrap starting.
I20260811 06:17:21.120123 11361 tablet_bootstrap.cc:492] T 52344eea7d3548feb9949beb09b34492 P f8dcf15ece3a4389932aa672079442b6: No bootstrap required, opened a new log
I20260811 06:17:21.120173 11365 tablet_bootstrap.cc:654] T ffbcb6061e544b5cb1a31bf1175fb0ba P 24d29113b2454d9c93e23db3e3dac801: Neither blocks nor log segments found. Creating new log.
I20260811 06:17:21.120399 11361 ts_tablet_manager.cc:1397] T 52344eea7d3548feb9949beb09b34492 P f8dcf15ece3a4389932aa672079442b6: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260811 06:17:21.123291 15158 raft_consensus.cc:482] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.123963 15158 raft_consensus.cc:504] T 3210614ebacf45c89d63413c51c8f923 P 56a371f7ed104f68a5db9ca097eb237e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:21.124601 14994 raft_consensus.cc:482] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.124717 14994 raft_consensus.cc:504] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:21.125607 14994 leader_election.cc:288] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.125952 10661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df64ad168f341be899eba30e55b7f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801" is_pre_election: true
I20260811 06:17:21.126212 10661 raft_consensus.cc:2454] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8dcf15ece3a4389932aa672079442b6 in term 0.
I20260811 06:17:21.126593 11046 leader_election.cc:302] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801, f8dcf15ece3a4389932aa672079442b6; no voters:
I20260811 06:17:21.126979 14994 raft_consensus.cc:2781] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 06:17:21.127075 14994 raft_consensus.cc:482] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 06:17:21.127199 14994 raft_consensus.cc:3037] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 06:17:21.130486 15337 raft_consensus.cc:482] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.130618 15337 raft_consensus.cc:504] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.130610 14994 raft_consensus.cc:504] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } } peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } }
I20260811 06:17:21.131567 14994 leader_election.cc:288] T 2df64ad168f341be899eba30e55b7f44 P f8dcf15ece3a4389932aa672079442b6 [CANDIDATE]: Term 1 election: Requested vote from peers 24d29113b2454d9c93e23db3e3dac801 (127.9.203.65:37755), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.132139 15337 leader_election.cc:288] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.132606 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446112faf4374fa29fea8bb40666856e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
W20260811 06:17:21.133289 10564 leader_election.cc:341] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.134061 15337 raft_consensus.cc:482] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 06:17:21.134203 15337 raft_consensus.cc:504] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8dcf15ece3a4389932aa672079442b6" member_type: VOTER last_known_addr { host: "127.9.203.67" port: 46797 } } peers { permanent_uuid: "56a371f7ed104f68a5db9ca097eb237e" member_type: VOTER last_known_addr { host: "127.9.203.66" port: 45845 } } peers { permanent_uuid: "24d29113b2454d9c93e23db3e3dac801" member_type: VOTER last_known_addr { host: "127.9.203.65" port: 37755 } }
I20260811 06:17:21.134768 15337 leader_election.cc:288] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797), 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845)
I20260811 06:17:21.134964 15261 ts_tablet_manager.cc:1918] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260811 06:17:21.135365 11106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9efc03bb295f45acabf65c33d6a4edf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 06:17:20 UTC) from {username='slave'} at 127.0.0.1:41374
I20260811 06:17:21.135478 11163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd91e4f85cc64de9a13c598a3695f8a1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8dcf15ece3a4389932aa672079442b6" is_pre_election: true
I20260811 06:17:21.135830 15261 log.cc:1196] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Deleting WAL directory at /tmp/dist-test-taskcM0g7B/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786429001281334-10029-0/minicluster-data/ts-2/wal/wals/1f48707b4fb746f49eaaf91b5b81e814
I20260811 06:17:21.135804 10658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2df64ad168f341be899eba30e55b7f44" candidate_uuid: "f8dcf15ece3a4389932aa672079442b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24d29113b2454d9c93e23db3e3dac801"
I20260811 06:17:21.136004 10658 raft_consensus.cc:3037] T 2df64ad168f341be899eba30e55b7f44 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Advancing to term 1
W20260811 06:17:21.135977 10564 leader_election.cc:341] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8dcf15ece3a4389932aa672079442b6 (127.9.203.67:46797): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.136664 15261 ts_tablet_manager.cc:1939] T 1f48707b4fb746f49eaaf91b5b81e814 P f8dcf15ece3a4389932aa672079442b6: Deleting consensus metadata
I20260811 06:17:21.138821 15261 tablet_replica.cc:330] T a5008449b09e43fba758a7edab4a5c48 P f8dcf15ece3a4389932aa672079442b6: stopping tablet replica
I20260811 06:17:21.139065 11663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 240) took 2445 ms. Trace:
I20260811 06:17:21.134202 10910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446112faf4374fa29fea8bb40666856e" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:21.138795 10918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd91e4f85cc64de9a13c598a3695f8a1" candidate_uuid: "24d29113b2454d9c93e23db3e3dac801" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a371f7ed104f68a5db9ca097eb237e" is_pre_election: true
I20260811 06:17:21.139272 11663 rpcz_store.cc:276] 0811 06:17:18.693910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:21.032231 (+2338321us) service_pool.cc:227] Handling call
0811 06:17:21.098709 (+ 66478us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x615000020ba4. stack: 00007f3e40f5166e 00007f3e40f51430 00007f3e3ffd85ed 00000000008ea064 00000000008ea02d 00007f3e4f66e27d 00007f3e4f66e373 00007f3e4c490361 00007f3e53e0366a 00007f3e53f8b313 00007f3e4b27d466 00007f3e4b27d195 00007f3e47a8d9be 00007f3e47a8c79e 00007f3e47a92b25 00007f3e47a9354f
0811 06:17:21.100165 (+ 1456us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:21.100635 (+ 470us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:21.138732 (+ 38097us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:21.138856 (+ 124us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:21.138954 (+ 98us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0811 06:17:21.121281 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0811 06:17:21.121384 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0811 06:17:21.121390 (+ 6us) write_op.cc:435] Acquired schema lock
0811 06:17:21.121393 (+ 3us) tablet.cc:660] Decoding operations
0811 06:17:21.121468 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0811 06:17:21.121477 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0811 06:17:21.121481 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0811 06:17:21.121545 (+ 64us) tablet.cc:699] Row locks acquired
0811 06:17:21.121548 (+ 3us) write_op.cc:260] PREPARE: finished
0811 06:17:21.121576 (+ 28us) write_op.cc:270] Start()
0811 06:17:21.121601 (+ 25us) write_op.cc:276] Timestamp: P: 1786429041121560 usec, L: 0
0811 06:17:21.121604 (+ 3us) op_driver.cc:331] REPLICATION: starting
0811 06:17:21.121871 (+ 267us) log.cc:842] Serialized 433 byte log entry
0811 06:17:21.129307 (+ 7436us) op_driver.cc:444] REPLICATION: finished
0811 06:17:21.130186 (+ 879us) write_op.cc:301] APPLY: starting
0811 06:17:21.130197 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0811 06:17:21.130231 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
0811 06:17:21.130279 (+ 48us) tablet.cc:1370] starting ApplyRowOperation cycle
0811 06:17:21.130397 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0811 06:17:21.130426 (+ 29us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0811 06:17:21.130432 (+ 6us) write_op.cc:312] APPLY: finished
0811 06:17:21.130488 (+ 56us) log.cc:842] Serialized 29 byte log entry
0811 06:17:21.130528 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.130544 (+ 16us) write_op.cc:454] Released schema lock
0811 06:17:21.130549 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0811 06:17:21.130596 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.130599 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":151905152,"child_traces":[["op",{"apply.queue_time_us":840,"apply.run_cpu_time_us":455,"apply.run_wall_time_us":454,"mutex_wait_us":19045,"num_ops":2,"prepare.queue_time_us":20178,"prepare.run_cpu_time_us":609,"prepare.run_wall_time_us":964,"raft.queue_time_us":52,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":7690}]]}
W20260811 06:17:21.139971 10555 leader_election.cc:341] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.140074 10555 leader_election.cc:302] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:21.140297 15337 raft_consensus.cc:2726] T fd91e4f85cc64de9a13c598a3695f8a1 P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260811 06:17:21.140664 10555 leader_election.cc:341] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56a371f7ed104f68a5db9ca097eb237e (127.9.203.66:45845): Illegal state: must be running to vote when last-logged opid is not known
I20260811 06:17:21.140926 10555 leader_election.cc:302] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24d29113b2454d9c93e23db3e3dac801; no voters: 56a371f7ed104f68a5db9ca097eb237e, f8dcf15ece3a4389932aa672079442b6
I20260811 06:17:21.141140 15337 raft_consensus.cc:2726] T 446112faf4374fa29fea8bb40666856e P 24d29113b2454d9c93e23db3e3dac801 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 06:17:21.142248 11655 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:52508 (request call id 241) took 2441 ms. Trace:
I20260811 06:17:21.142428 11655 rpcz_store.cc:276] 0811 06:17:18.700935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0811 06:17:21.072300 (+2371365us) service_pool.cc:227] Handling call
0811 06:17:21.074442 (+ 2142us) catalog_manager.cc:2075] Acquired catalog manager lock
0811 06:17:21.075017 (+ 575us) catalog_manager.cc:2121] Created new table and tablet info
0811 06:17:21.141956 (+ 66939us) write_op.cc:489] Releasing partition, row and schema locks
0811 06:17:21.141965 (+ 9us) write_op.cc:454] Released schema lock
0811 06:17:21.142037 (+ 72us) catalog_manager.cc:2181] Wrote table and tablets to system table
0811 06:17:21.142138 (+ 101us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0811 06:17:21.142227 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op'